Release Notes: IBM Aspera Command-Line Interface 3.7.7
Release Notes: IBM Aspera Command-Line Interface 3.7.7

Release Notes: IBM Aspera Command-Line Interface 3.7.7

Product Release: December 6, 2017
Release Notes Updated: April 18, 2018

IBM Aspera Command-Line Interface (the Aspera CLI) is a collection of Aspera tools for performing high-speed, secure data transfers from the command line. The Aspera CLI is for users and organizations who want to automate their transfer workflows.

The Aspera CLI comprises three command-line programs:
  • aspera, a command-line client for performing transfers with Aspera Faspex, Aspera Files, and Aspera Shares transfer servers.
  • The ascp command-line FASP transfer program.
  • ascp4, or A4, a FASP transfer program similar to ascp that has been optimized for sending large sets of individual files and can support UDP multicast through Aspera FASPStream.
Note: This release of the Aspera CLI does not support Shares 2.0.x. Support for Shares 2.0.x will be added in a future release.
Note: This release of the Aspera CLI does not support the Shares Management API or the Faspex v4 API.

NEW FEATURES

This release expands the options available for the Aspera CLI with Aspera Files:

You can now use the Aspera CLI to send packages to dropboxes in Aspera Files. To support this capability, the Aspera CLI now includes the following additional options for the files send subcommand:
Option Definition
-d dropbox_name

--dropbox=dropbox_name

Send a package to a Files dropbox.
Restrictions:
  • The user sending the package must have Can submit permissions to the specified dropbox.
  • You cannot specify multiple dropboxes.
  • If the dropbox is configured to require metadata, you must also use the -s or --metadata-file option (see below).
-s [path/]metadata_file

--metadata-file=[path/]metadata_file

Specify a file containing the metadata for this dropbox.
Restrictions:
  • If the dropbox is configured to require metadata and you do not specify a metadata file with this option, the Aspera CLI displays a template for the file you must create. See the Aspera CLI User Guide for more information.
  • The metadata file must be in JSON format.
  • If the metadata file is not located in the directory from which the command sequence is run, you must specify its path.

BREAKING CHANGES

If you are upgrading from a previous release, the following changes in this release may require you to adjust your workflow, configuration, or usage.

In order to match ascp and ascp4 syntax, a previous option for the aspera component has changed. Examine any Aspera CLI sequences you may have saved or automated, and adjust them accordingly. Details of the changed option are below:
Changed Aspera CLI Command Option Definition in Prior Releases New Definition Migration Notes
Get a list of the Files workspaces. -lw

--lsworkspace

-a

--lsworkspace

This change was made in order to avoid a conflict with an existing option for ascp.

SYSTEM REQUIREMENTS

Linux 64-bit: RedHat 6-7, CentOS 6-7, Fedora 16-20, Ubuntu 12-14, Debian 6-7, SLES 11-12 Kernel 2.4 or higher; and libc version GLIB 2.3.4-2.40.

Mac: OS X 10.8, 10.9, 10.10, 10.11, macOS 10.12, 10.13.

Windows: Windows 7, 8, 10, or Windows Server 2008 R2, 2012 R2, 2016.

PACKAGE INFORMATION

Linux 64-bit (rpm): aspera-cli-3.7.7.608.927cce8-linux-64-release.sh
md5: e92140d809e7e65112a5d1cd49c442cf
sha1: 9d1d5e6039503907e6266300da8a2550bf1cc75f
Mac OS X: aspera-cli-3.7.7.608.927cce8-mac-10.7-64-release.sh
md5: 3b8ae0278e4fd56aefd5be984146b383
sha1: 7a83cb9a1e7827456bb32791621f3646d867c358
Windows: aspera-cli-3.7.7.608.927cce8-win-v140_xp-32-release.zip
md5: 3b499fc933932f8977f780a61ce11a27
sha1: d96b2a8d5257ba2fe7e8f7b7107a641df0ec04b2

KNOWN ISSUES

Note: This version of the Aspera CLI was developed using two different issue-tracking systems; so the list below uses two different formats for issue numbers.

aspera

ACLI-141 - Transfers that use the aspera faspex send command fail if you use the -s (or --source_id) option and if the remote source argument for -f is written as just the filename (data.txt) or as the filename prepended with a backslash (\data.txt). Workaround: Enter the filename prepended with a forward slash (/data.txt).

ACLI-93 - [Windows only] For systems using PowerShell, you must use the following syntax to set the password as an environment variable:
> $env:ASPERA_PASS = "password"
When you set an environment variable for your password, your Aspera CLI command sequences will not require the -p option to specify the password.

ACLI-71 - [Mac OS X only] If you install the Aspera CLI to a location to which you lack permissions, the installation fails, but the installer nevertheless reports a successful installation.

ACLI-61 - [Windows only] When you specify a filepath using the %homepath% variable, the Aspera CLI action fails.

ACLI-48 - When you use the faspex list subcommand with the -x or --xml option for XML-formatted content, there is an issue with the formatting of the URLs that are returned. As a result, when you download the XML content with faspex get, the following error is returned:
Cannot parse an empty string
Workaround: Remove XML escape sequences (either manually or with an XML parser) from URLS before passing them as input to a faspex get subcommand.

ACLI-44 - When you specify the -b or --base-ca-path option with a filepath variable, the Aspera CLI fails to find the file or directory you specify.

ACLI-43 - When a Shares command is run on a share that the user does not have authorization for, the following error is returned:
JSON Exception: Error: Path not found
The error does not indicate that authorization is denied.

ACLI-18 - The Aspera CLI does not HTTP fallback. This support will be added in a future release.

#35287 - Transfers from the local computer to the Azure default inbox fail with the following error:
Setting up FASP parameters... Invalid access: Cannot convert empty value.

ascp

ATT-470 - When using HTTP fallback, downloads with in-line decryption sometimes fail after an upload to a server with EAR.

ATT-405 - When monitoring an ascp transfer, the FASP2 Management Protocol reports inconsistent WrittenBytes, FileBytes, and TransferredBytes.

ATT-395 - When running a persistent ascp session, a FaspManager FILEERROR message truncates a filename that is longer than 128 characters to only the first 128 characters.

ATT-361 - ascp transfers to S3 fail when the --symbolic-link=copy or --symbolic-link=copy+force option is used.

ATT-360 - Directory timestamps are not always preserved on the destination during an ascp transfer.

ATT-226 - If the docroot is a URL path, ascp reports incorrect bytes for the sessions that are involved in a multi-session transfer.

ATT-205 - ascp transfer fails with an internal memory error if <network_rc><module> is set to air in the <bandwidth> section of aspera.conf.

ATT-189 - In rare cases, ascp keeps running after it encounters a disk read error. (CIM-233)

ATT-185 - ascp does not reconnect to Redis database when asperanoded is restarted.

ATT-134 - [Windows, Linux]asdelete and ascp --delete-before-transfer commands that are initiated from Windows machines fail to delete files that are named with ASCII characters (< | ? * > : " \ ) on Linux machines.

ES-349 - When ascp is run with resume enabled (-k {1|2|3}), --preserve-file-owner-uid and --preserve-file-owner-gid are ignored.

ES-267 - Under rare conditions, ascp transfers to cloud object storage may be reported as successful even though Trapd reports an error and the content is not in the storage. (CIM-475)

ES-177 - The range_low value of a -@ argument is not respected.

ES-96 (#33091) - [Windows] Downloading files or folders that have names that end in a trailing space fail.

#35010 - If the source path in an ascp transfer is a file that is named \ (which is not supported by Aspera), the file is not transferred and an error is generated, but the folder then contains the file and all other files in that folder are transferred.

#34322 - [Linux CentOS 7.2] ascp fails to authenticate SSH with a large banner file size (approximately 2000 bytes).

#33094 - The ascp option delete-before-transfer is not supported for URI storage.

#32890 - During an ascp transfer that uses the --preserve-xattrs= metafile --remote-preserve-xattrs=metafile options, the metafile is not transferred.

#32680 - The option to create a directory (ascp -d) may create a directory at a destination before an expected session failure.

#32553 - When the FASP Session log source file list exceeds 500 bytes and contains multibyte UTF-8 characters, the output is truncated in a manner that creates an invalid UTF-8 sequence.

#31423 - It is possible for an ascp transfer of a file on a full disk to be reported as successful by both the sender and the receiver.

#30324 - During an ascp upload to cloud storage, if a mid-file read failure occurs on the sending computer (which is rare) it can cause the server-side ascp to crash and possibly fail to report transfer completion. This read failure can be caused when a source file is truncated during transfer, a drive or file system fails, or a transfer is canceled with Ctrl+C or other means.

#30231 - [Windows] If a pre-post script includes a path that contains ".." and the client is running on Windows, ascp fails with the following message:
Cannot open -e pre-post command: Unknown error

#29255 - Download from SoftLayer of a file larger than 62 GB is unsuccessful. Workaround: Do not use time-stamp preservation with SoftLayer.

#29043 - [Windows] Under serious WAN impairment, Hot Folder push transfers with a prepost script intermittently report an asssh error approximately 10-15 seconds after Transfer Statistics are reported to the log. This delay in process shutdown can hold the handle to the file list such that subsequent ascp processes fail.

#28939 - If command line ascp neglects to specify a destination host, then the failed transfer (error: "no remote host specified") gets recorded in SQLite with client_node_id NULL, instead of being populated with the uuid of the node. This database error causes an issue with Console.

#26281 - If you run approximately 100 (or a similarly high number) concurrent uploads to S3, intermittent transfer session failures can occur.

#26185 - During an upload to S3 storage, an error may result if ascp reports a successful file transfer before the transfer to S3 completes.

#25865 - Allowing symbolic links to be copied also allows access to locations outside the docroot.

#23503 - Uploads of zero-byte files to Akamai appear to be successful, but no file is present at the destination.

#22905 - When you copy a file in S3 storage with ascp, if a slash is appended to the destination -- for example, /path/ -- the file is renamed path/. Because of the trailing slash, it appears to be a directory, but is actually a file.

A4

ATT-438 - A4 downloads from object storage fail if the source filename contains special Unicode characters, such as Japanese font.

ATT-433 - [Windows] An ascp4 transfer that uses the --file-list option fails. (CIM-433) Workaround: Add an extra blank line to the end of the file list. For example,
c:\project\images
c:\project\docs

ATT-432 - [Linux Ubuntu] When downloading files from a server by using ascp4 in receive mode, if a docroot is configured for the transfer user and multiple source files are specified on the command line then only the first file is downloaded.

ATT-426 - To use SSH key authentication in A4, the full path to the private key must be specified as the argument for -i because A4 does not automatically look in the transfer user's home folder. This prevents Aspera Console from being able to use SSH keys if it is configured to use A4 instead of ascp because the full path cannot be specified in the Console UI.

ATT-366 - An ascp4 transfer to object storage does not fail immediately if chunk size is configured incorrectly. Workaround: On the client command line, set the chunk size equal to the size of the shared memory buffers used by Trapd with the --chunk-size option. By default, shared memory buffers are 1 MB, in which case --chunk-size=1048576 should be used.

ATT-338 - Parallel uploads of several large (>1 GB) files to object or HDFS storage may fail with the error "Peer aborted session" if the number of threads that are specified in the ascp4 command exceeds the number of jobs that are allowed to run by Trapd. Workaround: Open /opt/aspera/etc/trapd/trap.properties and set the value for aspera.session.upload.max-jobs to one larger than the number of ascp4 threads. For example,
# Number of jobs allowed to run in parallel for uploads.
            # Default is 15
            aspera.session.upload.max-jobs=50

ATT-321 - To use ascp4 to transfer with object storage, you must set the chunk size on the server to 64 kb for transfers that include primarily small files, and set it to 1 Mb for transfers that include primarily large files. If the chunk size is not set on the server, then the transfer fails.

ATT-298 - [Windows] When the destination has several million files, the source has few files, and <worker_threads> is set to 64 in aspera.conf, a download run with the --delete-before or --delete-after option can take several hours to delete files and might time out before finishing the deletion.

ATT-191 - [Linux] Symbolic links are not updated on the destination when the symbolic link option is follow (the default value when none is set) or copy.

ATT-44 - The timestamp of a parent directory that is transferred with ascp -p is not preserved, while the timestamps of the child files and directories are preserved.

ATT-39 - When ascp4 is run with the --no-write option, a 0-byte file and an .aspx (partial) file are created at the destination.

ATT-30 and ATT-46 - ascp4 transfer is slow when you upload many small files (for example, 1 million 4-byte files) to S3 storage.

ATT-29 - Files that are transferred to S3 storage with ascp4 retain a .partial extension when viewed in the GUI.

ATT-27 - Direct-to-cloud ascp4 transfers are skipped unless the full destination path is specified.

ATT-2 (#32295) - The default minimum transfer rate is not picked up from aspera.conf.

ES-247 - Console-initiated ascp4 transfers fail if the docroot on the source is a UNC path (for example, \\localhost\SHARE), returning the error ERR Source base/path is not a valid directory/file (doesn't match any source path). (CIM-397)

ES-151 - ascp4 does not recognize the UNC-path docroot of a Console transfer user. (CIM-197)

#29613 - [Windows] Timestamps are not preserved on top-level directories.

#26484 - A4 through Aspera Proxy is not supported.

PRODUCT SUPPORT

For on-line support resources for Aspera products, including raising new support tickets, please visit the Aspera Support Portal. Note that you may have an existing account if you contacted the Aspera support team in the past. Before creating a new account, first try setting a password for the email that you use to interact with us. You may also call one of our regional support centers.