Sources and sinks

Storage Transfer Service can transfer data from a number of sources to a number of destinations. The table below details the supported sources and destinations.

Storage system Source Destination Notes
Cloud Storage

Cloud Storage is a valid sink for transfers from all sources.

Transfers from Cloud Storage, Amazon S3, and Azure to Cloud Storage do not require agents or agent pools; they are managed entirely by Storage Transfer Service.

To configure Cloud Storage as a source and/or sink, refer to the following pages:

Amazon Simple Storage Service (Amazon S3)

Transfers to Cloud Storage only. Does not require agents or agent pools.

To configure Amazon S3, refer to Configure access to a source: Amazon S3.

S3-compatible storage

Transfers to Cloud Storage only. Requires agents and agent pools.

To configure S3-compatible storage, refer to Configure access to a source: S3-compatible storage.

Azure Blob Storage, including Azure Data Lake Storage Gen2

Transfers to Cloud Storage only. Does not require agents or agent pools.

To configure Azure storage options, refer to Configure access to a source: Microsoft Azure Storage.

Publicly accessible or signed HTTP and HTTPs URLs

Storage Transfer Service accepts a TSV file specifying a list of URLs to transfer.

Transfers to Cloud Storage only. Does not require agents or agent pools.

See Create a URL list for details.

File system

Storage Transfer Service supports transfers:

  • From file systems to Cloud Storage
  • From Cloud Storage to file systems
  • Between two file systems

Transfers involving file systems require agents and agent pools. See Manage agent pools to get started.

Hadoop distributed file system (HDFS)

Transfers to Cloud Storage only. Requires agents and agent pools.

To configure a transfer from an HDFS source, refer to Transfer from HDFS to Cloud Storage.