Jump to

Storage Transfer Service

Secure, low-cost services for transferring data from cloud or on-premises sources.

  • action/check_circle_24px Created with Sketch.

    Complete transfers without writing a single line of code

  • action/check_circle_24px Created with Sketch.

    Centralized job management to monitor transfer status

  • action/check_circle_24px Created with Sketch.

    Security and reliability built in, every step of the way

  • action/check_circle_24px Created with Sketch.

    Configure your data transfer to meet your business needs: manage cost, time, and schedule

Benefits

Enable your hybrid- or multicloud strategy

Move data from your private data centers, AWS, Azure, and Google Cloud, globally available through a single, easy-to-use interface.

Optimize infrastructure management and costs

Reduce your infrastructure costs by moving your data storage and application infrastructure to Google Cloud, while minimizing downtime.

Complete large-scale data transfers fast

Transfer petabytes of data from on-premises sources or other clouds over online networks— billions of files and 10s of Gbps. Optimize your network bandwidth and accelerate transfers with scale-out performance.

Key features

Reliable and secure data transfer services

Storage Transfer Service for cloud data

Transfer data from online sources like AWS S3 and Azure Blob Storage to Cloud Storage in one simple process. Perform transfers as needed to enable a multicloud strategy, or periodically move data as part of a data-processing pipeline or analytical workflow.

Storage Transfer Service for on-premises data

Transfer petabytes of data from on-premises sources to Cloud Storage over online networks. With simplicity and security built in, this service scales to available bandwidth and can deliver seamless transfers in just minutes. Perform one-time transfers as needed, or set up recurring transfers for analytics, backup, or archival purposes.

See the latest updates about our Storage Transfer Service

Sign up for Google Cloud newsletters to receive product updates, event information, special offers, and more.

Documentation

Find resources and documentation for Storage Transfer Service

Best Practice
Migration to Google Cloud: transferring your large datasets

This document explores the process of moving data into Google Cloud, from planning a data transfer to using best practices in implementing a plan.

Google Cloud Basics
Storage Transfer Service overview

Access guides, references, and resources for learning more about Storage Transfer Service.

Tutorial
Managing transfers for on-premises jobs

This document describes how to create your transfer job, install transfer agents, and how to manage your transfer jobs.

Tutorial
Metadata preservation in Storage Transfer Service

This document describes metadata that is preserved when you use Storage Transfer Service for on-premises data to transfer data to Cloud Storage.

Use cases

Explore common use cases for Storage Transfer Service

Use case
Data center migration

Move from your existing infrastructure to the cloud. The data you create and store on-premises demands time and significant resources to manage cost-effectively, securely, and reliably. Utilize our Storage Transfer Service solutions to migrate your workloads and datasets quickly to Google Cloud and start saving. Learn about all of Google Cloud’s migration services and solutions.

Use case
Content storage and delivery

Storage Transfer Service enables you to push your media assets from other clouds or your private data center into multi-regional setups, designed for video streaming and frequently accessed content like websites and images. Moving data can enable more efficient content distribution and simpler publishing operations, with the help of products such as Cloud CDN.

Use case
Disaster recovery, backup, and archival

With our data transfer services, you can schedule incremental syncs to enable disaster recovery for apps running in other clouds and on-premises, to meet your recovery goals. Learn about all of our backup and disaster recovery options, or read about how to use Cloud Storage for archiving your data.

Use case
Analytics and machine learning

Once transferred to Cloud Storage, your data is enabled for analytics or machine learning projects, via data pipelines that are hybrid or run across multiple clouds or cloud regions. Wherever your data is, you can take advantage of Google Cloud’s analytics and machine learning suite. Learn more about our innovative machine learning products and services.

All features

Learn more about Storage Transfer Service features

Monitoring and logging Transfer service for on-premises data produces transfer logs so that you can verify the results of your transfer jobs and offers an option to monitor progress of transfer jobs via Cloud Monitoring. Storage Transfer Service could be configured to deliver Pub/Sub notification on transfer completion.
Data integrity Storage Transfer Service uses metadata available from the source storage system, such as checksums and file sizes, to ensure that data written to Cloud Storage is the same data read from the source. In addition to data integrity provided by the TLS protocol, the Storage Transfer Service for on-premises data calculates a CRC32C checksum over each file that it copies as the file is being read.
Security and encryption We use TLS encryption for HTTPs connections, through the public internet and private connections, and support transfers to Cloud Storage buckets protected by VPC Service Controls. The only exception to TLS encryption is if you specify an HTTP URL for a URL list transfer. If you are using interconnect, you can get another layer of security by accessing a private API endpoint.
Data transfer scheduling You can schedule one-time transfer operations or recurring transfer operations. When transferring data from other cloud providers, you can schedule periodic synchronization with advanced filters based on file creation dates, file-names, and the times of day you prefer to import data. There is no manual intervention needed, and the results are recorded in the Cloud Console.
Bandwidth throttling We’ve incorporated controls into Storage Transfer Service for on-premises data to avoid disruption of your day-to-day business operations. Configure a bandwidth limit for your Google Cloud project to limit the rate at which on-premises agents will copy files. The bandwidth limit is shared across all transfer jobs in your project.
Incremental transfer By default all transfers begin by evaluating the data present at the source and destination. This process determines which source objects are new, updated, or deleted since the last transfer. With this initial step, you are able to minimize the amount of data that needs to be sent, use bandwidth effectively, and ensure transfers run quickly.
Flexibility, filtering, and controls You can use includePrefix and excludePrefix when creating transfers to limit what objects Storage Transfer Service operates on. We also support modification-time-based data filtering options.
Dynamic scale out When transferring data from on-premises locations, getting better performance is as easy as bringing up more TSOP agents. No transfer config changes or re-submissions required. As soon as the agents are up, they will start performing transfer work.
Reliability and fault tolerance We make reliability work out of the box. If some of your agents fail, the remaining ones will pick up their work. If all of your agents fail, no problem—as soon as you bring them back up, transfers will pick up where they had left off. No special recovery or retry logic required.
Simple pricing When using Storage Transfer Service for on-premises data, we charge at a per-GB rate. When transferring data from other cloud providers, Storage Transfer Service is free of charge. After transferring data, you are charged for data stored on Cloud Storage as documented in Cloud Storage pricing, and external cloud providers' costs may also apply while you use Storage Transfer Service.
Transfer from a URL list You can use Storage Transfer Service to transfer data from a list of public data locations to a Cloud Storage bucket.

Pricing

Storage Transfer Service pricing details

For more detailed pricing information, please view the pricing guide.

Product Pricing
Storage Transfer Service Free
Storage Transfer Service for on-premises data $0.0125/GB

Partners

Storage Transfer Service partners

For advanced network-level optimization or ongoing data transfer workflows, you may want to use even more advanced tools offered by Google Cloud partners.