Introduction to BigQuery Data Transfer Service

This page provides an overview of the BigQuery Data Transfer Service.

Overview

The BigQuery Data Transfer Service automates data movement into BigQuery on a scheduled, managed basis. Your analytics team can lay the foundation for a BigQuery data warehouse without writing a single line of code.

You can access the BigQuery Data Transfer Service using the:

After you configure a data transfer, the BigQuery Data Transfer Service automatically loads data into BigQuery on a regular basis. You can also initiate data backfills to recover from any outages or gaps. Currently, you cannot use the BigQuery Data Transfer Service to transfer data out of BigQuery.

Supported data sources

Currently, the BigQuery Data Transfer Service supports loading data from the following data sources:

Google Software as a Service (SaaS) apps External cloud storage providers Data warehouses In addition, several third-party transfers are available in the Google Cloud Marketplace.

Supported regions

Like BigQuery, the BigQuery Data Transfer Service is a multi-regional resource, with many additional single regions available.

A BigQuery dataset's locality is specified when you create a destination dataset to store the data transferred by the BigQuery Data Transfer Service. When you set up a transfer, the transfer configuration itself is set to the same location as the destination dataset. The BigQuery Data Transfer Service processes and stages data in the same location as the target BigQuery dataset.

The data you want to transfer to BigQuery can also have a region. In most cases, the region where your data is stored and the location of the destination dataset in BigQuery are irrelevant. In other kinds of transfers, the dataset and the source data must be colocated in the same region, or a compatible region.

For detailed information about transfers and region compatibility, see Dataset locations and transfers.

Pricing

For information on BigQuery Data Transfer Service pricing, see the Pricing page.

Once data is transferred to BigQuery, standard BigQuery storage and query pricing applies.

Quotas

For information on BigQuery Data Transfer Service qutoas, see the Quotas and limits page.

Next steps

To learn how to create a transfer, see the documentation for your data source:

Google Software as a Service (SaaS) apps External cloud storage providers Data warehouses In addition, several third-party transfers are available in the Google Cloud Marketplace.