BigQuery Data Transfer Service

This document describes the Google BigQuery Data Transfer Service.

Overview

The BigQuery Data Transfer Service automates loading data into BigQuery from YouTube, Google AdWords, and DoubleClick.

When you create a data transfer, you do so in the BigQuery web UI or the partner-level REST API. Currently, data transfer creation is not supported in the CLI. For more information on using the BigQuery Transfer Service API, see BigQuery Data Transfer Service API.

After you configure a data transfer, the BigQuery Data Transfer Service automatically schedules and manages recurring data loads from the source application into BigQuery. In addition to the automatically recurring data loads, you can manually trigger data loads with user-specified date ranges. When the source application adds a new report, modifies existing report formats, or updates the API, BigQuery Data Transfer Service updates to reflect the changes.

Supported data sources

Currently, the BigQuery Data Transfer Service supports the following reports:

For information on creating a data transfer for one of these data sources, see:

Supported regions

Like BigQuery, the BigQuery Data Transfer Service is a multi-regional resource. The BigQuery Data Transfer Service supports the same regions as BigQuery.

When you create a dataset to store your BigQuery Data Transfer Service data, you choose an appropriate data location. For more information, see the BigQuery Service Specific Terms.

Permissions

The following table lists the Google BigQuery API IAM roles with a corresponding list of all the BigQuery Data Transfer Service permissions each role includes.

Role includes permission(s): for resource type:
roles/bigquery.user
bigquery.transfers.get Project
roles/bigquery.admin

bigquery.transfers.get

bigquery.transfers.update

Project

For more information, see Access Control.

Pricing

For more information on BigQuery Data Transfer Service pricing, see: BigQuery Data Transfer Service Pricing.

Once data is transferred to BigQuery, standard BigQuery storage and query pricing applies.

Support

Before requesting support for the BigQuery Data Transfer Service, consult the BigQuery Data Transfer Service Transfer Setup Troubleshooting Guide.

If you need additional support, gather as much detail as possible, including:

  • Any error messages
  • Relevant screen captures
  • The Run Name of the failed transfer run (in the Run History, click the transfer run and note the Run Name details above the Log Messages section)

To request support:

  • For issues related to YouTube, DoubleClick, or Google AdWords reports, including report permissions, setup, format, and contents, contact the support team for the source application.
  • For issues related to billing, permissions, outages, and general Google Cloud Platform usage, refer to the Google Cloud Support page.
  • For questions on BigQuery Data Transfer Service pricing after the beta period, contact your Google Cloud Sales representative.

Monitor your resources on the go

Get the Google Cloud Console app to help you manage your projects.

Send feedback about...