REST Resource: projects.transferConfigs

Resource: TransferConfig

Represents a data transfer configuration. A transfer configuration contains all metadata needed to perform a data transfer. For example, destinationDatasetId specifies where data should be stored. When a new transfer configuration is created, the specified destinationDatasetId is created when needed and shared with the appropriate data source service account.

JSON representation
{
  "name": string,
  "destinationDatasetId": string,
  "displayName": string,
  "dataSourceId": string,
  "params": {
    object
  },
  "schedule": string,
  "dataRefreshWindowDays": number,
  "disabled": boolean,
  "updateTime": string,
  "nextRunTime": string,
  "state": enum(TransferState),
  "userId": string,
  "datasetRegion": string,
}
Fields
name

string

The resource name of the transfer config. Transfer config names have the form projects/{project_id}/transferConfigs/{config_id}. Where config_id is usually a uuid, even though it is not guaranteed or required. The name is ignored when creating a transfer config.

destinationDatasetId

string

The BigQuery target dataset id.

displayName

string

User specified display name for the data transfer.

dataSourceId

string

Data source id. Cannot be changed once data transfer is created.

params

object (Struct format)

Data transfer specific parameters.

schedule

string

Data transfer schedule. If the data source does not support a custom schedule, this should be empty. If it is empty, the default value for the data source will be used. The specified times are in UTC. Examples of valid format: 1st,3rd monday of month 15:30, every wed,fri of jan,jun 13:15, and first sunday of quarter 00:00. See more explanation about the format here: https://cloud.google.com/appengine/docs/flexible/python/scheduling-jobs-with-cron-yaml#the_schedule_format NOTE: the granularity should be at least 8 hours, or less frequent.

dataRefreshWindowDays

number

The number of days to look back to automatically refresh the data. For example, if dataRefreshWindowDays = 10, then every day BigQuery reingests data for [today-10, today-1], rather than ingesting data for just [today-1]. Only valid if the data source supports the feature. Set the value to 0 to use the default value.

disabled

boolean

Is this config disabled. When set to true, no runs are scheduled for a given transfer.

updateTime

string (Timestamp format)

Output only. Data transfer modification time. Ignored by server on input.

nextRunTime

string (Timestamp format)

Output only. Next time when data transfer will run.

state

enum(TransferState)

Output only. State of the most recently updated transfer run.

userId

string (int64 format)

Output only. Unique ID of the user on whose behalf transfer is done. Applicable only to data sources that do not support service accounts. When set to 0, the data source service account credentials are used.

datasetRegion

string

Output only. Region in which BigQuery dataset is located.

Methods

create

Creates a new data transfer configuration.

delete

Deletes a data transfer configuration, including any associated transfer runs and logs.

get

Returns information about a data transfer config.

list

Returns information about all data transfers in the project.

patch

Updates a data transfer configuration.

scheduleRuns

Creates transfer runs for a time range [range_start_time, range_end_time].

Monitor your resources on the go

Get the Google Cloud Console app to help you manage your projects.

Send feedback about...