BigQuerySource

JSON representation

BigQuery source import data from.

JSON representation

JSON representation
{ "projectId": string, "datasetId": string, "tableId": string, "gcsStagingDir": string, "dataSchema": string, // Union field `partition` can be only one of the following: "partitionDate": { object (`Date`) } // End of list of possible types for union field `partition`. }

{
  "projectId": string,
  "datasetId": string,
  "tableId": string,
  "gcsStagingDir": string,
  "dataSchema": string,

  // Union field partition can be only one of the following:
  "partitionDate": {
    object (Date)
  }
  // End of list of possible types for union field partition.
}

Fields
`projectId`	`string` The project ID or the project number that contains the BigQuery source. Has a length limit of 128 characters. If not specified, inherits the project ID from the parent request.
`datasetId`	`string` Required. The BigQuery data set to copy the data from with a length limit of 1,024 characters.
`tableId`	`string` Required. The BigQuery table to copy the data from with a length limit of 1,024 characters.
`gcsStagingDir`	`string` Intermediate Cloud Storage directory used for the import with a length limit of 2,000 characters. Can be specified if one wants to have the BigQuery export to a specific Cloud Storage directory.
`dataSchema`	`string` The schema to use when parsing the data from the source. Supported values for user event imports: `user_event` (default): One `UserEvent` per row. Supported values for document imports: `document` (default): One `Document` format per row. Each document must have a valid `Document.id` and one of `Document.json_data` or `Document.struct_data`. `custom`: One custom data per row in arbitrary format that conforms to the defined `Schema` of the data store. This can only be used by the GENERIC Data Store vertical.
Union field `partition`. BigQuery table partition info. Leave this empty if the BigQuery table is not partitioned. `partition` can be only one of the following:
`partitionDate`	`object (Date)` BigQuery time partitioned table's _PARTITIONDATE in YYYY-MM-DD format.