BigQuerySource(mapping=None, *, ignore_unknown_fields=False, **kwargs)
BigQuery source import data from.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Attributes
Name | Description |
partition_date |
google.type.date_pb2.Date
BigQuery time partitioned table's \_PARTITIONDATE in YYYY-MM-DD format. This field is a member of oneof _ partition .
|
project_id |
str
The project ID (can be project # or ID) that the BigQuery source is in with a length limit of 128 characters. If not specified, inherits the project ID from the parent request. |
dataset_id |
str
Required. The BigQuery data set to copy the data from with a length limit of 1,024 characters. |
table_id |
str
Required. The BigQuery table to copy the data from with a length limit of 1,024 characters. |
gcs_staging_dir |
str
Intermediate Cloud Storage directory used for the import with a length limit of 2,000 characters. Can be specified if one wants to have the BigQuery export to a specific Cloud Storage directory. |
data_schema |
str
The schema to use when parsing the data from the source. Supported values for imports: - user_event (default): One JSON
UserEvent
per line.
- document (default): One JSON
Document
per line. Each document must have a valid
[document.id][].
|