Method: googleapis.bigquery.v2.jobs.insert

Starts a new asynchronous job. Requires the Can View project role.

This method waits—the workflow execution is paused—until the operation is complete, fails, or times out. The default timeout value is 1800 seconds (30 minutes) and can be changed to a maximum value of 31536000 seconds (one year) for long-running operations using the connector_params field. See the Connectors reference.

The connector uses polling to monitor the long-running operation, which might generate additional billable steps. For more information about retries and long-running operations, refer to Understand connectors.

The polling policy for the long-running operation can be configured. To set the connector-specific parameters (connector_params), refer to Invoke a connector call.

Learn more about how to load data into BigQuery and how to use schema auto-detection.

Arguments

Parameters
projectId

string

Required. Project ID of the project that will be billed for the job

body

object (Job)

Required.

Raised exceptions

Exceptions
ConnectionError In case of a network problem (such as DNS failure or refused connection).
HttpError If the response status is >= 400 (excluding 429 and 503).
TimeoutError If a long-running operation takes longer to finish than the specified timeout limit.
TypeError If an operation or function receives an argument of the wrong type.
ValueError If an operation or function receives an argument of the right type but an inappropriate value. For example, a negative timeout.
OperationError If the long-running operation finished unsuccessfully.
ResponseTypeError If the long-running operation returned a response of the wrong type.

Response

If successful, the response contains an instance of Job.

Subworkflow snippet

Some fields might be optional or required. To identify required fields, refer to the API documentation.

YAML

- insert:
    call: googleapis.bigquery.v2.jobs.insert
    args:
        projectId: ...
        body:
            configuration:
                copy:
                    createDisposition: ...
                    destinationEncryptionConfiguration:
                        kmsKeyName: ...
                    destinationExpirationTime: ...
                    destinationTable:
                        datasetId: ...
                        projectId: ...
                        tableId: ...
                    operationType: ...
                    sourceTable: ...
                    sourceTables: ...
                    writeDisposition: ...
                dryRun: ...
                extract:
                    compression: ...
                    destinationFormat: ...
                    destinationUri: ...
                    destinationUris: ...
                    fieldDelimiter: ...
                    printHeader: ...
                    sourceModel:
                        datasetId: ...
                        modelId: ...
                        projectId: ...
                    sourceTable: ...
                    useAvroLogicalTypes: ...
                jobTimeoutMs: ...
                labels: ...
                load:
                    allowJaggedRows: ...
                    allowQuotedNewlines: ...
                    autodetect: ...
                    clustering:
                        fields: ...
                    connectionProperties: ...
                    createDisposition: ...
                    createSession: ...
                    decimalTargetTypes: ...
                    destinationEncryptionConfiguration: ...
                    destinationTable: ...
                    destinationTableProperties:
                        description: ...
                        expirationTime: ...
                        friendlyName: ...
                        labels: ...
                    encoding: ...
                    fieldDelimiter: ...
                    hivePartitioningOptions:
                        mode: ...
                        requirePartitionFilter: ...
                        sourceUriPrefix: ...
                    ignoreUnknownValues: ...
                    jsonExtension: ...
                    maxBadRecords: ...
                    nullMarker: ...
                    parquetOptions:
                        enableListInference: ...
                        enumAsString: ...
                    preserveAsciiControlCharacters: ...
                    projectionFields: ...
                    quote: ...
                    rangePartitioning:
                        field: ...
                        range:
                            end: ...
                            interval: ...
                            start: ...
                    referenceFileSchemaUri: ...
                    schema:
                        fields: ...
                    schemaInline: ...
                    schemaInlineFormat: ...
                    schemaUpdateOptions: ...
                    skipLeadingRows: ...
                    sourceFormat: ...
                    sourceUris: ...
                    timePartitioning:
                        expirationMs: ...
                        field: ...
                        requirePartitionFilter: ...
                        type: ...
                    useAvroLogicalTypes: ...
                    writeDisposition: ...
                query:
                    allowLargeResults: ...
                    clustering: ...
                    connectionProperties: ...
                    createDisposition: ...
                    createSession: ...
                    defaultDataset:
                        datasetId: ...
                        projectId: ...
                    destinationEncryptionConfiguration: ...
                    destinationTable: ...
                    flattenResults: ...
                    maximumBillingTier: ...
                    maximumBytesBilled: ...
                    parameterMode: ...
                    preserveNulls: ...
                    priority: ...
                    query: ...
                    queryParameters: ...
                    rangePartitioning: ...
                    schemaUpdateOptions: ...
                    tableDefinitions: ...
                    timePartitioning: ...
                    useLegacySql: ...
                    useQueryCache: ...
                    userDefinedFunctionResources: ...
                    writeDisposition: ...
            jobReference:
                jobId: ...
                location: ...
                projectId: ...
    result: insertResult

JSON

[
  {
    "insert": {
      "call": "googleapis.bigquery.v2.jobs.insert",
      "args": {
        "projectId": "...",
        "body": {
          "configuration": {
            "copy": {
              "createDisposition": "...",
              "destinationEncryptionConfiguration": {
                "kmsKeyName": "..."
              },
              "destinationExpirationTime": "...",
              "destinationTable": {
                "datasetId": "...",
                "projectId": "...",
                "tableId": "..."
              },
              "operationType": "...",
              "sourceTable": "...",
              "sourceTables": "...",
              "writeDisposition": "..."
            },
            "dryRun": "...",
            "extract": {
              "compression": "...",
              "destinationFormat": "...",
              "destinationUri": "...",
              "destinationUris": "...",
              "fieldDelimiter": "...",
              "printHeader": "...",
              "sourceModel": {
                "datasetId": "...",
                "modelId": "...",
                "projectId": "..."
              },
              "sourceTable": "...",
              "useAvroLogicalTypes": "..."
            },
            "jobTimeoutMs": "...",
            "labels": "...",
            "load": {
              "allowJaggedRows": "...",
              "allowQuotedNewlines": "...",
              "autodetect": "...",
              "clustering": {
                "fields": "..."
              },
              "connectionProperties": "...",
              "createDisposition": "...",
              "createSession": "...",
              "decimalTargetTypes": "...",
              "destinationEncryptionConfiguration": "...",
              "destinationTable": "...",
              "destinationTableProperties": {
                "description": "...",
                "expirationTime": "...",
                "friendlyName": "...",
                "labels": "..."
              },
              "encoding": "...",
              "fieldDelimiter": "...",
              "hivePartitioningOptions": {
                "mode": "...",
                "requirePartitionFilter": "...",
                "sourceUriPrefix": "..."
              },
              "ignoreUnknownValues": "...",
              "jsonExtension": "...",
              "maxBadRecords": "...",
              "nullMarker": "...",
              "parquetOptions": {
                "enableListInference": "...",
                "enumAsString": "..."
              },
              "preserveAsciiControlCharacters": "...",
              "projectionFields": "...",
              "quote": "...",
              "rangePartitioning": {
                "field": "...",
                "range": {
                  "end": "...",
                  "interval": "...",
                  "start": "..."
                }
              },
              "referenceFileSchemaUri": "...",
              "schema": {
                "fields": "..."
              },
              "schemaInline": "...",
              "schemaInlineFormat": "...",
              "schemaUpdateOptions": "...",
              "skipLeadingRows": "...",
              "sourceFormat": "...",
              "sourceUris": "...",
              "timePartitioning": {
                "expirationMs": "...",
                "field": "...",
                "requirePartitionFilter": "...",
                "type": "..."
              },
              "useAvroLogicalTypes": "...",
              "writeDisposition": "..."
            },
            "query": {
              "allowLargeResults": "...",
              "clustering": "...",
              "connectionProperties": "...",
              "createDisposition": "...",
              "createSession": "...",
              "defaultDataset": {
                "datasetId": "...",
                "projectId": "..."
              },
              "destinationEncryptionConfiguration": "...",
              "destinationTable": "...",
              "flattenResults": "...",
              "maximumBillingTier": "...",
              "maximumBytesBilled": "...",
              "parameterMode": "...",
              "preserveNulls": "...",
              "priority": "...",
              "query": "...",
              "queryParameters": "...",
              "rangePartitioning": "...",
              "schemaUpdateOptions": "...",
              "tableDefinitions": "...",
              "timePartitioning": "...",
              "useLegacySql": "...",
              "useQueryCache": "...",
              "userDefinedFunctionResources": "...",
              "writeDisposition": "..."
            }
          },
          "jobReference": {
            "jobId": "...",
            "location": "...",
            "projectId": "..."
          }
        }
      },
      "result": "insertResult"
    }
  }
]