Data pipelines API

Data Pipelines provides an interface for creating, updating, and managing recurring Data Analytics jobs.


To call this service, we recommend that you use the Google-provided client libraries. If your application needs to use your own libraries to call this service, use the following information when you make the API requests.

Discovery document

A Discovery Document is a machine-readable specification for describing and consuming REST APIs. It is used to build client libraries, IDE plugins, and other tools that interact with Google APIs. One service may provide multiple discovery documents. This service provides the following discovery document:

Service endpoint

A service endpoint is a base URL that specifies the network address of an API service. One service might have multiple service endpoints. This service has the following service endpoint and all URIs below are relative to this service endpoint:


REST Resource: v1.projects.locations.pipelines

create POST /v1/{parent=projects/*/locations/*}/pipelines
Creates a pipeline.
delete DELETE /v1/{name=projects/*/locations/*/pipelines/*}
Deletes a pipeline.
get GET /v1/{name=projects/*/locations/*/pipelines/*}
Looks up a single pipeline.
list GET /v1/{parent=projects/*/locations/*}/pipelines
Lists pipelines.
patch PATCH /v1/{*/locations/*/pipelines/*}
Updates a pipeline.
run POST /v1/{name=projects/*/locations/*/pipelines/*}:run
Creates a job for the specified pipeline directly.
stop POST /v1/{name=projects/*/locations/*/pipelines/*}:stop
Freezes pipeline execution permanently.

REST Resource:

list GET /v1/{parent=projects/*/locations/*/pipelines/*}/jobs
Lists jobs for a given pipeline.