Method: projects.locations.processOpenLineageRunEvent

Creates new lineage events together with their parents: process and run. Updates the process and run if they already exist. Mapped from Open Lineage specification: https://github.com/OpenLineage/OpenLineage/blob/main/spec/OpenLineage.json.

HTTP request

POST https://datalineage.googleapis.com/v1/{parent}:processOpenLineageRunEvent

Path parameters

Parameters
parent

string

Required. The name of the project and its location that should own the process, run, and lineage event. It takes the form projects/{project}/locations/{location}.

Query parameters

Parameters
requestId

string

Optional. A unique identifier for this request. Restricted to 36 ASCII characters. A random UUID is recommended. This request is idempotent only if a requestId is provided.

Request body

The request body contains an instance of Struct.

Response body

Response message for locations.processOpenLineageRunEvent.

If successful, the response body contains data with the following structure:

JSON representation 
{
  "process": string,
  "run": string,
  "lineageEvents": [
    string
  ]
}
Fields
process

string

Created process name. Format: projects/{project}/locations/{location}/processes/{process}.
run

string

Created run name. Format: projects/{project}/locations/{location}/processes/{process}/runs/{run}.
lineageEvents[]

string

Created lineage event names. Format: projects/{project}/locations/{location}/processes/{process}/runs/{run}/lineageEvents/{lineageEvent}.

Authorization scopes

Requires the following OAuth scope:

  • https://www.googleapis.com/auth/cloud-platform

For more information, see the Authentication Overview.

IAM Permissions

Requires the following IAM permission on the parent resource:

  • datalineage.locations.processOpenLineageMessage

For more information, see the IAM documentation.