REST Resource: projects.locations.processes

Resource: Process

A process is the definition of a data transformation operation.

JSON representation
{
  "name": string,
  "displayName": string,
  "attributes": {
    string: value,
    ...
  },
  "origin": {
    object (Origin)
  }
}
Fields
name

string

Immutable. The resource name of the lineage process. Format: projects/{project}/locations/{location}/processes/{process}. Can be specified or auto-assigned. {process} must be not longer than 200 characters and only contain characters in a set: a-zA-Z0-9_-:.

displayName

string

Optional. A human-readable name you can set to display in a user interface. Must be not longer than 200 characters and only contain UTF-8 letters or numbers, spaces or characters like _-:&.

attributes

map (key: string, value: value (Value format))

Optional. The attributes of the process. Should only be used for the purpose of non-semantic management (classifying, describing or labeling the process).

Up to 100 attributes are allowed.

origin

object (Origin)

Optional. The origin of this process and its runs and lineage events.

Origin

Origin of a process.

JSON representation
{
  "sourceType": enum (SourceType),
  "name": string
}
Fields
sourceType

enum (SourceType)

Type of the source.

Use of a sourceType other than CUSTOM for process creation or updating is highly discouraged. It might be restricted in the future without notice. There will be increase in cost if you use any of the source types other than CUSTOM.

name

string

If the sourceType isn't CUSTOM, the value of this field should be a GCP resource name of the system, which reports lineage. The project and location parts of the resource name must match the project and location of the lineage resource being created. Examples:

  • {sourceType: COMPOSER, name: "projects/foo/locations/us/environments/bar"}
  • {sourceType: BIGQUERY, name: "projects/foo/locations/eu"}
  • {sourceType: CUSTOM, name: "myCustomIntegration"}

SourceType

Type of the source of a process.

Enums
SOURCE_TYPE_UNSPECIFIED Source is Unspecified
CUSTOM A custom source
BIGQUERY BigQuery
DATA_FUSION Data Fusion
COMPOSER Composer
LOOKER_STUDIO Looker Studio
DATAPROC Dataproc
VERTEX_AI Vertex AI

Methods

create

Creates a new process.

delete

Deletes the process with the specified name.

get

Gets the details of the specified process.

list

List processes in the given project and location.

patch

Updates a process.