public static interface LineageGrpc.AsyncService
Lineage is used to track data flows between assets over time. You can create LineageEvents to record lineage between multiple sources and a single target, for example, when table data is based on data from multiple tables.
Methods
batchSearchLinkProcesses(BatchSearchLinkProcessesRequest request, StreamObserver<BatchSearchLinkProcessesResponse> responseObserver)
public default void batchSearchLinkProcesses(BatchSearchLinkProcessesRequest request, StreamObserver<BatchSearchLinkProcessesResponse> responseObserver)
Retrieve information about LineageProcesses associated with specific
links. LineageProcesses are transformation pipelines that result in data
flowing from source to target assets. Links between assets
represent this operation.
If you have specific link names, you can use this method to
verify which LineageProcesses contribute to creating those links.
See the
SearchLinks
method for more information on how to retrieve link name.
You can retrieve the LineageProcess information in every project where you
have the datalineage.events.get
permission. The project provided in the
URL is used for Billing and Quota.
Parameters | |
---|---|
Name | Description |
request | BatchSearchLinkProcessesRequest |
responseObserver | io.grpc.stub.StreamObserver<BatchSearchLinkProcessesResponse> |
createLineageEvent(CreateLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)
public default void createLineageEvent(CreateLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)
Creates a new lineage event.
Parameters | |
---|---|
Name | Description |
request | CreateLineageEventRequest |
responseObserver | io.grpc.stub.StreamObserver<LineageEvent> |
createProcess(CreateProcessRequest request, StreamObserver<Process> responseObserver)
public default void createProcess(CreateProcessRequest request, StreamObserver<Process> responseObserver)
Creates a new process.
Parameters | |
---|---|
Name | Description |
request | CreateProcessRequest |
responseObserver | io.grpc.stub.StreamObserver<Process> |
createRun(CreateRunRequest request, StreamObserver<Run> responseObserver)
public default void createRun(CreateRunRequest request, StreamObserver<Run> responseObserver)
Creates a new run.
Parameters | |
---|---|
Name | Description |
request | CreateRunRequest |
responseObserver | io.grpc.stub.StreamObserver<Run> |
deleteLineageEvent(DeleteLineageEventRequest request, StreamObserver<Empty> responseObserver)
public default void deleteLineageEvent(DeleteLineageEventRequest request, StreamObserver<Empty> responseObserver)
Deletes the lineage event with the specified name.
Parameters | |
---|---|
Name | Description |
request | DeleteLineageEventRequest |
responseObserver | io.grpc.stub.StreamObserver<Empty> |
deleteProcess(DeleteProcessRequest request, StreamObserver<Operation> responseObserver)
public default void deleteProcess(DeleteProcessRequest request, StreamObserver<Operation> responseObserver)
Deletes the process with the specified name.
Parameters | |
---|---|
Name | Description |
request | DeleteProcessRequest |
responseObserver | io.grpc.stub.StreamObserver<Operation> |
deleteRun(DeleteRunRequest request, StreamObserver<Operation> responseObserver)
public default void deleteRun(DeleteRunRequest request, StreamObserver<Operation> responseObserver)
Deletes the run with the specified name.
Parameters | |
---|---|
Name | Description |
request | DeleteRunRequest |
responseObserver | io.grpc.stub.StreamObserver<Operation> |
getLineageEvent(GetLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)
public default void getLineageEvent(GetLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)
Gets details of a specified lineage event.
Parameters | |
---|---|
Name | Description |
request | GetLineageEventRequest |
responseObserver | io.grpc.stub.StreamObserver<LineageEvent> |
getProcess(GetProcessRequest request, StreamObserver<Process> responseObserver)
public default void getProcess(GetProcessRequest request, StreamObserver<Process> responseObserver)
Gets the details of the specified process.
Parameters | |
---|---|
Name | Description |
request | GetProcessRequest |
responseObserver | io.grpc.stub.StreamObserver<Process> |
getRun(GetRunRequest request, StreamObserver<Run> responseObserver)
public default void getRun(GetRunRequest request, StreamObserver<Run> responseObserver)
Gets the details of the specified run.
Parameters | |
---|---|
Name | Description |
request | GetRunRequest |
responseObserver | io.grpc.stub.StreamObserver<Run> |
listLineageEvents(ListLineageEventsRequest request, StreamObserver<ListLineageEventsResponse> responseObserver)
public default void listLineageEvents(ListLineageEventsRequest request, StreamObserver<ListLineageEventsResponse> responseObserver)
Lists lineage events in the given project and location. The list order is not defined.
Parameters | |
---|---|
Name | Description |
request | ListLineageEventsRequest |
responseObserver | io.grpc.stub.StreamObserver<ListLineageEventsResponse> |
listProcesses(ListProcessesRequest request, StreamObserver<ListProcessesResponse> responseObserver)
public default void listProcesses(ListProcessesRequest request, StreamObserver<ListProcessesResponse> responseObserver)
List processes in the given project and location. List order is descending by insertion time.
Parameters | |
---|---|
Name | Description |
request | ListProcessesRequest |
responseObserver | io.grpc.stub.StreamObserver<ListProcessesResponse> |
listRuns(ListRunsRequest request, StreamObserver<ListRunsResponse> responseObserver)
public default void listRuns(ListRunsRequest request, StreamObserver<ListRunsResponse> responseObserver)
Lists runs in the given project and location. List order is descending by
start_time
.
Parameters | |
---|---|
Name | Description |
request | ListRunsRequest |
responseObserver | io.grpc.stub.StreamObserver<ListRunsResponse> |
processOpenLineageRunEvent(ProcessOpenLineageRunEventRequest request, StreamObserver<ProcessOpenLineageRunEventResponse> responseObserver)
public default void processOpenLineageRunEvent(ProcessOpenLineageRunEventRequest request, StreamObserver<ProcessOpenLineageRunEventResponse> responseObserver)
Creates new lineage events together with their parents: process and run. Updates the process and run if they already exist. Mapped from Open Lineage specification: https://github.com/OpenLineage/OpenLineage/blob/main/spec/OpenLineage.json.
Parameters | |
---|---|
Name | Description |
request | ProcessOpenLineageRunEventRequest |
responseObserver | io.grpc.stub.StreamObserver<ProcessOpenLineageRunEventResponse> |
searchLinks(SearchLinksRequest request, StreamObserver<SearchLinksResponse> responseObserver)
public default void searchLinks(SearchLinksRequest request, StreamObserver<SearchLinksResponse> responseObserver)
Retrieve a list of links connected to a specific asset.
Links represent the data flow between source (upstream)
and target (downstream) assets in transformation pipelines.
Links are stored in the same project as the Lineage Events that create
them.
You can retrieve links in every project where you have the
datalineage.events.get
permission. The project provided in the URL
is used for Billing and Quota.
Parameters | |
---|---|
Name | Description |
request | SearchLinksRequest |
responseObserver | io.grpc.stub.StreamObserver<SearchLinksResponse> |
updateProcess(UpdateProcessRequest request, StreamObserver<Process> responseObserver)
public default void updateProcess(UpdateProcessRequest request, StreamObserver<Process> responseObserver)
Updates a process.
Parameters | |
---|---|
Name | Description |
request | UpdateProcessRequest |
responseObserver | io.grpc.stub.StreamObserver<Process> |
updateRun(UpdateRunRequest request, StreamObserver<Run> responseObserver)
public default void updateRun(UpdateRunRequest request, StreamObserver<Run> responseObserver)
Updates a run.
Parameters | |
---|---|
Name | Description |
request | UpdateRunRequest |
responseObserver | io.grpc.stub.StreamObserver<Run> |