Interface LineageGrpc.AsyncService (0.24.0)

public static interface LineageGrpc.AsyncService

Lineage is used to track data flows between assets over time. You can create LineageEvents to record lineage between multiple sources and a single target, for example, when table data is based on data from multiple tables.

Methods

batchSearchLinkProcesses(BatchSearchLinkProcessesRequest request, StreamObserver<BatchSearchLinkProcessesResponse> responseObserver)

public default void batchSearchLinkProcesses(BatchSearchLinkProcessesRequest request, StreamObserver<BatchSearchLinkProcessesResponse> responseObserver)

Retrieve information about LineageProcesses associated with specific links. LineageProcesses are transformation pipelines that result in data flowing from source to target assets. Links between assets represent this operation. If you have specific link names, you can use this method to verify which LineageProcesses contribute to creating those links. See the SearchLinks method for more information on how to retrieve link name. You can retrieve the LineageProcess information in every project where you have the datalineage.events.get permission. The project provided in the URL is used for Billing and Quota.

Parameters
NameDescription
requestBatchSearchLinkProcessesRequest
responseObserverio.grpc.stub.StreamObserver<BatchSearchLinkProcessesResponse>

createLineageEvent(CreateLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

public default void createLineageEvent(CreateLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

Creates a new lineage event.

Parameters
NameDescription
requestCreateLineageEventRequest
responseObserverio.grpc.stub.StreamObserver<LineageEvent>

createProcess(CreateProcessRequest request, StreamObserver<Process> responseObserver)

public default void createProcess(CreateProcessRequest request, StreamObserver<Process> responseObserver)

Creates a new process.

Parameters
NameDescription
requestCreateProcessRequest
responseObserverio.grpc.stub.StreamObserver<Process>

createRun(CreateRunRequest request, StreamObserver<Run> responseObserver)

public default void createRun(CreateRunRequest request, StreamObserver<Run> responseObserver)

Creates a new run.

Parameters
NameDescription
requestCreateRunRequest
responseObserverio.grpc.stub.StreamObserver<Run>

deleteLineageEvent(DeleteLineageEventRequest request, StreamObserver<Empty> responseObserver)

public default void deleteLineageEvent(DeleteLineageEventRequest request, StreamObserver<Empty> responseObserver)

Deletes the lineage event with the specified name.

Parameters
NameDescription
requestDeleteLineageEventRequest
responseObserverio.grpc.stub.StreamObserver<Empty>

deleteProcess(DeleteProcessRequest request, StreamObserver<Operation> responseObserver)

public default void deleteProcess(DeleteProcessRequest request, StreamObserver<Operation> responseObserver)

Deletes the process with the specified name.

Parameters
NameDescription
requestDeleteProcessRequest
responseObserverio.grpc.stub.StreamObserver<Operation>

deleteRun(DeleteRunRequest request, StreamObserver<Operation> responseObserver)

public default void deleteRun(DeleteRunRequest request, StreamObserver<Operation> responseObserver)

Deletes the run with the specified name.

Parameters
NameDescription
requestDeleteRunRequest
responseObserverio.grpc.stub.StreamObserver<Operation>

getLineageEvent(GetLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

public default void getLineageEvent(GetLineageEventRequest request, StreamObserver<LineageEvent> responseObserver)

Gets details of a specified lineage event.

Parameters
NameDescription
requestGetLineageEventRequest
responseObserverio.grpc.stub.StreamObserver<LineageEvent>

getProcess(GetProcessRequest request, StreamObserver<Process> responseObserver)

public default void getProcess(GetProcessRequest request, StreamObserver<Process> responseObserver)

Gets the details of the specified process.

Parameters
NameDescription
requestGetProcessRequest
responseObserverio.grpc.stub.StreamObserver<Process>

getRun(GetRunRequest request, StreamObserver<Run> responseObserver)

public default void getRun(GetRunRequest request, StreamObserver<Run> responseObserver)

Gets the details of the specified run.

Parameters
NameDescription
requestGetRunRequest
responseObserverio.grpc.stub.StreamObserver<Run>

listLineageEvents(ListLineageEventsRequest request, StreamObserver<ListLineageEventsResponse> responseObserver)

public default void listLineageEvents(ListLineageEventsRequest request, StreamObserver<ListLineageEventsResponse> responseObserver)

Lists lineage events in the given project and location. The list order is not defined.

Parameters
NameDescription
requestListLineageEventsRequest
responseObserverio.grpc.stub.StreamObserver<ListLineageEventsResponse>

listProcesses(ListProcessesRequest request, StreamObserver<ListProcessesResponse> responseObserver)

public default void listProcesses(ListProcessesRequest request, StreamObserver<ListProcessesResponse> responseObserver)

List processes in the given project and location. List order is descending by insertion time.

Parameters
NameDescription
requestListProcessesRequest
responseObserverio.grpc.stub.StreamObserver<ListProcessesResponse>

listRuns(ListRunsRequest request, StreamObserver<ListRunsResponse> responseObserver)

public default void listRuns(ListRunsRequest request, StreamObserver<ListRunsResponse> responseObserver)

Lists runs in the given project and location. List order is descending by start_time.

Parameters
NameDescription
requestListRunsRequest
responseObserverio.grpc.stub.StreamObserver<ListRunsResponse>

processOpenLineageRunEvent(ProcessOpenLineageRunEventRequest request, StreamObserver<ProcessOpenLineageRunEventResponse> responseObserver)

public default void processOpenLineageRunEvent(ProcessOpenLineageRunEventRequest request, StreamObserver<ProcessOpenLineageRunEventResponse> responseObserver)

Creates new lineage events together with their parents: process and run. Updates the process and run if they already exist. Mapped from Open Lineage specification: https://github.com/OpenLineage/OpenLineage/blob/main/spec/OpenLineage.json.

Parameters
NameDescription
requestProcessOpenLineageRunEventRequest
responseObserverio.grpc.stub.StreamObserver<ProcessOpenLineageRunEventResponse>
public default void searchLinks(SearchLinksRequest request, StreamObserver<SearchLinksResponse> responseObserver)

Retrieve a list of links connected to a specific asset. Links represent the data flow between source (upstream) and target (downstream) assets in transformation pipelines. Links are stored in the same project as the Lineage Events that create them. You can retrieve links in every project where you have the datalineage.events.get permission. The project provided in the URL is used for Billing and Quota.

Parameters
NameDescription
requestSearchLinksRequest
responseObserverio.grpc.stub.StreamObserver<SearchLinksResponse>

updateProcess(UpdateProcessRequest request, StreamObserver<Process> responseObserver)

public default void updateProcess(UpdateProcessRequest request, StreamObserver<Process> responseObserver)

Updates a process.

Parameters
NameDescription
requestUpdateProcessRequest
responseObserverio.grpc.stub.StreamObserver<Process>

updateRun(UpdateRunRequest request, StreamObserver<Run> responseObserver)

public default void updateRun(UpdateRunRequest request, StreamObserver<Run> responseObserver)

Updates a run.

Parameters
NameDescription
requestUpdateRunRequest
responseObserverio.grpc.stub.StreamObserver<Run>