- 2.47.0 (latest)
- 2.46.0
- 2.45.0
- 2.44.0
- 2.43.0
- 2.42.0
- 2.41.0
- 2.40.0
- 2.39.0
- 2.37.0
- 2.36.0
- 2.35.0
- 2.34.0
- 2.33.0
- 2.32.0
- 2.31.0
- 2.30.0
- 2.29.0
- 2.28.0
- 2.27.0
- 2.24.0
- 2.23.0
- 2.22.0
- 2.21.0
- 2.20.0
- 2.19.0
- 2.18.0
- 2.17.0
- 2.16.0
- 2.15.0
- 2.14.0
- 2.13.0
- 2.12.0
- 2.11.0
- 2.10.0
- 2.9.0
- 2.8.0
- 2.7.0
- 2.6.0
- 2.5.0
- 2.4.0
- 2.3.17
- 2.2.6
- 2.1.23
- 2.0.27
public abstract static class DataSourceServiceGrpc.DataSourceServiceImplBase implements BindableService
The Google BigQuery Data Transfer API allows BigQuery users to configure transfer of their data from other Google Products into BigQuery. This service exposes methods that should be used by data source backend.
Implements
io.grpc.BindableServiceConstructors
DataSourceServiceImplBase()
public DataSourceServiceImplBase()
Methods
bindService()
public final ServerServiceDefinition bindService()
Returns | |
---|---|
Type | Description |
io.grpc.ServerServiceDefinition |
createDataSourceDefinition(CreateDataSourceDefinitionRequest request, StreamObserver<DataSourceDefinition> responseObserver)
public void createDataSourceDefinition(CreateDataSourceDefinitionRequest request, StreamObserver<DataSourceDefinition> responseObserver)
Creates a data source definition. Calling this method will automatically use your credentials to create the following Google Cloud resources in YOUR Google Cloud project.
- OAuth client
- Pub/Sub Topics and Subscriptions in each supported_location_ids. e.g., projects/{project_id}/{topics|subscriptions}/bigquerydatatransfer.{data_source_id}.{location_id}.run The field data_source.client_id should be left empty in the input request, as the API will create a new OAuth client on behalf of the caller. On the other hand data_source.scopes usually need to be set when there are OAuth scopes that need to be granted by end users.
- We need a longer deadline due to the 60 seconds SLO from Pub/Sub admin Operations. This also applies to update and delete data source definition.
Parameters | |
---|---|
Name | Description |
request | CreateDataSourceDefinitionRequest |
responseObserver | io.grpc.stub.StreamObserver<DataSourceDefinition> |
deleteDataSourceDefinition(DeleteDataSourceDefinitionRequest request, StreamObserver<Empty> responseObserver)
public void deleteDataSourceDefinition(DeleteDataSourceDefinitionRequest request, StreamObserver<Empty> responseObserver)
Deletes a data source definition, all of the transfer configs associated with this data source definition (if any) must be deleted first by the user in ALL regions, in order to delete the data source definition. This method is primarily meant for deleting data sources created during testing stage. If the data source is referenced by transfer configs in the region specified in the request URL, the method will fail immediately. If in the current region (e.g., US) it's not used by any transfer configs, but in another region (e.g., EU) it is, then although the method will succeed in region US, but it will fail when the deletion operation is replicated to region EU. And eventually, the system will replicate the data source definition back from EU to US, in order to bring all regions to consistency. The final effect is that the data source appears to be 'undeleted' in the US region.
Parameters | |
---|---|
Name | Description |
request | DeleteDataSourceDefinitionRequest |
responseObserver | io.grpc.stub.StreamObserver<Empty> |
finishRun(FinishRunRequest request, StreamObserver<Empty> responseObserver)
public void finishRun(FinishRunRequest request, StreamObserver<Empty> responseObserver)
Notify the Data Transfer Service that the data source is done processing the run. No more status updates or requests to start/monitor jobs will be accepted. The run will be finalized by the Data Transfer Service when all monitored jobs are completed. Does not need to be called if the run is set to FAILED.
Parameters | |
---|---|
Name | Description |
request | FinishRunRequest |
responseObserver | io.grpc.stub.StreamObserver<Empty> |
getDataSourceDefinition(GetDataSourceDefinitionRequest request, StreamObserver<DataSourceDefinition> responseObserver)
public void getDataSourceDefinition(GetDataSourceDefinitionRequest request, StreamObserver<DataSourceDefinition> responseObserver)
Retrieves an existing data source definition.
Parameters | |
---|---|
Name | Description |
request | GetDataSourceDefinitionRequest |
responseObserver | io.grpc.stub.StreamObserver<DataSourceDefinition> |
listDataSourceDefinitions(ListDataSourceDefinitionsRequest request, StreamObserver<ListDataSourceDefinitionsResponse> responseObserver)
public void listDataSourceDefinitions(ListDataSourceDefinitionsRequest request, StreamObserver<ListDataSourceDefinitionsResponse> responseObserver)
Lists supported data source definitions.
Parameters | |
---|---|
Name | Description |
request | ListDataSourceDefinitionsRequest |
responseObserver | io.grpc.stub.StreamObserver<ListDataSourceDefinitionsResponse> |
logTransferRunMessages(LogTransferRunMessagesRequest request, StreamObserver<Empty> responseObserver)
public void logTransferRunMessages(LogTransferRunMessagesRequest request, StreamObserver<Empty> responseObserver)
Log messages for a transfer run. If successful (at least 1 message), resets data_source.update_deadline_seconds timer.
Parameters | |
---|---|
Name | Description |
request | LogTransferRunMessagesRequest |
responseObserver | io.grpc.stub.StreamObserver<Empty> |
startBigQueryJobs(StartBigQueryJobsRequest request, StreamObserver<Empty> responseObserver)
public void startBigQueryJobs(StartBigQueryJobsRequest request, StreamObserver<Empty> responseObserver)
Notify the Data Transfer Service that data is ready for loading. The Data Transfer Service will start and monitor multiple BigQuery Load jobs for a transfer run. Monitored jobs will be automatically retried and produce log messages when starting and finishing a job. Can be called multiple times for the same transfer run.
Parameters | |
---|---|
Name | Description |
request | StartBigQueryJobsRequest |
responseObserver | io.grpc.stub.StreamObserver<Empty> |
updateDataSourceDefinition(UpdateDataSourceDefinitionRequest request, StreamObserver<DataSourceDefinition> responseObserver)
public void updateDataSourceDefinition(UpdateDataSourceDefinitionRequest request, StreamObserver<DataSourceDefinition> responseObserver)
Updates an existing data source definition. If changing supported_location_ids, triggers same effects as mentioned in "Create a data source definition."
Parameters | |
---|---|
Name | Description |
request | UpdateDataSourceDefinitionRequest |
responseObserver | io.grpc.stub.StreamObserver<DataSourceDefinition> |
updateTransferRun(UpdateTransferRunRequest request, StreamObserver<TransferRun> responseObserver)
public void updateTransferRun(UpdateTransferRunRequest request, StreamObserver<TransferRun> responseObserver)
Update a transfer run. If successful, resets data_source.update_deadline_seconds timer.
Parameters | |
---|---|
Name | Description |
request | UpdateTransferRunRequest |
responseObserver | io.grpc.stub.StreamObserver<TransferRun> |