Package com.google.dataflow.v1beta3 (0.10.0)

Stay organized with collections Save and categorize content based on your preferences.

A client to Dataflow API

The interfaces provided are listed below, along with usage samples.

JobsV1Beta3Client

Service Description: Provides a method to create and modify Google Cloud Dataflow jobs. A Job is a multi-stage computation graph run by the Cloud Dataflow service.

Sample for JobsV1Beta3Client:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (JobsV1Beta3Client jobsV1Beta3Client = JobsV1Beta3Client.create()) {
   CreateJobRequest request =
       CreateJobRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setJob(Job.newBuilder().build())
           .setView(JobView.forNumber(0))
           .setReplaceJobId("replaceJobId441554788")
           .setLocation("location1901043637")
           .build();
   Job response = jobsV1Beta3Client.createJob(request);
 }
 

MessagesV1Beta3Client

Service Description: The Dataflow Messages API is used for monitoring the progress of Dataflow jobs.

Sample for MessagesV1Beta3Client:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (MessagesV1Beta3Client messagesV1Beta3Client = MessagesV1Beta3Client.create()) {
   ListJobMessagesRequest request =
       ListJobMessagesRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setJobId("jobId101296568")
           .setMinimumImportance(JobMessageImportance.forNumber(0))
           .setPageSize(883849137)
           .setPageToken("pageToken873572522")
           .setStartTime(Timestamp.newBuilder().build())
           .setEndTime(Timestamp.newBuilder().build())
           .setLocation("location1901043637")
           .build();
   for (JobMessage element : messagesV1Beta3Client.listJobMessages(request).iterateAll()) {
     // doThingsWith(element);
   }
 }
 

MetricsV1Beta3Client

Service Description: The Dataflow Metrics API lets you monitor the progress of Dataflow jobs.

Sample for MetricsV1Beta3Client:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (MetricsV1Beta3Client metricsV1Beta3Client = MetricsV1Beta3Client.create()) {
   GetJobMetricsRequest request =
       GetJobMetricsRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setJobId("jobId101296568")
           .setStartTime(Timestamp.newBuilder().build())
           .setLocation("location1901043637")
           .build();
   JobMetrics response = metricsV1Beta3Client.getJobMetrics(request);
 }
 

SnapshotsV1Beta3Client

Service Description: Provides methods to manage snapshots of Google Cloud Dataflow jobs.

Sample for SnapshotsV1Beta3Client:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (SnapshotsV1Beta3Client snapshotsV1Beta3Client = SnapshotsV1Beta3Client.create()) {
   GetSnapshotRequest request =
       GetSnapshotRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setSnapshotId("snapshotId-1113817601")
           .setLocation("location1901043637")
           .build();
   Snapshot response = snapshotsV1Beta3Client.getSnapshot(request);
 }
 

TemplatesServiceClient

Service Description: Provides a method to create Cloud Dataflow jobs from templates.

Sample for TemplatesServiceClient:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (TemplatesServiceClient templatesServiceClient = TemplatesServiceClient.create()) {
   CreateJobFromTemplateRequest request =
       CreateJobFromTemplateRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setJobName("jobName-1438096408")
           .putAllParameters(new HashMap<String, String>())
           .setEnvironment(RuntimeEnvironment.newBuilder().build())
           .setLocation("location1901043637")
           .build();
   Job response = templatesServiceClient.createJobFromTemplate(request);
 }
 

FlexTemplatesServiceClient

Service Description: Provides a service for Flex templates. This feature is not ready yet.

Sample for FlexTemplatesServiceClient:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (FlexTemplatesServiceClient flexTemplatesServiceClient =
     FlexTemplatesServiceClient.create()) {
   LaunchFlexTemplateRequest request =
       LaunchFlexTemplateRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setLaunchParameter(LaunchFlexTemplateParameter.newBuilder().build())
           .setLocation("location1901043637")
           .setValidateOnly(true)
           .build();
   LaunchFlexTemplateResponse response = flexTemplatesServiceClient.launchFlexTemplate(request);
 }
 

Classes

AutoscalingEvent

A structured message reporting an autoscaling decision made by the Dataflow service.

Protobuf type google.dataflow.v1beta3.AutoscalingEvent

AutoscalingEvent.Builder

A structured message reporting an autoscaling decision made by the Dataflow service.

Protobuf type google.dataflow.v1beta3.AutoscalingEvent

AutoscalingSettings

Settings for WorkerPool autoscaling.

Protobuf type google.dataflow.v1beta3.AutoscalingSettings

AutoscalingSettings.Builder

Settings for WorkerPool autoscaling.

Protobuf type google.dataflow.v1beta3.AutoscalingSettings

BigQueryIODetails

Metadata for a BigQuery connector used by the job.

Protobuf type google.dataflow.v1beta3.BigQueryIODetails

BigQueryIODetails.Builder

Metadata for a BigQuery connector used by the job.

Protobuf type google.dataflow.v1beta3.BigQueryIODetails

BigTableIODetails

Metadata for a Cloud Bigtable connector used by the job.

Protobuf type google.dataflow.v1beta3.BigTableIODetails

BigTableIODetails.Builder

Metadata for a Cloud Bigtable connector used by the job.

Protobuf type google.dataflow.v1beta3.BigTableIODetails

CheckActiveJobsRequest

Request to check is active jobs exists for a project

Protobuf type google.dataflow.v1beta3.CheckActiveJobsRequest

CheckActiveJobsRequest.Builder

Request to check is active jobs exists for a project

Protobuf type google.dataflow.v1beta3.CheckActiveJobsRequest

CheckActiveJobsResponse

Response for CheckActiveJobsRequest.

Protobuf type google.dataflow.v1beta3.CheckActiveJobsResponse

CheckActiveJobsResponse.Builder

Response for CheckActiveJobsRequest.

Protobuf type google.dataflow.v1beta3.CheckActiveJobsResponse

ComputationTopology

All configuration data for a particular Computation.

Protobuf type google.dataflow.v1beta3.ComputationTopology

ComputationTopology.Builder

All configuration data for a particular Computation.

Protobuf type google.dataflow.v1beta3.ComputationTopology

ContainerSpec

Container Spec.

Protobuf type google.dataflow.v1beta3.ContainerSpec

ContainerSpec.Builder

Container Spec.

Protobuf type google.dataflow.v1beta3.ContainerSpec

CreateJobFromTemplateRequest

A request to create a Cloud Dataflow job from a template.

Protobuf type google.dataflow.v1beta3.CreateJobFromTemplateRequest

CreateJobFromTemplateRequest.Builder

A request to create a Cloud Dataflow job from a template.

Protobuf type google.dataflow.v1beta3.CreateJobFromTemplateRequest

CreateJobRequest

Request to create a Cloud Dataflow job.

Protobuf type google.dataflow.v1beta3.CreateJobRequest

CreateJobRequest.Builder

Request to create a Cloud Dataflow job.

Protobuf type google.dataflow.v1beta3.CreateJobRequest

CustomSourceLocation

Identifies the location of a custom souce.

Protobuf type google.dataflow.v1beta3.CustomSourceLocation

CustomSourceLocation.Builder

Identifies the location of a custom souce.

Protobuf type google.dataflow.v1beta3.CustomSourceLocation

DataDiskAssignment

Data disk assignment for a given VM instance.

Protobuf type google.dataflow.v1beta3.DataDiskAssignment

DataDiskAssignment.Builder

Data disk assignment for a given VM instance.

Protobuf type google.dataflow.v1beta3.DataDiskAssignment

DatastoreIODetails

Metadata for a Datastore connector used by the job.

Protobuf type google.dataflow.v1beta3.DatastoreIODetails

DatastoreIODetails.Builder

Metadata for a Datastore connector used by the job.

Protobuf type google.dataflow.v1beta3.DatastoreIODetails

DebugOptions

Describes any options that have an effect on the debugging of pipelines.

Protobuf type google.dataflow.v1beta3.DebugOptions

DebugOptions.Builder

Describes any options that have an effect on the debugging of pipelines.

Protobuf type google.dataflow.v1beta3.DebugOptions

DeleteSnapshotRequest

Request to delete a snapshot.

Protobuf type google.dataflow.v1beta3.DeleteSnapshotRequest

DeleteSnapshotRequest.Builder

Request to delete a snapshot.

Protobuf type google.dataflow.v1beta3.DeleteSnapshotRequest

DeleteSnapshotResponse

Response from deleting a snapshot.

Protobuf type google.dataflow.v1beta3.DeleteSnapshotResponse

DeleteSnapshotResponse.Builder

Response from deleting a snapshot.

Protobuf type google.dataflow.v1beta3.DeleteSnapshotResponse

Disk

Describes the data disk used by a workflow job.

Protobuf type google.dataflow.v1beta3.Disk

Disk.Builder

Describes the data disk used by a workflow job.

Protobuf type google.dataflow.v1beta3.Disk

DisplayData

Data provided with a pipeline or transform to provide descriptive info.

Protobuf type google.dataflow.v1beta3.DisplayData

DisplayData.Builder

Data provided with a pipeline or transform to provide descriptive info.

Protobuf type google.dataflow.v1beta3.DisplayData

DynamicTemplateLaunchParams

Params which should be passed when launching a dynamic template.

Protobuf type google.dataflow.v1beta3.DynamicTemplateLaunchParams

DynamicTemplateLaunchParams.Builder

Params which should be passed when launching a dynamic template.

Protobuf type google.dataflow.v1beta3.DynamicTemplateLaunchParams

Environment

Describes the environment in which a Dataflow Job runs.

Protobuf type google.dataflow.v1beta3.Environment

Environment.Builder

Describes the environment in which a Dataflow Job runs.

Protobuf type google.dataflow.v1beta3.Environment

EnvironmentProto

ExecutionStageState

A message describing the state of a particular execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageState

ExecutionStageState.Builder

A message describing the state of a particular execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageState

ExecutionStageSummary

Description of the composing transforms, names/ids, and input/outputs of a stage of execution. Some composing transforms and sources may have been generated by the Dataflow service during execution planning.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary

ExecutionStageSummary.Builder

Description of the composing transforms, names/ids, and input/outputs of a stage of execution. Some composing transforms and sources may have been generated by the Dataflow service during execution planning.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary

ExecutionStageSummary.ComponentSource

Description of an interstitial value between transforms in an execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary.ComponentSource

ExecutionStageSummary.ComponentSource.Builder

Description of an interstitial value between transforms in an execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary.ComponentSource

ExecutionStageSummary.ComponentTransform

Description of a transform executed as part of an execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary.ComponentTransform

ExecutionStageSummary.ComponentTransform.Builder

Description of a transform executed as part of an execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary.ComponentTransform

ExecutionStageSummary.StageSource

Description of an input or output of an execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary.StageSource

ExecutionStageSummary.StageSource.Builder

Description of an input or output of an execution stage.

Protobuf type google.dataflow.v1beta3.ExecutionStageSummary.StageSource

FailedLocation

Indicates which regional endpoint failed to respond to a request for data.

Protobuf type google.dataflow.v1beta3.FailedLocation

FailedLocation.Builder

Indicates which regional endpoint failed to respond to a request for data.

Protobuf type google.dataflow.v1beta3.FailedLocation

FileIODetails

Metadata for a File connector used by the job.

Protobuf type google.dataflow.v1beta3.FileIODetails

FileIODetails.Builder

Metadata for a File connector used by the job.

Protobuf type google.dataflow.v1beta3.FileIODetails

FlexTemplateRuntimeEnvironment

The environment values to be set at runtime for flex template.

Protobuf type google.dataflow.v1beta3.FlexTemplateRuntimeEnvironment

FlexTemplateRuntimeEnvironment.Builder

The environment values to be set at runtime for flex template.

Protobuf type google.dataflow.v1beta3.FlexTemplateRuntimeEnvironment

FlexTemplatesServiceClient

Service Description: Provides a service for Flex templates. This feature is not ready yet.

This class provides the ability to make remote calls to the backing service through method calls that map to API methods. Sample code to get started:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (FlexTemplatesServiceClient flexTemplatesServiceClient =
     FlexTemplatesServiceClient.create()) {
   LaunchFlexTemplateRequest request =
       LaunchFlexTemplateRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setLaunchParameter(LaunchFlexTemplateParameter.newBuilder().build())
           .setLocation("location1901043637")
           .setValidateOnly(true)
           .build();
   LaunchFlexTemplateResponse response = flexTemplatesServiceClient.launchFlexTemplate(request);
 }
 

Note: close() needs to be called on the FlexTemplatesServiceClient object to clean up resources such as threads. In the example above, try-with-resources is used, which automatically calls close().

The surface of this class includes several types of Java methods for each of the API's methods:

  1. A "flattened" method. With this type of method, the fields of the request type have been converted into function parameters. It may be the case that not all fields are available as parameters, and not every API method will have a flattened method entry point.
  2. A "request object" method. This type of method only takes one parameter, a request object, which must be constructed before the call. Not every API method will have a request object method.
  3. A "callable" method. This type of method takes no parameters and returns an immutable API callable object, which can be used to initiate calls to the service.

See the individual methods for example code.

Many parameters require resource names to be formatted in a particular way. To assist with these names, this class includes a format method for each type of name, and additionally a parse method to extract the individual identifiers contained within names that are returned.

This class can be customized by passing in a custom instance of FlexTemplatesServiceSettings to create(). For example:

To customize credentials:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 FlexTemplatesServiceSettings flexTemplatesServiceSettings =
     FlexTemplatesServiceSettings.newBuilder()
         .setCredentialsProvider(FixedCredentialsProvider.create(myCredentials))
         .build();
 FlexTemplatesServiceClient flexTemplatesServiceClient =
     FlexTemplatesServiceClient.create(flexTemplatesServiceSettings);
 

To customize the endpoint:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 FlexTemplatesServiceSettings flexTemplatesServiceSettings =
     FlexTemplatesServiceSettings.newBuilder().setEndpoint(myEndpoint).build();
 FlexTemplatesServiceClient flexTemplatesServiceClient =
     FlexTemplatesServiceClient.create(flexTemplatesServiceSettings);
 

To use REST (HTTP1.1/JSON) transport (instead of gRPC) for sending and receiving requests over the wire:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 FlexTemplatesServiceSettings flexTemplatesServiceSettings =
     FlexTemplatesServiceSettings.newHttpJsonBuilder().build();
 FlexTemplatesServiceClient flexTemplatesServiceClient =
     FlexTemplatesServiceClient.create(flexTemplatesServiceSettings);
 

Please refer to the GitHub repository's samples for more quickstart code snippets.

FlexTemplatesServiceGrpc

Provides a service for Flex templates. This feature is not ready yet.

FlexTemplatesServiceGrpc.FlexTemplatesServiceBlockingStub

Provides a service for Flex templates. This feature is not ready yet.

FlexTemplatesServiceGrpc.FlexTemplatesServiceFutureStub

Provides a service for Flex templates. This feature is not ready yet.

FlexTemplatesServiceGrpc.FlexTemplatesServiceImplBase

Provides a service for Flex templates. This feature is not ready yet.

FlexTemplatesServiceGrpc.FlexTemplatesServiceStub

Provides a service for Flex templates. This feature is not ready yet.

FlexTemplatesServiceSettings

Settings class to configure an instance of FlexTemplatesServiceClient.

The default instance has everything set to sensible defaults:

  • The default service address (dataflow.googleapis.com) and default port (443) are used.
  • Credentials are acquired automatically through Application Default Credentials.
  • Retries are configured for idempotent methods but not for non-idempotent methods.

The builder of this class is recursive, so contained classes are themselves builders. When build() is called, the tree of builders is called to create the complete settings object.

For example, to set the total timeout of launchFlexTemplate to 30 seconds:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 FlexTemplatesServiceSettings.Builder flexTemplatesServiceSettingsBuilder =
     FlexTemplatesServiceSettings.newBuilder();
 flexTemplatesServiceSettingsBuilder
     .launchFlexTemplateSettings()
     .setRetrySettings(
         flexTemplatesServiceSettingsBuilder
             .launchFlexTemplateSettings()
             .getRetrySettings()
             .toBuilder()
             .setTotalTimeout(Duration.ofSeconds(30))
             .build());
 FlexTemplatesServiceSettings flexTemplatesServiceSettings =
     flexTemplatesServiceSettingsBuilder.build();
 

FlexTemplatesServiceSettings.Builder

Builder for FlexTemplatesServiceSettings.

GetJobExecutionDetailsRequest

Request to get job execution details.

Protobuf type google.dataflow.v1beta3.GetJobExecutionDetailsRequest

GetJobExecutionDetailsRequest.Builder

Request to get job execution details.

Protobuf type google.dataflow.v1beta3.GetJobExecutionDetailsRequest

GetJobMetricsRequest

Request to get job metrics.

Protobuf type google.dataflow.v1beta3.GetJobMetricsRequest

GetJobMetricsRequest.Builder

Request to get job metrics.

Protobuf type google.dataflow.v1beta3.GetJobMetricsRequest

GetJobRequest

Request to get the state of a Cloud Dataflow job.

Protobuf type google.dataflow.v1beta3.GetJobRequest

GetJobRequest.Builder

Request to get the state of a Cloud Dataflow job.

Protobuf type google.dataflow.v1beta3.GetJobRequest

GetSnapshotRequest

Request to get information about a snapshot

Protobuf type google.dataflow.v1beta3.GetSnapshotRequest

GetSnapshotRequest.Builder

Request to get information about a snapshot

Protobuf type google.dataflow.v1beta3.GetSnapshotRequest

GetStageExecutionDetailsRequest

Request to get information about a particular execution stage of a job. Currently only tracked for Batch jobs.

Protobuf type google.dataflow.v1beta3.GetStageExecutionDetailsRequest

GetStageExecutionDetailsRequest.Builder

Request to get information about a particular execution stage of a job. Currently only tracked for Batch jobs.

Protobuf type google.dataflow.v1beta3.GetStageExecutionDetailsRequest

GetTemplateRequest

A request to retrieve a Cloud Dataflow job template.

Protobuf type google.dataflow.v1beta3.GetTemplateRequest

GetTemplateRequest.Builder

A request to retrieve a Cloud Dataflow job template.

Protobuf type google.dataflow.v1beta3.GetTemplateRequest

GetTemplateResponse

The response to a GetTemplate request.

Protobuf type google.dataflow.v1beta3.GetTemplateResponse

GetTemplateResponse.Builder

The response to a GetTemplate request.

Protobuf type google.dataflow.v1beta3.GetTemplateResponse

InvalidTemplateParameters

Used in the error_details field of a google.rpc.Status message, this indicates problems with the template parameter.

Protobuf type google.dataflow.v1beta3.InvalidTemplateParameters

InvalidTemplateParameters.Builder

Used in the error_details field of a google.rpc.Status message, this indicates problems with the template parameter.

Protobuf type google.dataflow.v1beta3.InvalidTemplateParameters

InvalidTemplateParameters.ParameterViolation

A specific template-parameter violation.

Protobuf type google.dataflow.v1beta3.InvalidTemplateParameters.ParameterViolation

InvalidTemplateParameters.ParameterViolation.Builder

A specific template-parameter violation.

Protobuf type google.dataflow.v1beta3.InvalidTemplateParameters.ParameterViolation

Job

Defines a job to be run by the Cloud Dataflow service.

Protobuf type google.dataflow.v1beta3.Job

Job.Builder

Defines a job to be run by the Cloud Dataflow service.

Protobuf type google.dataflow.v1beta3.Job

JobExecutionDetails

Information about the execution of a job.

Protobuf type google.dataflow.v1beta3.JobExecutionDetails

JobExecutionDetails.Builder

Information about the execution of a job.

Protobuf type google.dataflow.v1beta3.JobExecutionDetails

JobExecutionInfo

Additional information about how a Cloud Dataflow job will be executed that isn't contained in the submitted job.

Protobuf type google.dataflow.v1beta3.JobExecutionInfo

JobExecutionInfo.Builder

Additional information about how a Cloud Dataflow job will be executed that isn't contained in the submitted job.

Protobuf type google.dataflow.v1beta3.JobExecutionInfo

JobExecutionStageInfo

Contains information about how a particular google.dataflow.v1beta3.Step will be executed.

Protobuf type google.dataflow.v1beta3.JobExecutionStageInfo

JobExecutionStageInfo.Builder

Contains information about how a particular google.dataflow.v1beta3.Step will be executed.

Protobuf type google.dataflow.v1beta3.JobExecutionStageInfo

JobMessage

A particular message pertaining to a Dataflow job.

Protobuf type google.dataflow.v1beta3.JobMessage

JobMessage.Builder

A particular message pertaining to a Dataflow job.

Protobuf type google.dataflow.v1beta3.JobMessage

JobMetadata

Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view.

Protobuf type google.dataflow.v1beta3.JobMetadata

JobMetadata.Builder

Metadata available primarily for filtering jobs. Will be included in the ListJob response and Job SUMMARY view.

Protobuf type google.dataflow.v1beta3.JobMetadata

JobMetrics

JobMetrics contains a collection of metrics describing the detailed progress of a Dataflow job. Metrics correspond to user-defined and system-defined metrics in the job. This resource captures only the most recent values of each metric; time-series data can be queried for them (under the same metric names) from Cloud Monitoring.

Protobuf type google.dataflow.v1beta3.JobMetrics

JobMetrics.Builder

JobMetrics contains a collection of metrics describing the detailed progress of a Dataflow job. Metrics correspond to user-defined and system-defined metrics in the job. This resource captures only the most recent values of each metric; time-series data can be queried for them (under the same metric names) from Cloud Monitoring.

Protobuf type google.dataflow.v1beta3.JobMetrics

JobsProto

JobsV1Beta3Client

Service Description: Provides a method to create and modify Google Cloud Dataflow jobs. A Job is a multi-stage computation graph run by the Cloud Dataflow service.

This class provides the ability to make remote calls to the backing service through method calls that map to API methods. Sample code to get started:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 try (JobsV1Beta3Client jobsV1Beta3Client = JobsV1Beta3Client.create()) {
   CreateJobRequest request =
       CreateJobRequest.newBuilder()
           .setProjectId("projectId-894832108")
           .setJob(Job.newBuilder().build())
           .setView(JobView.forNumber(0))
           .setReplaceJobId("replaceJobId441554788")
           .setLocation("location1901043637")
           .build();
   Job response = jobsV1Beta3Client.createJob(request);
 }
 

Note: close() needs to be called on the JobsV1Beta3Client object to clean up resources such as threads. In the example above, try-with-resources is used, which automatically calls close().

The surface of this class includes several types of Java methods for each of the API's methods:

  1. A "flattened" method. With this type of method, the fields of the request type have been converted into function parameters. It may be the case that not all fields are available as parameters, and not every API method will have a flattened method entry point.
  2. A "request object" method. This type of method only takes one parameter, a request object, which must be constructed before the call. Not every API method will have a request object method.
  3. A "callable" method. This type of method takes no parameters and returns an immutable API callable object, which can be used to initiate calls to the service.

See the individual methods for example code.

Many parameters require resource names to be formatted in a particular way. To assist with these names, this class includes a format method for each type of name, and additionally a parse method to extract the individual identifiers contained within names that are returned.

This class can be customized by passing in a custom instance of JobsV1Beta3Settings to create(). For example:

To customize credentials:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 JobsV1Beta3Settings jobsV1Beta3Settings =
     JobsV1Beta3Settings.newBuilder()
         .setCredentialsProvider(FixedCredentialsProvider.create(myCredentials))
         .build();
 JobsV1Beta3Client jobsV1Beta3Client = JobsV1Beta3Client.create(jobsV1Beta3Settings);
 

To customize the endpoint:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 JobsV1Beta3Settings jobsV1Beta3Settings =
     JobsV1Beta3Settings.newBuilder().setEndpoint(myEndpoint).build();
 JobsV1Beta3Client jobsV1Beta3Client = JobsV1Beta3Client.create(jobsV1Beta3Settings);
 

To use REST (HTTP1.1/JSON) transport (instead of gRPC) for sending and receiving requests over the wire:


 // This snippet has been automatically generated and should be regarded as a code template only.
 // It will require modifications to work:
 // - It may require correct/in-range values for request initialization.
 // - It may require specifying regional endpoints when creating the service client as shown in
 // https://cloud.google.com/java/docs/setup#configure_endpoints_for_the_client_library
 JobsV1Beta3Settings jobsV1Beta3Settings = JobsV1Beta3Settings.newHttpJsonBuilder().build();
 JobsV1Beta3Client jobsV1Beta3Client = JobsV1Beta3Client.create(jobsV1Beta3Settings);
 

Please refer to the GitHub repository's samples for more quickstart code snippets.

JobsV1Beta3Client.AggregatedListJobsFixedSizeCollection

JobsV1Beta3Client.AggregatedListJobsPage

JobsV1Beta3Client.AggregatedListJobsPagedResponse

JobsV1Beta3Client.ListJobsFixedSizeCollection

JobsV1Beta3Client.ListJobsPage

JobsV1Beta3Client.ListJobsPagedResponse