Class Environment.Builder (0.10.0)

Stay organized with collections Save and categorize content based on your preferences.
public static final class Environment.Builder extends GeneratedMessageV3.Builder<Environment.Builder> implements EnvironmentOrBuilder

Describes the environment in which a Dataflow Job runs.

Protobuf type google.dataflow.v1beta3.Environment

Static Methods

getDescriptor()

public static final Descriptors.Descriptor getDescriptor()
Returns
TypeDescription
Descriptor

Methods

addAllExperiments(Iterable<String> values)

public Environment.Builder addAllExperiments(Iterable<String> values)

The list of experiments to enable. This field should be used for SDK related experiments and not for service related experiments. The proper field for service related experiments is service_options.

repeated string experiments = 3;

Parameter
NameDescription
valuesIterable<String>

The experiments to add.

Returns
TypeDescription
Environment.Builder

This builder for chaining.

addAllServiceOptions(Iterable<String> values)

public Environment.Builder addAllServiceOptions(Iterable<String> values)

The list of service options to enable. This field should be used for service related experiments only. These experiments, when graduating to GA, should be replaced by dedicated fields or become default (i.e. always on).

repeated string service_options = 16;

Parameter
NameDescription
valuesIterable<String>

The serviceOptions to add.

Returns
TypeDescription
Environment.Builder

This builder for chaining.

addAllWorkerPools(Iterable<? extends WorkerPool> values)

public Environment.Builder addAllWorkerPools(Iterable<? extends WorkerPool> values)

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Parameter
NameDescription
valuesIterable<? extends com.google.dataflow.v1beta3.WorkerPool>
Returns
TypeDescription
Environment.Builder

addExperiments(String value)

public Environment.Builder addExperiments(String value)

The list of experiments to enable. This field should be used for SDK related experiments and not for service related experiments. The proper field for service related experiments is service_options.

repeated string experiments = 3;

Parameter
NameDescription
valueString

The experiments to add.

Returns
TypeDescription
Environment.Builder

This builder for chaining.

addExperimentsBytes(ByteString value)

public Environment.Builder addExperimentsBytes(ByteString value)

The list of experiments to enable. This field should be used for SDK related experiments and not for service related experiments. The proper field for service related experiments is service_options.

repeated string experiments = 3;

Parameter
NameDescription
valueByteString

The bytes of the experiments to add.

Returns
TypeDescription
Environment.Builder

This builder for chaining.

addRepeatedField(Descriptors.FieldDescriptor field, Object value)

public Environment.Builder addRepeatedField(Descriptors.FieldDescriptor field, Object value)
Parameters
NameDescription
fieldFieldDescriptor
valueObject
Returns
TypeDescription
Environment.Builder
Overrides

addServiceOptions(String value)

public Environment.Builder addServiceOptions(String value)

The list of service options to enable. This field should be used for service related experiments only. These experiments, when graduating to GA, should be replaced by dedicated fields or become default (i.e. always on).

repeated string service_options = 16;

Parameter
NameDescription
valueString

The serviceOptions to add.

Returns
TypeDescription
Environment.Builder

This builder for chaining.

addServiceOptionsBytes(ByteString value)

public Environment.Builder addServiceOptionsBytes(ByteString value)

The list of service options to enable. This field should be used for service related experiments only. These experiments, when graduating to GA, should be replaced by dedicated fields or become default (i.e. always on).

repeated string service_options = 16;

Parameter
NameDescription
valueByteString

The bytes of the serviceOptions to add.

Returns
TypeDescription
Environment.Builder

This builder for chaining.

addWorkerPools(WorkerPool value)

public Environment.Builder addWorkerPools(WorkerPool value)

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Parameter
NameDescription
valueWorkerPool
Returns
TypeDescription
Environment.Builder

addWorkerPools(WorkerPool.Builder builderForValue)

public Environment.Builder addWorkerPools(WorkerPool.Builder builderForValue)

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Parameter
NameDescription
builderForValueWorkerPool.Builder
Returns
TypeDescription
Environment.Builder

addWorkerPools(int index, WorkerPool value)

public Environment.Builder addWorkerPools(int index, WorkerPool value)

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Parameters
NameDescription
indexint
valueWorkerPool
Returns
TypeDescription
Environment.Builder

addWorkerPools(int index, WorkerPool.Builder builderForValue)

public Environment.Builder addWorkerPools(int index, WorkerPool.Builder builderForValue)

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Parameters
NameDescription
indexint
builderForValueWorkerPool.Builder
Returns
TypeDescription
Environment.Builder

addWorkerPoolsBuilder()

public WorkerPool.Builder addWorkerPoolsBuilder()

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Returns
TypeDescription
WorkerPool.Builder

addWorkerPoolsBuilder(int index)

public WorkerPool.Builder addWorkerPoolsBuilder(int index)

The worker pools. At least one "harness" worker pool must be specified in order for the job to have workers.

repeated .google.dataflow.v1beta3.WorkerPool worker_pools = 4;

Parameter
NameDescription
indexint
Returns
TypeDescription
WorkerPool.Builder

build()

public Environment build()
Returns
TypeDescription
Environment

buildPartial()

public Environment buildPartial()
Returns
TypeDescription
Environment

clear()

public Environment.Builder clear()
Returns
TypeDescription
Environment.Builder
Overrides

clearClusterManagerApiService()

public Environment.Builder clearClusterManagerApiService()

The type of cluster manager API to use. If unknown or unspecified, the service will attempt to choose a reasonable default. This should be in the form of the API service name, e.g. "compute.googleapis.com".

string cluster_manager_api_service = 2;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearDataset()

public Environment.Builder clearDataset()

The dataset for the current project where various workflow related tables are stored. The supported resource type is: Google BigQuery: bigquery.googleapis.com/{dataset}

string dataset = 7;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearDebugOptions()

public Environment.Builder clearDebugOptions()

Any debugging options to be supplied to the job.

.google.dataflow.v1beta3.DebugOptions debug_options = 17;

Returns
TypeDescription
Environment.Builder

clearExperiments()

public Environment.Builder clearExperiments()

The list of experiments to enable. This field should be used for SDK related experiments and not for service related experiments. The proper field for service related experiments is service_options.

repeated string experiments = 3;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearField(Descriptors.FieldDescriptor field)

public Environment.Builder clearField(Descriptors.FieldDescriptor field)
Parameter
NameDescription
fieldFieldDescriptor
Returns
TypeDescription
Environment.Builder
Overrides

clearFlexResourceSchedulingGoal()

public Environment.Builder clearFlexResourceSchedulingGoal()

Which Flexible Resource Scheduling mode to run in.

.google.dataflow.v1beta3.FlexResourceSchedulingGoal flex_resource_scheduling_goal = 11;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearInternalExperiments()

public Environment.Builder clearInternalExperiments()

Experimental settings.

.google.protobuf.Any internal_experiments = 9;

Returns
TypeDescription
Environment.Builder

clearOneof(Descriptors.OneofDescriptor oneof)

public Environment.Builder clearOneof(Descriptors.OneofDescriptor oneof)
Parameter
NameDescription
oneofOneofDescriptor
Returns
TypeDescription
Environment.Builder
Overrides

clearSdkPipelineOptions()

public Environment.Builder clearSdkPipelineOptions()

The Cloud Dataflow SDK pipeline options specified by the user. These options are passed through the service and are used to recreate the SDK pipeline options on the worker in a language agnostic and platform independent way.

.google.protobuf.Struct sdk_pipeline_options = 8;

Returns
TypeDescription
Environment.Builder

clearServiceAccountEmail()

public Environment.Builder clearServiceAccountEmail()

Identity to run virtual machines as. Defaults to the default account.

string service_account_email = 10;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearServiceKmsKeyName()

public Environment.Builder clearServiceKmsKeyName()

If set, contains the Cloud KMS key identifier used to encrypt data at rest, AKA a Customer Managed Encryption Key (CMEK). Format: projects/PROJECT_ID/locations/LOCATION/keyRings/KEY_RING/cryptoKeys/KEY

string service_kms_key_name = 12;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearServiceOptions()

public Environment.Builder clearServiceOptions()

The list of service options to enable. This field should be used for service related experiments only. These experiments, when graduating to GA, should be replaced by dedicated fields or become default (i.e. always on).

repeated string service_options = 16;

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearShuffleMode()

public Environment.Builder clearShuffleMode()

Output only. The shuffle mode used for the job.

.google.dataflow.v1beta3.ShuffleMode shuffle_mode = 15 [(.google.api.field_behavior) = OUTPUT_ONLY];

Returns
TypeDescription
Environment.Builder

This builder for chaining.

clearTempStoragePrefix()

public Environment.Builder clearTempStoragePrefix()

The prefix of the resources the system should use for temporary storage. The system will append the suffix "/temp-{JOBNAME} to this resource prefix, where {JOBNAME} is the value of the job_name field. The resulting bucket and object prefix is used as the prefix of the resources used to store temporary data needed during the job execution. NOTE: This will