Class WorkerPool.Builder (0.40.0)

public static final class WorkerPool.Builder extends GeneratedMessageV3.Builder<WorkerPool.Builder> implements WorkerPoolOrBuilder

Describes one particular pool of Cloud Dataflow workers to be instantiated by the Cloud Dataflow service in order to perform the computations required by a job. Note that a workflow job may use multiple pools, in order to match the various computational requirements of the various stages of the job.

Protobuf type google.dataflow.v1beta3.WorkerPool

Implements

WorkerPoolOrBuilder

Static Methods

getDescriptor()

public static final Descriptors.Descriptor getDescriptor()
Returns
TypeDescription
Descriptor

Methods

addAllDataDisks(Iterable<? extends Disk> values)

public WorkerPool.Builder addAllDataDisks(Iterable<? extends Disk> values)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
valuesIterable<? extends com.google.dataflow.v1beta3.Disk>
Returns
TypeDescription
WorkerPool.Builder

addAllPackages(Iterable<? extends Package> values)

public WorkerPool.Builder addAllPackages(Iterable<? extends Package> values)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
valuesIterable<? extends com.google.dataflow.v1beta3.Package>
Returns
TypeDescription
WorkerPool.Builder

addAllSdkHarnessContainerImages(Iterable<? extends SdkHarnessContainerImage> values)

public WorkerPool.Builder addAllSdkHarnessContainerImages(Iterable<? extends SdkHarnessContainerImage> values)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
valuesIterable<? extends com.google.dataflow.v1beta3.SdkHarnessContainerImage>
Returns
TypeDescription
WorkerPool.Builder

addDataDisks(Disk value)

public WorkerPool.Builder addDataDisks(Disk value)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
valueDisk
Returns
TypeDescription
WorkerPool.Builder

addDataDisks(Disk.Builder builderForValue)

public WorkerPool.Builder addDataDisks(Disk.Builder builderForValue)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
builderForValueDisk.Builder
Returns
TypeDescription
WorkerPool.Builder

addDataDisks(int index, Disk value)

public WorkerPool.Builder addDataDisks(int index, Disk value)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameters
NameDescription
indexint
valueDisk
Returns
TypeDescription
WorkerPool.Builder

addDataDisks(int index, Disk.Builder builderForValue)

public WorkerPool.Builder addDataDisks(int index, Disk.Builder builderForValue)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameters
NameDescription
indexint
builderForValueDisk.Builder
Returns
TypeDescription
WorkerPool.Builder

addDataDisksBuilder()

public Disk.Builder addDataDisksBuilder()

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Returns
TypeDescription
Disk.Builder

addDataDisksBuilder(int index)

public Disk.Builder addDataDisksBuilder(int index)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
indexint
Returns
TypeDescription
Disk.Builder

addPackages(Package value)

public WorkerPool.Builder addPackages(Package value)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
valuePackage
Returns
TypeDescription
WorkerPool.Builder

addPackages(Package.Builder builderForValue)

public WorkerPool.Builder addPackages(Package.Builder builderForValue)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
builderForValuePackage.Builder
Returns
TypeDescription
WorkerPool.Builder

addPackages(int index, Package value)

public WorkerPool.Builder addPackages(int index, Package value)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameters
NameDescription
indexint
valuePackage
Returns
TypeDescription
WorkerPool.Builder

addPackages(int index, Package.Builder builderForValue)

public WorkerPool.Builder addPackages(int index, Package.Builder builderForValue)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameters
NameDescription
indexint
builderForValuePackage.Builder
Returns
TypeDescription
WorkerPool.Builder

addPackagesBuilder()

public Package.Builder addPackagesBuilder()

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Returns
TypeDescription
Package.Builder

addPackagesBuilder(int index)

public Package.Builder addPackagesBuilder(int index)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
indexint
Returns
TypeDescription
Package.Builder

addRepeatedField(Descriptors.FieldDescriptor field, Object value)

public WorkerPool.Builder addRepeatedField(Descriptors.FieldDescriptor field, Object value)
Parameters
NameDescription
fieldFieldDescriptor
valueObject
Returns
TypeDescription
WorkerPool.Builder
Overrides

addSdkHarnessContainerImages(SdkHarnessContainerImage value)

public WorkerPool.Builder addSdkHarnessContainerImages(SdkHarnessContainerImage value)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
valueSdkHarnessContainerImage
Returns
TypeDescription
WorkerPool.Builder

addSdkHarnessContainerImages(SdkHarnessContainerImage.Builder builderForValue)

public WorkerPool.Builder addSdkHarnessContainerImages(SdkHarnessContainerImage.Builder builderForValue)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
builderForValueSdkHarnessContainerImage.Builder
Returns
TypeDescription
WorkerPool.Builder

addSdkHarnessContainerImages(int index, SdkHarnessContainerImage value)

public WorkerPool.Builder addSdkHarnessContainerImages(int index, SdkHarnessContainerImage value)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameters
NameDescription
indexint
valueSdkHarnessContainerImage
Returns
TypeDescription
WorkerPool.Builder

addSdkHarnessContainerImages(int index, SdkHarnessContainerImage.Builder builderForValue)

public WorkerPool.Builder addSdkHarnessContainerImages(int index, SdkHarnessContainerImage.Builder builderForValue)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameters
NameDescription
indexint
builderForValueSdkHarnessContainerImage.Builder
Returns
TypeDescription
WorkerPool.Builder

addSdkHarnessContainerImagesBuilder()

public SdkHarnessContainerImage.Builder addSdkHarnessContainerImagesBuilder()

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Returns
TypeDescription
SdkHarnessContainerImage.Builder

addSdkHarnessContainerImagesBuilder(int index)

public SdkHarnessContainerImage.Builder addSdkHarnessContainerImagesBuilder(int index)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
indexint
Returns
TypeDescription
SdkHarnessContainerImage.Builder

build()

public WorkerPool build()
Returns
TypeDescription
WorkerPool

buildPartial()

public WorkerPool buildPartial()
Returns
TypeDescription
WorkerPool

clear()

public WorkerPool.Builder clear()
Returns
TypeDescription
WorkerPool.Builder
Overrides

clearAutoscalingSettings()

public WorkerPool.Builder clearAutoscalingSettings()

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Returns
TypeDescription
WorkerPool.Builder

clearDataDisks()

public WorkerPool.Builder clearDataDisks()

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Returns
TypeDescription
WorkerPool.Builder

clearDefaultPackageSet()

public WorkerPool.Builder clearDefaultPackageSet()

The default package set to install. This allows the service to select a default set of packages which are useful to worker harnesses written in a particular language.

.google.dataflow.v1beta3.DefaultPackageSet default_package_set = 4;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearDiskSizeGb()

public WorkerPool.Builder clearDiskSizeGb()

Size of root disk for VMs, in GB. If zero or unspecified, the service will attempt to choose a reasonable default.

int32 disk_size_gb = 7;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearDiskSourceImage()

public WorkerPool.Builder clearDiskSourceImage()

Fully qualified source image for disks.

string disk_source_image = 8;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearDiskType()

public WorkerPool.Builder clearDiskType()

Type of root disk for VMs. If empty or unspecified, the service will attempt to choose a reasonable default.

string disk_type = 16;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearField(Descriptors.FieldDescriptor field)

public WorkerPool.Builder clearField(Descriptors.FieldDescriptor field)
Parameter
NameDescription
fieldFieldDescriptor
Returns
TypeDescription
WorkerPool.Builder
Overrides

clearIpConfiguration()

public WorkerPool.Builder clearIpConfiguration()

Configuration for VM IPs.

.google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 21;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearKind()

public WorkerPool.Builder clearKind()

The kind of the worker pool; currently only harness and shuffle are supported.

string kind = 1;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearMachineType()

public WorkerPool.Builder clearMachineType()

Machine type (e.g. "n1-standard-1"). If empty or unspecified, the service will attempt to choose a reasonable default.

string machine_type = 5;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearMetadata()

public WorkerPool.Builder clearMetadata()
Returns
TypeDescription
WorkerPool.Builder

clearNetwork()

public WorkerPool.Builder clearNetwork()

Network to which VMs will be assigned. If empty or unspecified, the service will use the network "default".

string network = 17;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearNumThreadsPerWorker()

public WorkerPool.Builder clearNumThreadsPerWorker()

The number of threads per worker harness. If empty or unspecified, the service will choose a number of threads (according to the number of cores on the selected machine type for batch, or 1 by convention for streaming).

int32 num_threads_per_worker = 20;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearNumWorkers()

public WorkerPool.Builder clearNumWorkers()

Number of Google Compute Engine workers in this pool needed to execute the job. If zero or unspecified, the service will attempt to choose a reasonable default.

int32 num_workers = 2;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearOnHostMaintenance()

public WorkerPool.Builder clearOnHostMaintenance()

The action to take on host maintenance, as defined by the Google Compute Engine API.

string on_host_maintenance = 11;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearOneof(Descriptors.OneofDescriptor oneof)

public WorkerPool.Builder clearOneof(Descriptors.OneofDescriptor oneof)
Parameter
NameDescription
oneofOneofDescriptor
Returns
TypeDescription
WorkerPool.Builder
Overrides

clearPackages()

public WorkerPool.Builder clearPackages()

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Returns
TypeDescription
WorkerPool.Builder

clearPoolArgs()

public WorkerPool.Builder clearPoolArgs()

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Returns
TypeDescription
WorkerPool.Builder

clearSdkHarnessContainerImages()

public WorkerPool.Builder clearSdkHarnessContainerImages()

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Returns
TypeDescription
WorkerPool.Builder

clearSubnetwork()

public WorkerPool.Builder clearSubnetwork()

Subnetwork to which VMs will be assigned, if desired. Expected to be of the form "regions/REGION/subnetworks/SUBNETWORK".

string subnetwork = 19;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearTaskrunnerSettings()

public WorkerPool.Builder clearTaskrunnerSettings()

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Returns
TypeDescription
WorkerPool.Builder

clearTeardownPolicy()

public WorkerPool.Builder clearTeardownPolicy()

Sets the policy for determining when to turndown worker pool. Allowed values are: TEARDOWN_ALWAYS, TEARDOWN_ON_SUCCESS, and TEARDOWN_NEVER. TEARDOWN_ALWAYS means workers are always torn down regardless of whether the job succeeds. TEARDOWN_ON_SUCCESS means workers are torn down if the job succeeds. TEARDOWN_NEVER means the workers are never torn down.

If the workers are not torn down by the service, they will continue to run and use Google Compute Engine VM resources in the user's project until they are explicitly terminated by the user. Because of this, Google recommends using the TEARDOWN_ALWAYS policy except for small, manually supervised test jobs.

If unknown or unspecified, the service will attempt to choose a reasonable default.

.google.dataflow.v1beta3.TeardownPolicy teardown_policy = 6;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearWorkerHarnessContainerImage()

public WorkerPool.Builder clearWorkerHarnessContainerImage()

Required. Docker container image that executes the Cloud Dataflow worker harness, residing in Google Container Registry.

Deprecated for the Fn API path. Use sdk_harness_container_images instead.

string worker_harness_container_image = 18;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clearZone()

public WorkerPool.Builder clearZone()

Zone to run the worker pools in. If empty or unspecified, the service will attempt to choose a reasonable default.

string zone = 9;

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

clone()

public WorkerPool.Builder clone()
Returns
TypeDescription
WorkerPool.Builder
Overrides

containsMetadata(String key)

public boolean containsMetadata(String key)

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Parameter
NameDescription
keyString
Returns
TypeDescription
boolean

getAutoscalingSettings()

public AutoscalingSettings getAutoscalingSettings()

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Returns
TypeDescription
AutoscalingSettings

The autoscalingSettings.

getAutoscalingSettingsBuilder()

public AutoscalingSettings.Builder getAutoscalingSettingsBuilder()

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Returns
TypeDescription
AutoscalingSettings.Builder

getAutoscalingSettingsOrBuilder()

public AutoscalingSettingsOrBuilder getAutoscalingSettingsOrBuilder()

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Returns
TypeDescription
AutoscalingSettingsOrBuilder

getDataDisks(int index)

public Disk getDataDisks(int index)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
indexint
Returns
TypeDescription
Disk

getDataDisksBuilder(int index)

public Disk.Builder getDataDisksBuilder(int index)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
indexint
Returns
TypeDescription
Disk.Builder

getDataDisksBuilderList()

public List<Disk.Builder> getDataDisksBuilderList()

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Returns
TypeDescription
List<Builder>

getDataDisksCount()

public int getDataDisksCount()

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Returns
TypeDescription
int

getDataDisksList()

public List<Disk> getDataDisksList()

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Returns
TypeDescription
List<Disk>

getDataDisksOrBuilder(int index)

public DiskOrBuilder getDataDisksOrBuilder(int index)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
indexint
Returns
TypeDescription
DiskOrBuilder

getDataDisksOrBuilderList()

public List<? extends DiskOrBuilder> getDataDisksOrBuilderList()

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Returns
TypeDescription
List<? extends com.google.dataflow.v1beta3.DiskOrBuilder>

getDefaultInstanceForType()

public WorkerPool getDefaultInstanceForType()
Returns
TypeDescription
WorkerPool

getDefaultPackageSet()

public DefaultPackageSet getDefaultPackageSet()

The default package set to install. This allows the service to select a default set of packages which are useful to worker harnesses written in a particular language.

.google.dataflow.v1beta3.DefaultPackageSet default_package_set = 4;

Returns
TypeDescription
DefaultPackageSet

The defaultPackageSet.

getDefaultPackageSetValue()

public int getDefaultPackageSetValue()

The default package set to install. This allows the service to select a default set of packages which are useful to worker harnesses written in a particular language.

.google.dataflow.v1beta3.DefaultPackageSet default_package_set = 4;

Returns
TypeDescription
int

The enum numeric value on the wire for defaultPackageSet.

getDescriptorForType()

public Descriptors.Descriptor getDescriptorForType()
Returns
TypeDescription
Descriptor
Overrides

getDiskSizeGb()

public int getDiskSizeGb()

Size of root disk for VMs, in GB. If zero or unspecified, the service will attempt to choose a reasonable default.

int32 disk_size_gb = 7;

Returns
TypeDescription
int

The diskSizeGb.

getDiskSourceImage()

public String getDiskSourceImage()

Fully qualified source image for disks.

string disk_source_image = 8;

Returns
TypeDescription
String

The diskSourceImage.

getDiskSourceImageBytes()

public ByteString getDiskSourceImageBytes()

Fully qualified source image for disks.

string disk_source_image = 8;

Returns
TypeDescription
ByteString

The bytes for diskSourceImage.

getDiskType()

public String getDiskType()

Type of root disk for VMs. If empty or unspecified, the service will attempt to choose a reasonable default.

string disk_type = 16;

Returns
TypeDescription
String

The diskType.

getDiskTypeBytes()

public ByteString getDiskTypeBytes()

Type of root disk for VMs. If empty or unspecified, the service will attempt to choose a reasonable default.

string disk_type = 16;

Returns
TypeDescription
ByteString

The bytes for diskType.

getIpConfiguration()

public WorkerIPAddressConfiguration getIpConfiguration()

Configuration for VM IPs.

.google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 21;

Returns
TypeDescription
WorkerIPAddressConfiguration

The ipConfiguration.

getIpConfigurationValue()

public int getIpConfigurationValue()

Configuration for VM IPs.

.google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 21;

Returns
TypeDescription
int

The enum numeric value on the wire for ipConfiguration.

getKind()

public String getKind()

The kind of the worker pool; currently only harness and shuffle are supported.

string kind = 1;

Returns
TypeDescription
String

The kind.

getKindBytes()

public ByteString getKindBytes()

The kind of the worker pool; currently only harness and shuffle are supported.

string kind = 1;

Returns
TypeDescription
ByteString

The bytes for kind.

getMachineType()

public String getMachineType()

Machine type (e.g. "n1-standard-1"). If empty or unspecified, the service will attempt to choose a reasonable default.

string machine_type = 5;

Returns
TypeDescription
String

The machineType.

getMachineTypeBytes()

public ByteString getMachineTypeBytes()

Machine type (e.g. "n1-standard-1"). If empty or unspecified, the service will attempt to choose a reasonable default.

string machine_type = 5;

Returns
TypeDescription
ByteString

The bytes for machineType.

getMetadata() (deprecated)

public Map<String,String> getMetadata()

Use #getMetadataMap() instead.

Returns
TypeDescription
Map<String,String>

getMetadataCount()

public int getMetadataCount()

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Returns
TypeDescription
int

getMetadataMap()

public Map<String,String> getMetadataMap()

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Returns
TypeDescription
Map<String,String>

getMetadataOrDefault(String key, String defaultValue)

public String getMetadataOrDefault(String key, String defaultValue)

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Parameters
NameDescription
keyString
defaultValueString
Returns
TypeDescription
String

getMetadataOrThrow(String key)

public String getMetadataOrThrow(String key)

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Parameter
NameDescription
keyString
Returns
TypeDescription
String

getMutableMetadata() (deprecated)

public Map<String,String> getMutableMetadata()

Use alternate mutation accessors instead.

Returns
TypeDescription
Map<String,String>

getNetwork()

public String getNetwork()

Network to which VMs will be assigned. If empty or unspecified, the service will use the network "default".

string network = 17;

Returns
TypeDescription
String

The network.

getNetworkBytes()

public ByteString getNetworkBytes()

Network to which VMs will be assigned. If empty or unspecified, the service will use the network "default".

string network = 17;

Returns
TypeDescription
ByteString

The bytes for network.

getNumThreadsPerWorker()

public int getNumThreadsPerWorker()

The number of threads per worker harness. If empty or unspecified, the service will choose a number of threads (according to the number of cores on the selected machine type for batch, or 1 by convention for streaming).

int32 num_threads_per_worker = 20;

Returns
TypeDescription
int

The numThreadsPerWorker.

getNumWorkers()

public int getNumWorkers()

Number of Google Compute Engine workers in this pool needed to execute the job. If zero or unspecified, the service will attempt to choose a reasonable default.

int32 num_workers = 2;

Returns
TypeDescription
int

The numWorkers.

getOnHostMaintenance()

public String getOnHostMaintenance()

The action to take on host maintenance, as defined by the Google Compute Engine API.

string on_host_maintenance = 11;

Returns
TypeDescription
String

The onHostMaintenance.

getOnHostMaintenanceBytes()

public ByteString getOnHostMaintenanceBytes()

The action to take on host maintenance, as defined by the Google Compute Engine API.

string on_host_maintenance = 11;

Returns
TypeDescription
ByteString

The bytes for onHostMaintenance.

getPackages(int index)

public Package getPackages(int index)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
indexint
Returns
TypeDescription
Package

getPackagesBuilder(int index)

public Package.Builder getPackagesBuilder(int index)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
indexint
Returns
TypeDescription
Package.Builder

getPackagesBuilderList()

public List<Package.Builder> getPackagesBuilderList()

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Returns
TypeDescription
List<Builder>

getPackagesCount()

public int getPackagesCount()

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Returns
TypeDescription
int

getPackagesList()

public List<Package> getPackagesList()

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Returns
TypeDescription
List<Package>

getPackagesOrBuilder(int index)

public PackageOrBuilder getPackagesOrBuilder(int index)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
indexint
Returns
TypeDescription
PackageOrBuilder

getPackagesOrBuilderList()

public List<? extends PackageOrBuilder> getPackagesOrBuilderList()

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Returns
TypeDescription
List<? extends com.google.dataflow.v1beta3.PackageOrBuilder>

getPoolArgs()

public Any getPoolArgs()

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Returns
TypeDescription
Any

The poolArgs.

getPoolArgsBuilder()

public Any.Builder getPoolArgsBuilder()

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Returns
TypeDescription
Builder

getPoolArgsOrBuilder()

public AnyOrBuilder getPoolArgsOrBuilder()

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Returns
TypeDescription
AnyOrBuilder

getSdkHarnessContainerImages(int index)

public SdkHarnessContainerImage getSdkHarnessContainerImages(int index)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
indexint
Returns
TypeDescription
SdkHarnessContainerImage

getSdkHarnessContainerImagesBuilder(int index)

public SdkHarnessContainerImage.Builder getSdkHarnessContainerImagesBuilder(int index)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
indexint
Returns
TypeDescription
SdkHarnessContainerImage.Builder

getSdkHarnessContainerImagesBuilderList()

public List<SdkHarnessContainerImage.Builder> getSdkHarnessContainerImagesBuilderList()

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Returns
TypeDescription
List<Builder>

getSdkHarnessContainerImagesCount()

public int getSdkHarnessContainerImagesCount()

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Returns
TypeDescription
int

getSdkHarnessContainerImagesList()

public List<SdkHarnessContainerImage> getSdkHarnessContainerImagesList()

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Returns
TypeDescription
List<SdkHarnessContainerImage>

getSdkHarnessContainerImagesOrBuilder(int index)

public SdkHarnessContainerImageOrBuilder getSdkHarnessContainerImagesOrBuilder(int index)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
indexint
Returns
TypeDescription
SdkHarnessContainerImageOrBuilder

getSdkHarnessContainerImagesOrBuilderList()

public List<? extends SdkHarnessContainerImageOrBuilder> getSdkHarnessContainerImagesOrBuilderList()

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Returns
TypeDescription
List<? extends com.google.dataflow.v1beta3.SdkHarnessContainerImageOrBuilder>

getSubnetwork()

public String getSubnetwork()

Subnetwork to which VMs will be assigned, if desired. Expected to be of the form "regions/REGION/subnetworks/SUBNETWORK".

string subnetwork = 19;

Returns
TypeDescription
String

The subnetwork.

getSubnetworkBytes()

public ByteString getSubnetworkBytes()

Subnetwork to which VMs will be assigned, if desired. Expected to be of the form "regions/REGION/subnetworks/SUBNETWORK".

string subnetwork = 19;

Returns
TypeDescription
ByteString

The bytes for subnetwork.

getTaskrunnerSettings()

public TaskRunnerSettings getTaskrunnerSettings()

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Returns
TypeDescription
TaskRunnerSettings

The taskrunnerSettings.

getTaskrunnerSettingsBuilder()

public TaskRunnerSettings.Builder getTaskrunnerSettingsBuilder()

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Returns
TypeDescription
TaskRunnerSettings.Builder

getTaskrunnerSettingsOrBuilder()

public TaskRunnerSettingsOrBuilder getTaskrunnerSettingsOrBuilder()

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Returns
TypeDescription
TaskRunnerSettingsOrBuilder

getTeardownPolicy()

public TeardownPolicy getTeardownPolicy()

Sets the policy for determining when to turndown worker pool. Allowed values are: TEARDOWN_ALWAYS, TEARDOWN_ON_SUCCESS, and TEARDOWN_NEVER. TEARDOWN_ALWAYS means workers are always torn down regardless of whether the job succeeds. TEARDOWN_ON_SUCCESS means workers are torn down if the job succeeds. TEARDOWN_NEVER means the workers are never torn down.

If the workers are not torn down by the service, they will continue to run and use Google Compute Engine VM resources in the user's project until they are explicitly terminated by the user. Because of this, Google recommends using the TEARDOWN_ALWAYS policy except for small, manually supervised test jobs.

If unknown or unspecified, the service will attempt to choose a reasonable default.

.google.dataflow.v1beta3.TeardownPolicy teardown_policy = 6;

Returns
TypeDescription
TeardownPolicy

The teardownPolicy.

getTeardownPolicyValue()

public int getTeardownPolicyValue()

Sets the policy for determining when to turndown worker pool. Allowed values are: TEARDOWN_ALWAYS, TEARDOWN_ON_SUCCESS, and TEARDOWN_NEVER. TEARDOWN_ALWAYS means workers are always torn down regardless of whether the job succeeds. TEARDOWN_ON_SUCCESS means workers are torn down if the job succeeds. TEARDOWN_NEVER means the workers are never torn down.

If the workers are not torn down by the service, they will continue to run and use Google Compute Engine VM resources in the user's project until they are explicitly terminated by the user. Because of this, Google recommends using the TEARDOWN_ALWAYS policy except for small, manually supervised test jobs.

If unknown or unspecified, the service will attempt to choose a reasonable default.

.google.dataflow.v1beta3.TeardownPolicy teardown_policy = 6;

Returns
TypeDescription
int

The enum numeric value on the wire for teardownPolicy.

getWorkerHarnessContainerImage()

public String getWorkerHarnessContainerImage()

Required. Docker container image that executes the Cloud Dataflow worker harness, residing in Google Container Registry.

Deprecated for the Fn API path. Use sdk_harness_container_images instead.

string worker_harness_container_image = 18;

Returns
TypeDescription
String

The workerHarnessContainerImage.

getWorkerHarnessContainerImageBytes()

public ByteString getWorkerHarnessContainerImageBytes()

Required. Docker container image that executes the Cloud Dataflow worker harness, residing in Google Container Registry.

Deprecated for the Fn API path. Use sdk_harness_container_images instead.

string worker_harness_container_image = 18;

Returns
TypeDescription
ByteString

The bytes for workerHarnessContainerImage.

getZone()

public String getZone()

Zone to run the worker pools in. If empty or unspecified, the service will attempt to choose a reasonable default.

string zone = 9;

Returns
TypeDescription
String

The zone.

getZoneBytes()

public ByteString getZoneBytes()

Zone to run the worker pools in. If empty or unspecified, the service will attempt to choose a reasonable default.

string zone = 9;

Returns
TypeDescription
ByteString

The bytes for zone.

hasAutoscalingSettings()

public boolean hasAutoscalingSettings()

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Returns
TypeDescription
boolean

Whether the autoscalingSettings field is set.

hasPoolArgs()

public boolean hasPoolArgs()

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Returns
TypeDescription
boolean

Whether the poolArgs field is set.

hasTaskrunnerSettings()

public boolean hasTaskrunnerSettings()

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Returns
TypeDescription
boolean

Whether the taskrunnerSettings field is set.

internalGetFieldAccessorTable()

protected GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
Returns
TypeDescription
FieldAccessorTable
Overrides

internalGetMapFieldReflection(int number)

protected MapFieldReflectionAccessor internalGetMapFieldReflection(int number)
Parameter
NameDescription
numberint
Returns
TypeDescription
com.google.protobuf.MapFieldReflectionAccessor
Overrides
com.google.protobuf.GeneratedMessageV3.Builder.internalGetMapFieldReflection(int)

internalGetMutableMapFieldReflection(int number)

protected MapFieldReflectionAccessor internalGetMutableMapFieldReflection(int number)
Parameter
NameDescription
numberint
Returns
TypeDescription
com.google.protobuf.MapFieldReflectionAccessor
Overrides
com.google.protobuf.GeneratedMessageV3.Builder.internalGetMutableMapFieldReflection(int)

isInitialized()

public final boolean isInitialized()
Returns
TypeDescription
boolean
Overrides

mergeAutoscalingSettings(AutoscalingSettings value)

public WorkerPool.Builder mergeAutoscalingSettings(AutoscalingSettings value)

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Parameter
NameDescription
valueAutoscalingSettings
Returns
TypeDescription
WorkerPool.Builder

mergeFrom(WorkerPool other)

public WorkerPool.Builder mergeFrom(WorkerPool other)
Parameter
NameDescription
otherWorkerPool
Returns
TypeDescription
WorkerPool.Builder

mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)

public WorkerPool.Builder mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)
Parameters
NameDescription
inputCodedInputStream
extensionRegistryExtensionRegistryLite
Returns
TypeDescription
WorkerPool.Builder
Overrides
Exceptions
TypeDescription
IOException

mergeFrom(Message other)

public WorkerPool.Builder mergeFrom(Message other)
Parameter
NameDescription
otherMessage
Returns
TypeDescription
WorkerPool.Builder
Overrides

mergePoolArgs(Any value)

public WorkerPool.Builder mergePoolArgs(Any value)

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Parameter
NameDescription
valueAny
Returns
TypeDescription
WorkerPool.Builder

mergeTaskrunnerSettings(TaskRunnerSettings value)

public WorkerPool.Builder mergeTaskrunnerSettings(TaskRunnerSettings value)

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Parameter
NameDescription
valueTaskRunnerSettings
Returns
TypeDescription
WorkerPool.Builder

mergeUnknownFields(UnknownFieldSet unknownFields)

public final WorkerPool.Builder mergeUnknownFields(UnknownFieldSet unknownFields)
Parameter
NameDescription
unknownFieldsUnknownFieldSet
Returns
TypeDescription
WorkerPool.Builder
Overrides

putAllMetadata(Map<String,String> values)

public WorkerPool.Builder putAllMetadata(Map<String,String> values)

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Parameter
NameDescription
valuesMap<String,String>
Returns
TypeDescription
WorkerPool.Builder

putMetadata(String key, String value)

public WorkerPool.Builder putMetadata(String key, String value)

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Parameters
NameDescription
keyString
valueString
Returns
TypeDescription
WorkerPool.Builder

removeDataDisks(int index)

public WorkerPool.Builder removeDataDisks(int index)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameter
NameDescription
indexint
Returns
TypeDescription
WorkerPool.Builder

removeMetadata(String key)

public WorkerPool.Builder removeMetadata(String key)

Metadata to set on the Google Compute Engine VMs.

map<string, string> metadata = 13;

Parameter
NameDescription
keyString
Returns
TypeDescription
WorkerPool.Builder

removePackages(int index)

public WorkerPool.Builder removePackages(int index)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameter
NameDescription
indexint
Returns
TypeDescription
WorkerPool.Builder

removeSdkHarnessContainerImages(int index)

public WorkerPool.Builder removeSdkHarnessContainerImages(int index)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameter
NameDescription
indexint
Returns
TypeDescription
WorkerPool.Builder

setAutoscalingSettings(AutoscalingSettings value)

public WorkerPool.Builder setAutoscalingSettings(AutoscalingSettings value)

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Parameter
NameDescription
valueAutoscalingSettings
Returns
TypeDescription
WorkerPool.Builder

setAutoscalingSettings(AutoscalingSettings.Builder builderForValue)

public WorkerPool.Builder setAutoscalingSettings(AutoscalingSettings.Builder builderForValue)

Settings for autoscaling of this WorkerPool.

.google.dataflow.v1beta3.AutoscalingSettings autoscaling_settings = 14;

Parameter
NameDescription
builderForValueAutoscalingSettings.Builder
Returns
TypeDescription
WorkerPool.Builder

setDataDisks(int index, Disk value)

public WorkerPool.Builder setDataDisks(int index, Disk value)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameters
NameDescription
indexint
valueDisk
Returns
TypeDescription
WorkerPool.Builder

setDataDisks(int index, Disk.Builder builderForValue)

public WorkerPool.Builder setDataDisks(int index, Disk.Builder builderForValue)

Data disks that are used by a VM in this workflow.

repeated .google.dataflow.v1beta3.Disk data_disks = 12;

Parameters
NameDescription
indexint
builderForValueDisk.Builder
Returns
TypeDescription
WorkerPool.Builder

setDefaultPackageSet(DefaultPackageSet value)

public WorkerPool.Builder setDefaultPackageSet(DefaultPackageSet value)

The default package set to install. This allows the service to select a default set of packages which are useful to worker harnesses written in a particular language.

.google.dataflow.v1beta3.DefaultPackageSet default_package_set = 4;

Parameter
NameDescription
valueDefaultPackageSet

The defaultPackageSet to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setDefaultPackageSetValue(int value)

public WorkerPool.Builder setDefaultPackageSetValue(int value)

The default package set to install. This allows the service to select a default set of packages which are useful to worker harnesses written in a particular language.

.google.dataflow.v1beta3.DefaultPackageSet default_package_set = 4;

Parameter
NameDescription
valueint

The enum numeric value on the wire for defaultPackageSet to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setDiskSizeGb(int value)

public WorkerPool.Builder setDiskSizeGb(int value)

Size of root disk for VMs, in GB. If zero or unspecified, the service will attempt to choose a reasonable default.

int32 disk_size_gb = 7;

Parameter
NameDescription
valueint

The diskSizeGb to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setDiskSourceImage(String value)

public WorkerPool.Builder setDiskSourceImage(String value)

Fully qualified source image for disks.

string disk_source_image = 8;

Parameter
NameDescription
valueString

The diskSourceImage to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setDiskSourceImageBytes(ByteString value)

public WorkerPool.Builder setDiskSourceImageBytes(ByteString value)

Fully qualified source image for disks.

string disk_source_image = 8;

Parameter
NameDescription
valueByteString

The bytes for diskSourceImage to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setDiskType(String value)

public WorkerPool.Builder setDiskType(String value)

Type of root disk for VMs. If empty or unspecified, the service will attempt to choose a reasonable default.

string disk_type = 16;

Parameter
NameDescription
valueString

The diskType to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setDiskTypeBytes(ByteString value)

public WorkerPool.Builder setDiskTypeBytes(ByteString value)

Type of root disk for VMs. If empty or unspecified, the service will attempt to choose a reasonable default.

string disk_type = 16;

Parameter
NameDescription
valueByteString

The bytes for diskType to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setField(Descriptors.FieldDescriptor field, Object value)

public WorkerPool.Builder setField(Descriptors.FieldDescriptor field, Object value)
Parameters
NameDescription
fieldFieldDescriptor
valueObject
Returns
TypeDescription
WorkerPool.Builder
Overrides

setIpConfiguration(WorkerIPAddressConfiguration value)

public WorkerPool.Builder setIpConfiguration(WorkerIPAddressConfiguration value)

Configuration for VM IPs.

.google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 21;

Parameter
NameDescription
valueWorkerIPAddressConfiguration

The ipConfiguration to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setIpConfigurationValue(int value)

public WorkerPool.Builder setIpConfigurationValue(int value)

Configuration for VM IPs.

.google.dataflow.v1beta3.WorkerIPAddressConfiguration ip_configuration = 21;

Parameter
NameDescription
valueint

The enum numeric value on the wire for ipConfiguration to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setKind(String value)

public WorkerPool.Builder setKind(String value)

The kind of the worker pool; currently only harness and shuffle are supported.

string kind = 1;

Parameter
NameDescription
valueString

The kind to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setKindBytes(ByteString value)

public WorkerPool.Builder setKindBytes(ByteString value)

The kind of the worker pool; currently only harness and shuffle are supported.

string kind = 1;

Parameter
NameDescription
valueByteString

The bytes for kind to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setMachineType(String value)

public WorkerPool.Builder setMachineType(String value)

Machine type (e.g. "n1-standard-1"). If empty or unspecified, the service will attempt to choose a reasonable default.

string machine_type = 5;

Parameter
NameDescription
valueString

The machineType to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setMachineTypeBytes(ByteString value)

public WorkerPool.Builder setMachineTypeBytes(ByteString value)

Machine type (e.g. "n1-standard-1"). If empty or unspecified, the service will attempt to choose a reasonable default.

string machine_type = 5;

Parameter
NameDescription
valueByteString

The bytes for machineType to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setNetwork(String value)

public WorkerPool.Builder setNetwork(String value)

Network to which VMs will be assigned. If empty or unspecified, the service will use the network "default".

string network = 17;

Parameter
NameDescription
valueString

The network to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setNetworkBytes(ByteString value)

public WorkerPool.Builder setNetworkBytes(ByteString value)

Network to which VMs will be assigned. If empty or unspecified, the service will use the network "default".

string network = 17;

Parameter
NameDescription
valueByteString

The bytes for network to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setNumThreadsPerWorker(int value)

public WorkerPool.Builder setNumThreadsPerWorker(int value)

The number of threads per worker harness. If empty or unspecified, the service will choose a number of threads (according to the number of cores on the selected machine type for batch, or 1 by convention for streaming).

int32 num_threads_per_worker = 20;

Parameter
NameDescription
valueint

The numThreadsPerWorker to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setNumWorkers(int value)

public WorkerPool.Builder setNumWorkers(int value)

Number of Google Compute Engine workers in this pool needed to execute the job. If zero or unspecified, the service will attempt to choose a reasonable default.

int32 num_workers = 2;

Parameter
NameDescription
valueint

The numWorkers to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setOnHostMaintenance(String value)

public WorkerPool.Builder setOnHostMaintenance(String value)

The action to take on host maintenance, as defined by the Google Compute Engine API.

string on_host_maintenance = 11;

Parameter
NameDescription
valueString

The onHostMaintenance to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setOnHostMaintenanceBytes(ByteString value)

public WorkerPool.Builder setOnHostMaintenanceBytes(ByteString value)

The action to take on host maintenance, as defined by the Google Compute Engine API.

string on_host_maintenance = 11;

Parameter
NameDescription
valueByteString

The bytes for onHostMaintenance to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setPackages(int index, Package value)

public WorkerPool.Builder setPackages(int index, Package value)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameters
NameDescription
indexint
valuePackage
Returns
TypeDescription
WorkerPool.Builder

setPackages(int index, Package.Builder builderForValue)

public WorkerPool.Builder setPackages(int index, Package.Builder builderForValue)

Packages to be installed on workers.

repeated .google.dataflow.v1beta3.Package packages = 3;

Parameters
NameDescription
indexint
builderForValuePackage.Builder
Returns
TypeDescription
WorkerPool.Builder

setPoolArgs(Any value)

public WorkerPool.Builder setPoolArgs(Any value)

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Parameter
NameDescription
valueAny
Returns
TypeDescription
WorkerPool.Builder

setPoolArgs(Any.Builder builderForValue)

public WorkerPool.Builder setPoolArgs(Any.Builder builderForValue)

Extra arguments for this worker pool.

.google.protobuf.Any pool_args = 15;

Parameter
NameDescription
builderForValueBuilder
Returns
TypeDescription
WorkerPool.Builder

setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)

public WorkerPool.Builder setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)
Parameters
NameDescription
fieldFieldDescriptor
indexint
valueObject
Returns
TypeDescription
WorkerPool.Builder
Overrides

setSdkHarnessContainerImages(int index, SdkHarnessContainerImage value)

public WorkerPool.Builder setSdkHarnessContainerImages(int index, SdkHarnessContainerImage value)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameters
NameDescription
indexint
valueSdkHarnessContainerImage
Returns
TypeDescription
WorkerPool.Builder

setSdkHarnessContainerImages(int index, SdkHarnessContainerImage.Builder builderForValue)

public WorkerPool.Builder setSdkHarnessContainerImages(int index, SdkHarnessContainerImage.Builder builderForValue)

Set of SDK harness containers needed to execute this pipeline. This will only be set in the Fn API path. For non-cross-language pipelines this should have only one entry. Cross-language pipelines will have two or more entries.

repeated .google.dataflow.v1beta3.SdkHarnessContainerImage sdk_harness_container_images = 22;

Parameters
NameDescription
indexint
builderForValueSdkHarnessContainerImage.Builder
Returns
TypeDescription
WorkerPool.Builder

setSubnetwork(String value)

public WorkerPool.Builder setSubnetwork(String value)

Subnetwork to which VMs will be assigned, if desired. Expected to be of the form "regions/REGION/subnetworks/SUBNETWORK".

string subnetwork = 19;

Parameter
NameDescription
valueString

The subnetwork to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setSubnetworkBytes(ByteString value)

public WorkerPool.Builder setSubnetworkBytes(ByteString value)

Subnetwork to which VMs will be assigned, if desired. Expected to be of the form "regions/REGION/subnetworks/SUBNETWORK".

string subnetwork = 19;

Parameter
NameDescription
valueByteString

The bytes for subnetwork to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setTaskrunnerSettings(TaskRunnerSettings value)

public WorkerPool.Builder setTaskrunnerSettings(TaskRunnerSettings value)

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Parameter
NameDescription
valueTaskRunnerSettings
Returns
TypeDescription
WorkerPool.Builder

setTaskrunnerSettings(TaskRunnerSettings.Builder builderForValue)

public WorkerPool.Builder setTaskrunnerSettings(TaskRunnerSettings.Builder builderForValue)

Settings passed through to Google Compute Engine workers when using the standard Dataflow task runner. Users should ignore this field.

.google.dataflow.v1beta3.TaskRunnerSettings taskrunner_settings = 10;

Parameter
NameDescription
builderForValueTaskRunnerSettings.Builder
Returns
TypeDescription
WorkerPool.Builder

setTeardownPolicy(TeardownPolicy value)

public WorkerPool.Builder setTeardownPolicy(TeardownPolicy value)

Sets the policy for determining when to turndown worker pool. Allowed values are: TEARDOWN_ALWAYS, TEARDOWN_ON_SUCCESS, and TEARDOWN_NEVER. TEARDOWN_ALWAYS means workers are always torn down regardless of whether the job succeeds. TEARDOWN_ON_SUCCESS means workers are torn down if the job succeeds. TEARDOWN_NEVER means the workers are never torn down.

If the workers are not torn down by the service, they will continue to run and use Google Compute Engine VM resources in the user's project until they are explicitly terminated by the user. Because of this, Google recommends using the TEARDOWN_ALWAYS policy except for small, manually supervised test jobs.

If unknown or unspecified, the service will attempt to choose a reasonable default.

.google.dataflow.v1beta3.TeardownPolicy teardown_policy = 6;

Parameter
NameDescription
valueTeardownPolicy

The teardownPolicy to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setTeardownPolicyValue(int value)

public WorkerPool.Builder setTeardownPolicyValue(int value)

Sets the policy for determining when to turndown worker pool. Allowed values are: TEARDOWN_ALWAYS, TEARDOWN_ON_SUCCESS, and TEARDOWN_NEVER. TEARDOWN_ALWAYS means workers are always torn down regardless of whether the job succeeds. TEARDOWN_ON_SUCCESS means workers are torn down if the job succeeds. TEARDOWN_NEVER means the workers are never torn down.

If the workers are not torn down by the service, they will continue to run and use Google Compute Engine VM resources in the user's project until they are explicitly terminated by the user. Because of this, Google recommends using the TEARDOWN_ALWAYS policy except for small, manually supervised test jobs.

If unknown or unspecified, the service will attempt to choose a reasonable default.

.google.dataflow.v1beta3.TeardownPolicy teardown_policy = 6;

Parameter
NameDescription
valueint

The enum numeric value on the wire for teardownPolicy to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setUnknownFields(UnknownFieldSet unknownFields)

public final WorkerPool.Builder setUnknownFields(UnknownFieldSet unknownFields)
Parameter
NameDescription
unknownFieldsUnknownFieldSet
Returns
TypeDescription
WorkerPool.Builder
Overrides

setWorkerHarnessContainerImage(String value)

public WorkerPool.Builder setWorkerHarnessContainerImage(String value)

Required. Docker container image that executes the Cloud Dataflow worker harness, residing in Google Container Registry.

Deprecated for the Fn API path. Use sdk_harness_container_images instead.

string worker_harness_container_image = 18;

Parameter
NameDescription
valueString

The workerHarnessContainerImage to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setWorkerHarnessContainerImageBytes(ByteString value)

public WorkerPool.Builder setWorkerHarnessContainerImageBytes(ByteString value)

Required. Docker container image that executes the Cloud Dataflow worker harness, residing in Google Container Registry.

Deprecated for the Fn API path. Use sdk_harness_container_images instead.

string worker_harness_container_image = 18;

Parameter
NameDescription
valueByteString

The bytes for workerHarnessContainerImage to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setZone(String value)

public WorkerPool.Builder setZone(String value)

Zone to run the worker pools in. If empty or unspecified, the service will attempt to choose a reasonable default.

string zone = 9;

Parameter
NameDescription
valueString

The zone to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.

setZoneBytes(ByteString value)

public WorkerPool.Builder setZoneBytes(ByteString value)

Zone to run the worker pools in. If empty or unspecified, the service will attempt to choose a reasonable default.

string zone = 9;

Parameter
NameDescription
valueByteString

The bytes for zone to set.

Returns
TypeDescription
WorkerPool.Builder

This builder for chaining.