public static final class ClusterConfig.Builder extends GeneratedMessageV3.Builder<ClusterConfig.Builder> implements ClusterConfigOrBuilderThe cluster config.
Protobuf type google.cloud.dataproc.v1.ClusterConfig
Inheritance
Object > AbstractMessageLite.Builder<MessageType,BuilderType> > AbstractMessage.Builder<BuilderType> > GeneratedMessageV3.Builder > ClusterConfig.BuilderImplements
ClusterConfigOrBuilderStatic Methods
getDescriptor()
public static final Descriptors.Descriptor getDescriptor()| Type | Description |
| Descriptor |
Methods
addAllInitializationActions(Iterable<? extends NodeInitializationAction> values)
public ClusterConfig.Builder addAllInitializationActions(Iterable<? extends NodeInitializationAction> values) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| values | Iterable<? extends com.google.cloud.dataproc.v1.NodeInitializationAction> |
| Type | Description |
| ClusterConfig.Builder |
addInitializationActions(NodeInitializationAction value)
public ClusterConfig.Builder addInitializationActions(NodeInitializationAction value) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | NodeInitializationAction |
| Type | Description |
| ClusterConfig.Builder |
addInitializationActions(NodeInitializationAction.Builder builderForValue)
public ClusterConfig.Builder addInitializationActions(NodeInitializationAction.Builder builderForValue) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | NodeInitializationAction.Builder |
| Type | Description |
| ClusterConfig.Builder |
addInitializationActions(int index, NodeInitializationAction value)
public ClusterConfig.Builder addInitializationActions(int index, NodeInitializationAction value) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| value | NodeInitializationAction |
| Type | Description |
| ClusterConfig.Builder |
addInitializationActions(int index, NodeInitializationAction.Builder builderForValue)
public ClusterConfig.Builder addInitializationActions(int index, NodeInitializationAction.Builder builderForValue) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| builderForValue | NodeInitializationAction.Builder |
| Type | Description |
| ClusterConfig.Builder |
addInitializationActionsBuilder()
public NodeInitializationAction.Builder addInitializationActionsBuilder() Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| NodeInitializationAction.Builder |
addInitializationActionsBuilder(int index)
public NodeInitializationAction.Builder addInitializationActionsBuilder(int index) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| Type | Description |
| NodeInitializationAction.Builder |
addRepeatedField(Descriptors.FieldDescriptor field, Object value)
public ClusterConfig.Builder addRepeatedField(Descriptors.FieldDescriptor field, Object value)| Name | Description |
| field | FieldDescriptor |
| value | Object |
| Type | Description |
| ClusterConfig.Builder |
build()
public ClusterConfig build()| Type | Description |
| ClusterConfig |
buildPartial()
public ClusterConfig buildPartial()| Type | Description |
| ClusterConfig |
clear()
public ClusterConfig.Builder clear()| Type | Description |
| ClusterConfig.Builder |
clearAutoscalingConfig()
public ClusterConfig.Builder clearAutoscalingConfig()Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearConfigBucket()
public ClusterConfig.Builder clearConfigBucket() Optional. A Cloud Storage bucket used to stage job
dependencies, config files, and job driver console output.
If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's staging bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string config_bucket = 1 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder | This builder for chaining. |
clearEncryptionConfig()
public ClusterConfig.Builder clearEncryptionConfig()Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearEndpointConfig()
public ClusterConfig.Builder clearEndpointConfig()Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearField(Descriptors.FieldDescriptor field)
public ClusterConfig.Builder clearField(Descriptors.FieldDescriptor field)| Name | Description |
| field | FieldDescriptor |
| Type | Description |
| ClusterConfig.Builder |
clearGceClusterConfig()
public ClusterConfig.Builder clearGceClusterConfig()Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearInitializationActions()
public ClusterConfig.Builder clearInitializationActions() Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearLifecycleConfig()
public ClusterConfig.Builder clearLifecycleConfig()Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearMasterConfig()
public ClusterConfig.Builder clearMasterConfig()Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearMetastoreConfig()
public ClusterConfig.Builder clearMetastoreConfig()Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearOneof(Descriptors.OneofDescriptor oneof)
public ClusterConfig.Builder clearOneof(Descriptors.OneofDescriptor oneof)| Name | Description |
| oneof | OneofDescriptor |
| Type | Description |
| ClusterConfig.Builder |
clearSecondaryWorkerConfig()
public ClusterConfig.Builder clearSecondaryWorkerConfig()Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearSecurityConfig()
public ClusterConfig.Builder clearSecurityConfig()Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearSoftwareConfig()
public ClusterConfig.Builder clearSoftwareConfig()Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clearTempBucket()
public ClusterConfig.Builder clearTempBucket() Optional. A Cloud Storage bucket used to store ephemeral cluster and jobs data,
such as Spark and MapReduce history files.
If you do not specify a temp bucket,
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's temp bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket. The default bucket has
a TTL of 90 days, but you can use any TTL (or none) if you specify a
bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string temp_bucket = 2 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder | This builder for chaining. |
clearWorkerConfig()
public ClusterConfig.Builder clearWorkerConfig()Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ClusterConfig.Builder |
clone()
public ClusterConfig.Builder clone()| Type | Description |
| ClusterConfig.Builder |
getAutoscalingConfig()
public AutoscalingConfig getAutoscalingConfig()Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| AutoscalingConfig | The autoscalingConfig. |
getAutoscalingConfigBuilder()
public AutoscalingConfig.Builder getAutoscalingConfigBuilder()Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| AutoscalingConfig.Builder |
getAutoscalingConfigOrBuilder()
public AutoscalingConfigOrBuilder getAutoscalingConfigOrBuilder()Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| AutoscalingConfigOrBuilder |
getConfigBucket()
public String getConfigBucket() Optional. A Cloud Storage bucket used to stage job
dependencies, config files, and job driver console output.
If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's staging bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string config_bucket = 1 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| String | The configBucket. |
getConfigBucketBytes()
public ByteString getConfigBucketBytes() Optional. A Cloud Storage bucket used to stage job
dependencies, config files, and job driver console output.
If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's staging bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string config_bucket = 1 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ByteString | The bytes for configBucket. |
getDefaultInstanceForType()
public ClusterConfig getDefaultInstanceForType()| Type | Description |
| ClusterConfig |
getDescriptorForType()
public Descriptors.Descriptor getDescriptorForType()| Type | Description |
| Descriptor |
getEncryptionConfig()
public EncryptionConfig getEncryptionConfig()Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| EncryptionConfig | The encryptionConfig. |
getEncryptionConfigBuilder()
public EncryptionConfig.Builder getEncryptionConfigBuilder()Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| EncryptionConfig.Builder |
getEncryptionConfigOrBuilder()
public EncryptionConfigOrBuilder getEncryptionConfigOrBuilder()Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| EncryptionConfigOrBuilder |
getEndpointConfig()
public EndpointConfig getEndpointConfig()Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| EndpointConfig | The endpointConfig. |
getEndpointConfigBuilder()
public EndpointConfig.Builder getEndpointConfigBuilder()Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| EndpointConfig.Builder |
getEndpointConfigOrBuilder()
public EndpointConfigOrBuilder getEndpointConfigOrBuilder()Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| EndpointConfigOrBuilder |
getGceClusterConfig()
public GceClusterConfig getGceClusterConfig()Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| GceClusterConfig | The gceClusterConfig. |
getGceClusterConfigBuilder()
public GceClusterConfig.Builder getGceClusterConfigBuilder()Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| GceClusterConfig.Builder |
getGceClusterConfigOrBuilder()
public GceClusterConfigOrBuilder getGceClusterConfigOrBuilder()Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| GceClusterConfigOrBuilder |
getInitializationActions(int index)
public NodeInitializationAction getInitializationActions(int index) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| Type | Description |
| NodeInitializationAction |
getInitializationActionsBuilder(int index)
public NodeInitializationAction.Builder getInitializationActionsBuilder(int index) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| Type | Description |
| NodeInitializationAction.Builder |
getInitializationActionsBuilderList()
public List<NodeInitializationAction.Builder> getInitializationActionsBuilderList() Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| List<Builder> |
getInitializationActionsCount()
public int getInitializationActionsCount() Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| int |
getInitializationActionsList()
public List<NodeInitializationAction> getInitializationActionsList() Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| List<NodeInitializationAction> |
getInitializationActionsOrBuilder(int index)
public NodeInitializationActionOrBuilder getInitializationActionsOrBuilder(int index) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| Type | Description |
| NodeInitializationActionOrBuilder |
getInitializationActionsOrBuilderList()
public List<? extends NodeInitializationActionOrBuilder> getInitializationActionsOrBuilderList() Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| List<? extends com.google.cloud.dataproc.v1.NodeInitializationActionOrBuilder> |
getLifecycleConfig()
public LifecycleConfig getLifecycleConfig()Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| LifecycleConfig | The lifecycleConfig. |
getLifecycleConfigBuilder()
public LifecycleConfig.Builder getLifecycleConfigBuilder()Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| LifecycleConfig.Builder |
getLifecycleConfigOrBuilder()
public LifecycleConfigOrBuilder getLifecycleConfigOrBuilder()Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| LifecycleConfigOrBuilder |
getMasterConfig()
public InstanceGroupConfig getMasterConfig()Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfig | The masterConfig. |
getMasterConfigBuilder()
public InstanceGroupConfig.Builder getMasterConfigBuilder()Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfig.Builder |
getMasterConfigOrBuilder()
public InstanceGroupConfigOrBuilder getMasterConfigOrBuilder()Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfigOrBuilder |
getMetastoreConfig()
public MetastoreConfig getMetastoreConfig()Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| MetastoreConfig | The metastoreConfig. |
getMetastoreConfigBuilder()
public MetastoreConfig.Builder getMetastoreConfigBuilder()Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| MetastoreConfig.Builder |
getMetastoreConfigOrBuilder()
public MetastoreConfigOrBuilder getMetastoreConfigOrBuilder()Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| MetastoreConfigOrBuilder |
getSecondaryWorkerConfig()
public InstanceGroupConfig getSecondaryWorkerConfig()Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfig | The secondaryWorkerConfig. |
getSecondaryWorkerConfigBuilder()
public InstanceGroupConfig.Builder getSecondaryWorkerConfigBuilder()Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfig.Builder |
getSecondaryWorkerConfigOrBuilder()
public InstanceGroupConfigOrBuilder getSecondaryWorkerConfigOrBuilder()Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfigOrBuilder |
getSecurityConfig()
public SecurityConfig getSecurityConfig()Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| SecurityConfig | The securityConfig. |
getSecurityConfigBuilder()
public SecurityConfig.Builder getSecurityConfigBuilder()Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| SecurityConfig.Builder |
getSecurityConfigOrBuilder()
public SecurityConfigOrBuilder getSecurityConfigOrBuilder()Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| SecurityConfigOrBuilder |
getSoftwareConfig()
public SoftwareConfig getSoftwareConfig()Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| SoftwareConfig | The softwareConfig. |
getSoftwareConfigBuilder()
public SoftwareConfig.Builder getSoftwareConfigBuilder()Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| SoftwareConfig.Builder |
getSoftwareConfigOrBuilder()
public SoftwareConfigOrBuilder getSoftwareConfigOrBuilder()Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| SoftwareConfigOrBuilder |
getTempBucket()
public String getTempBucket() Optional. A Cloud Storage bucket used to store ephemeral cluster and jobs data,
such as Spark and MapReduce history files.
If you do not specify a temp bucket,
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's temp bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket. The default bucket has
a TTL of 90 days, but you can use any TTL (or none) if you specify a
bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string temp_bucket = 2 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| String | The tempBucket. |
getTempBucketBytes()
public ByteString getTempBucketBytes() Optional. A Cloud Storage bucket used to store ephemeral cluster and jobs data,
such as Spark and MapReduce history files.
If you do not specify a temp bucket,
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's temp bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket. The default bucket has
a TTL of 90 days, but you can use any TTL (or none) if you specify a
bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string temp_bucket = 2 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| ByteString | The bytes for tempBucket. |
getWorkerConfig()
public InstanceGroupConfig getWorkerConfig()Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfig | The workerConfig. |
getWorkerConfigBuilder()
public InstanceGroupConfig.Builder getWorkerConfigBuilder()Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfig.Builder |
getWorkerConfigOrBuilder()
public InstanceGroupConfigOrBuilder getWorkerConfigOrBuilder()Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| InstanceGroupConfigOrBuilder |
hasAutoscalingConfig()
public boolean hasAutoscalingConfig()Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the autoscalingConfig field is set. |
hasEncryptionConfig()
public boolean hasEncryptionConfig()Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the encryptionConfig field is set. |
hasEndpointConfig()
public boolean hasEndpointConfig()Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the endpointConfig field is set. |
hasGceClusterConfig()
public boolean hasGceClusterConfig()Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the gceClusterConfig field is set. |
hasLifecycleConfig()
public boolean hasLifecycleConfig()Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the lifecycleConfig field is set. |
hasMasterConfig()
public boolean hasMasterConfig()Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the masterConfig field is set. |
hasMetastoreConfig()
public boolean hasMetastoreConfig()Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the metastoreConfig field is set. |
hasSecondaryWorkerConfig()
public boolean hasSecondaryWorkerConfig()Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the secondaryWorkerConfig field is set. |
hasSecurityConfig()
public boolean hasSecurityConfig()Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the securityConfig field is set. |
hasSoftwareConfig()
public boolean hasSoftwareConfig()Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the softwareConfig field is set. |
hasWorkerConfig()
public boolean hasWorkerConfig()Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Type | Description |
| boolean | Whether the workerConfig field is set. |
internalGetFieldAccessorTable()
protected GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()| Type | Description |
| FieldAccessorTable |
isInitialized()
public final boolean isInitialized()| Type | Description |
| boolean |
mergeAutoscalingConfig(AutoscalingConfig value)
public ClusterConfig.Builder mergeAutoscalingConfig(AutoscalingConfig value)Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | AutoscalingConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeEncryptionConfig(EncryptionConfig value)
public ClusterConfig.Builder mergeEncryptionConfig(EncryptionConfig value)Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | EncryptionConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeEndpointConfig(EndpointConfig value)
public ClusterConfig.Builder mergeEndpointConfig(EndpointConfig value)Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | EndpointConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeFrom(ClusterConfig other)
public ClusterConfig.Builder mergeFrom(ClusterConfig other)| Name | Description |
| other | ClusterConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)
public ClusterConfig.Builder mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)| Name | Description |
| input | CodedInputStream |
| extensionRegistry | ExtensionRegistryLite |
| Type | Description |
| ClusterConfig.Builder |
| Type | Description |
| IOException |
mergeFrom(Message other)
public ClusterConfig.Builder mergeFrom(Message other)| Name | Description |
| other | Message |
| Type | Description |
| ClusterConfig.Builder |
mergeGceClusterConfig(GceClusterConfig value)
public ClusterConfig.Builder mergeGceClusterConfig(GceClusterConfig value)Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | GceClusterConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeLifecycleConfig(LifecycleConfig value)
public ClusterConfig.Builder mergeLifecycleConfig(LifecycleConfig value)Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | LifecycleConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeMasterConfig(InstanceGroupConfig value)
public ClusterConfig.Builder mergeMasterConfig(InstanceGroupConfig value)Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | InstanceGroupConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeMetastoreConfig(MetastoreConfig value)
public ClusterConfig.Builder mergeMetastoreConfig(MetastoreConfig value)Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | MetastoreConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeSecondaryWorkerConfig(InstanceGroupConfig value)
public ClusterConfig.Builder mergeSecondaryWorkerConfig(InstanceGroupConfig value)Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | InstanceGroupConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeSecurityConfig(SecurityConfig value)
public ClusterConfig.Builder mergeSecurityConfig(SecurityConfig value)Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | SecurityConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeSoftwareConfig(SoftwareConfig value)
public ClusterConfig.Builder mergeSoftwareConfig(SoftwareConfig value)Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | SoftwareConfig |
| Type | Description |
| ClusterConfig.Builder |
mergeUnknownFields(UnknownFieldSet unknownFields)
public final ClusterConfig.Builder mergeUnknownFields(UnknownFieldSet unknownFields)| Name | Description |
| unknownFields | UnknownFieldSet |
| Type | Description |
| ClusterConfig.Builder |
mergeWorkerConfig(InstanceGroupConfig value)
public ClusterConfig.Builder mergeWorkerConfig(InstanceGroupConfig value)Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | InstanceGroupConfig |
| Type | Description |
| ClusterConfig.Builder |
removeInitializationActions(int index)
public ClusterConfig.Builder removeInitializationActions(int index) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| Type | Description |
| ClusterConfig.Builder |
setAutoscalingConfig(AutoscalingConfig value)
public ClusterConfig.Builder setAutoscalingConfig(AutoscalingConfig value)Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | AutoscalingConfig |
| Type | Description |
| ClusterConfig.Builder |
setAutoscalingConfig(AutoscalingConfig.Builder builderForValue)
public ClusterConfig.Builder setAutoscalingConfig(AutoscalingConfig.Builder builderForValue)Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.
.google.cloud.dataproc.v1.AutoscalingConfig autoscaling_config = 18 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | AutoscalingConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setConfigBucket(String value)
public ClusterConfig.Builder setConfigBucket(String value) Optional. A Cloud Storage bucket used to stage job
dependencies, config files, and job driver console output.
If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's staging bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string config_bucket = 1 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | StringThe configBucket to set. |
| Type | Description |
| ClusterConfig.Builder | This builder for chaining. |
setConfigBucketBytes(ByteString value)
public ClusterConfig.Builder setConfigBucketBytes(ByteString value) Optional. A Cloud Storage bucket used to stage job
dependencies, config files, and job driver console output.
If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's staging bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string config_bucket = 1 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | ByteStringThe bytes for configBucket to set. |
| Type | Description |
| ClusterConfig.Builder | This builder for chaining. |
setEncryptionConfig(EncryptionConfig value)
public ClusterConfig.Builder setEncryptionConfig(EncryptionConfig value)Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | EncryptionConfig |
| Type | Description |
| ClusterConfig.Builder |
setEncryptionConfig(EncryptionConfig.Builder builderForValue)
public ClusterConfig.Builder setEncryptionConfig(EncryptionConfig.Builder builderForValue)Optional. Encryption settings for the cluster.
.google.cloud.dataproc.v1.EncryptionConfig encryption_config = 15 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | EncryptionConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setEndpointConfig(EndpointConfig value)
public ClusterConfig.Builder setEndpointConfig(EndpointConfig value)Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | EndpointConfig |
| Type | Description |
| ClusterConfig.Builder |
setEndpointConfig(EndpointConfig.Builder builderForValue)
public ClusterConfig.Builder setEndpointConfig(EndpointConfig.Builder builderForValue)Optional. Port/endpoint configuration for this cluster
.google.cloud.dataproc.v1.EndpointConfig endpoint_config = 19 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | EndpointConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setField(Descriptors.FieldDescriptor field, Object value)
public ClusterConfig.Builder setField(Descriptors.FieldDescriptor field, Object value)| Name | Description |
| field | FieldDescriptor |
| value | Object |
| Type | Description |
| ClusterConfig.Builder |
setGceClusterConfig(GceClusterConfig value)
public ClusterConfig.Builder setGceClusterConfig(GceClusterConfig value)Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | GceClusterConfig |
| Type | Description |
| ClusterConfig.Builder |
setGceClusterConfig(GceClusterConfig.Builder builderForValue)
public ClusterConfig.Builder setGceClusterConfig(GceClusterConfig.Builder builderForValue)Optional. The shared Compute Engine config settings for all instances in a cluster.
.google.cloud.dataproc.v1.GceClusterConfig gce_cluster_config = 8 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | GceClusterConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setInitializationActions(int index, NodeInitializationAction value)
public ClusterConfig.Builder setInitializationActions(int index, NodeInitializationAction value) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| value | NodeInitializationAction |
| Type | Description |
| ClusterConfig.Builder |
setInitializationActions(int index, NodeInitializationAction.Builder builderForValue)
public ClusterConfig.Builder setInitializationActions(int index, NodeInitializationAction.Builder builderForValue) Optional. Commands to execute on each node after config is
completed. By default, executables are run on master and all worker nodes.
You can test a node's role metadata to run an executable on
a master or worker node, as shown below using curl (you can also use
wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
repeated .google.cloud.dataproc.v1.NodeInitializationAction initialization_actions = 11 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| index | int |
| builderForValue | NodeInitializationAction.Builder |
| Type | Description |
| ClusterConfig.Builder |
setLifecycleConfig(LifecycleConfig value)
public ClusterConfig.Builder setLifecycleConfig(LifecycleConfig value)Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | LifecycleConfig |
| Type | Description |
| ClusterConfig.Builder |
setLifecycleConfig(LifecycleConfig.Builder builderForValue)
public ClusterConfig.Builder setLifecycleConfig(LifecycleConfig.Builder builderForValue)Optional. Lifecycle setting for the cluster.
.google.cloud.dataproc.v1.LifecycleConfig lifecycle_config = 17 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | LifecycleConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setMasterConfig(InstanceGroupConfig value)
public ClusterConfig.Builder setMasterConfig(InstanceGroupConfig value)Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | InstanceGroupConfig |
| Type | Description |
| ClusterConfig.Builder |
setMasterConfig(InstanceGroupConfig.Builder builderForValue)
public ClusterConfig.Builder setMasterConfig(InstanceGroupConfig.Builder builderForValue)Optional. The Compute Engine config settings for the cluster's master instance.
.google.cloud.dataproc.v1.InstanceGroupConfig master_config = 9 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | InstanceGroupConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setMetastoreConfig(MetastoreConfig value)
public ClusterConfig.Builder setMetastoreConfig(MetastoreConfig value)Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | MetastoreConfig |
| Type | Description |
| ClusterConfig.Builder |
setMetastoreConfig(MetastoreConfig.Builder builderForValue)
public ClusterConfig.Builder setMetastoreConfig(MetastoreConfig.Builder builderForValue)Optional. Metastore configuration.
.google.cloud.dataproc.v1.MetastoreConfig metastore_config = 20 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | MetastoreConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)
public ClusterConfig.Builder setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)| Name | Description |
| field | FieldDescriptor |
| index | int |
| value | Object |
| Type | Description |
| ClusterConfig.Builder |
setSecondaryWorkerConfig(InstanceGroupConfig value)
public ClusterConfig.Builder setSecondaryWorkerConfig(InstanceGroupConfig value)Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | InstanceGroupConfig |
| Type | Description |
| ClusterConfig.Builder |
setSecondaryWorkerConfig(InstanceGroupConfig.Builder builderForValue)
public ClusterConfig.Builder setSecondaryWorkerConfig(InstanceGroupConfig.Builder builderForValue)Optional. The Compute Engine config settings for a cluster's secondary worker instances
.google.cloud.dataproc.v1.InstanceGroupConfig secondary_worker_config = 12 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | InstanceGroupConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setSecurityConfig(SecurityConfig value)
public ClusterConfig.Builder setSecurityConfig(SecurityConfig value)Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | SecurityConfig |
| Type | Description |
| ClusterConfig.Builder |
setSecurityConfig(SecurityConfig.Builder builderForValue)
public ClusterConfig.Builder setSecurityConfig(SecurityConfig.Builder builderForValue)Optional. Security settings for the cluster.
.google.cloud.dataproc.v1.SecurityConfig security_config = 16 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | SecurityConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setSoftwareConfig(SoftwareConfig value)
public ClusterConfig.Builder setSoftwareConfig(SoftwareConfig value)Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | SoftwareConfig |
| Type | Description |
| ClusterConfig.Builder |
setSoftwareConfig(SoftwareConfig.Builder builderForValue)
public ClusterConfig.Builder setSoftwareConfig(SoftwareConfig.Builder builderForValue)Optional. The config settings for cluster software.
.google.cloud.dataproc.v1.SoftwareConfig software_config = 13 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | SoftwareConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |
setTempBucket(String value)
public ClusterConfig.Builder setTempBucket(String value) Optional. A Cloud Storage bucket used to store ephemeral cluster and jobs data,
such as Spark and MapReduce history files.
If you do not specify a temp bucket,
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's temp bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket. The default bucket has
a TTL of 90 days, but you can use any TTL (or none) if you specify a
bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string temp_bucket = 2 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | StringThe tempBucket to set. |
| Type | Description |
| ClusterConfig.Builder | This builder for chaining. |
setTempBucketBytes(ByteString value)
public ClusterConfig.Builder setTempBucketBytes(ByteString value) Optional. A Cloud Storage bucket used to store ephemeral cluster and jobs data,
such as Spark and MapReduce history files.
If you do not specify a temp bucket,
Dataproc will determine a Cloud Storage location (US,
ASIA, or EU) for your cluster's temp bucket according to the
Compute Engine zone where your cluster is deployed, and then create
and manage this project-level, per-location bucket. The default bucket has
a TTL of 90 days, but you can use any TTL (or none) if you specify a
bucket (see
Dataproc staging and temp
buckets).
This field requires a Cloud Storage bucket name, not a gs://... URI to
a Cloud Storage bucket.
string temp_bucket = 2 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | ByteStringThe bytes for tempBucket to set. |
| Type | Description |
| ClusterConfig.Builder | This builder for chaining. |
setUnknownFields(UnknownFieldSet unknownFields)
public final ClusterConfig.Builder setUnknownFields(UnknownFieldSet unknownFields)| Name | Description |
| unknownFields | UnknownFieldSet |
| Type | Description |
| ClusterConfig.Builder |
setWorkerConfig(InstanceGroupConfig value)
public ClusterConfig.Builder setWorkerConfig(InstanceGroupConfig value)Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| value | InstanceGroupConfig |
| Type | Description |
| ClusterConfig.Builder |
setWorkerConfig(InstanceGroupConfig.Builder builderForValue)
public ClusterConfig.Builder setWorkerConfig(InstanceGroupConfig.Builder builderForValue)Optional. The Compute Engine config settings for the cluster's worker instances.
.google.cloud.dataproc.v1.InstanceGroupConfig worker_config = 10 [(.google.api.field_behavior) = OPTIONAL];
| Name | Description |
| builderForValue | InstanceGroupConfig.Builder |
| Type | Description |
| ClusterConfig.Builder |