Class GkeNodePoolTarget (5.6.0)

GkeNodePoolTarget(mapping=None, *, ignore_unknown_fields=False, **kwargs)

GKE node pools that Dataproc workloads run on.

Attributes

NameDescription
node_pool str
Required. The target GKE node pool. Format: 'projects/{project}/locations/{location}/clusters/{cluster}/nodePools/{node_pool}'
roles MutableSequence[google.cloud.dataproc_v1.types.GkeNodePoolTarget.Role]
Required. The roles associated with the GKE node pool.
node_pool_config google.cloud.dataproc_v1.types.GkeNodePoolConfig
Input only. The configuration for the GKE node pool. If specified, Dataproc attempts to create a node pool with the specified shape. If one with the same name already exists, it is verified against all specified fields. If a field differs, the virtual cluster creation will fail. If omitted, any node pool with the specified name is used. If a node pool with the specified name does not exist, Dataproc create a node pool with default values. This is an input only field. It will not be returned by the API.

Classes

Role

Role(value)

Role specifies the tasks that will run on the node pool. Roles can be specific to workloads. Exactly one GkeNodePoolTarget within the virtual cluster must have the DEFAULT role, which is used to run all workloads that are not associated with a node pool.

Values: ROLE_UNSPECIFIED (0): Role is unspecified. DEFAULT (1): At least one node pool must have the DEFAULT role. Work assigned to a role that is not associated with a node pool is assigned to the node pool with the DEFAULT role. For example, work assigned to the CONTROLLER role will be assigned to the node pool with the DEFAULT role if no node pool has the CONTROLLER role. CONTROLLER (2): Run work associated with the Dataproc control plane (for example, controllers and webhooks). Very low resource requirements. SPARK_DRIVER (3): Run work associated with a Spark driver of a job. SPARK_EXECUTOR (4): Run work associated with a Spark executor of a job.