This feature allows you to select a minimum CPU platform for your Cloud Dataproc clusters. For example, when you create a cluster, you can select Intel Skylake CPUs for the cluster's master and/or worker instances to improve job performance.
Before using this feature, see Available regions & zones, which lists
the platforms available in each zone. You can also run the
gcloud compute zones describe zone
command to list
the availableCpuPlatforms
in your cluster's zone (see
Specifying a Minimum CPU Platform for VM Instances for
more information).
Using Minimum CPU Platform
gcloud command
To specify a minimum CPU platform for your cluster's master and/or worker (including preemptible) instances, pass one or both of the following flags to the gcloud beta dataproc clusters create command:
gcloud beta dataproc clusters create \ --master-min-cpu-platform cpu-platform-name \ --worker-min-cpu-platform cpu-platform-name \ other args ...
REST API
To specify a minimum CPU platform for your cluster's master and/or worker (including
preemptible) instances, set the minCpuPlatform
field in
InstanceGroupConfig
for your master and/or worker instances in your
cluster.create
request.