This feature lets you select a minimum CPU platform for your Dataproc clusters. For example, when you create a cluster, you can select Intel Skylake CPUs for the cluster's master and/or worker instances to improve job performance.
Before using this feature, see Available regions & zones, which lists
the platforms available in each zone. You can also run the
gcloud compute zones describe zone command to list
the availableCpuPlatforms in your cluster's zone. For more information, see
Specifying a minimum CPU platform for VM instances.
Use minimum CPU platform
gcloud command
To specify a minimum CPU platform for your cluster's master and/or worker (including
preemptible) nodes, pass one or both of the following flags to the
gcloud dataproc clusters create
command:
gcloud dataproc clusters create \ --region=region \ --master-min-cpu-platform=cpu-platform-name \ --worker-min-cpu-platform=cpu-platform-name \ other args ...
REST API
To specify a minimum CPU platform for your cluster's master, primary worker,
and/or secondary (preemptible) worker nodes, set the minCpuPlatform field in
InstanceGroupConfig
for your master, primary worker, and/or secondary (preemptible) instances in your
cluster.create
request.
Console
You can specify a minimum CPU platform for your cluster's master and worker nodes using the CPU PLATFORM AND GPU→CPU platform sections of the Configure nodes panel on the Create a cluster page in the Google Cloud console.