This feature allows you to select a minimum CPU platform for your Cloud Dataproc clusters. For example, when you create a cluster, you can select Intel Skylake CPUs for the cluster's master and/or worker instances to improve job performance.
Before using this feature, see Available regions & zones, which lists
the platforms available in each zone. You can also run the
gcloud compute zones describe zone command to list
the availableCpuPlatforms in your cluster's zone (see
Specifying a Minimum CPU Platform for VM Instances for
more information).
Using Minimum CPU Platform
gcloud command
To specify a minimum CPU platform for your cluster's master and/or worker (including preemptible) nodes, pass one or both of the following flags to the gcloud dataproc clusters create command:
gcloud dataproc clusters create \ --region=region \ --master-min-cpu-platform=cpu-platform-name \ --worker-min-cpu-platform=cpu-platform-name \ other args ...
REST API
To specify a minimum CPU platform for your cluster's master, primary worker,
and/or secondary (preemptible) worker nodes, set the minCpuPlatform field in
InstanceGroupConfig
for your master, primary worker, and/or secondary (preemptible) instances in your
cluster.create
request.
Console
You can specify a minimum CPU platform for your cluster's master and worker nodes using the CPU PLATFORM AND GPU→CPU platform sections of the Configure nodes panel on the Create a cluster page in the Google Cloud console.