Minimum CPU platform

Beta

This is a beta release of Cloud Dataproc Minimum CPU Platform. This feature might be changed in backward-incompatible ways and is not subject to any SLA or deprecation policy. This feature is not intended for real-time usage in critical applications.

This feature allows you to select a minimum CPU platform for your Cloud Dataproc clusters. For example, when you create a cluster, you can select Intel Skylake CPUs for the cluster's master and/or worker instances to improve job performance.

Before using this feature, see Available regions & zones, which lists the platforms available in each zone. You can also run the gcloud compute zones describe zone command to list the availableCpuPlatforms in your cluster's zone (see Specifying a Minimum CPU Platform for VM Instances for more information).

Using Minimum CPU Platform

gcloud command

To specify a minimum CPU platform for your cluster's master and/or worker (including preemptible) instances, pass one or both of the following flags to the gcloud beta dataproc clusters create command:

gcloud beta dataproc clusters create \
    --master-min-cpu-platform cpu-platform-name \
    --worker-min-cpu-platform cpu-platform-name \
    other args ...

REST API

To specify a minimum CPU platform for your cluster's master and/or worker (including preemptible) instances, set the minCpuPlatform field in InstanceGroupConfig for your master and/or worker instances in your cluster.create request.

Console

Currently, Google Cloud Platform Console does not support the Cloud Dataproc Minimum CPU Platform feature.