Cloud Dataproc Auto Zone placement

When you create a Cloud Dataproc cluster, you can use a single "global" endpoint or regional endpoints based on Compute Engine zones. If you choose a region, you can select a zone within that region, or you can omit the zone to have the Cloud Dataproc Auto Zone feature select a zone for you in the region you choose. The Auto Zone feature is not available when you choose the global endpoint.

Using Auto Zone placement

gcloud command

To create a Cloud Dataproc cluster that uses Auto Zone placement, use the gcloud dataproc clusters create command. Set the --region flag to a non-global region, and omit the --zone flag (or leave the flag empty: --zone= or zone="").

gcloud dataproc clusters create \
    --region=region \
    --zone="" \
    other args ...

REST API

To create a Cloud Dataproc cluster that uses Auto Zone placement, construct a JSON clusters.create API request, leaving the gceClusterConfig.zoneUri field empty. In the REST endpoint, https://dataproc.googleapis.com/v1/projects/projectId/regions/region/clusters, insert a non-global region. Cloud Dataproc Auto Zone will choose a zone for the cluster within the specified region.

Use short resource names with Auto Zone placement: When specifying a resource URI, such as machineTypeUri or acceleratorTypeUri, in an Auto Zone placement REST API cluster creation request, use a short resource name without a zone specification, for example, "n1-standard-2" or "nvidia-tesla-k80".

Console

To create a Cloud Dataproc cluster that uses Auto Zone placement, choose a non-global Region and select "No preference" from the Zone selector on the Cloud Dataproc Create a cluster page.

Was this page helpful? Let us know how we did:

Send feedback about...

Cloud Dataproc Documentation