Cloud Dataproc Persistent Solid State Drive (PD-SSD) Boot Disks

This feature allows you to select Persistent Disk Solid State Drives (PD-SSDs) as boot disks for your cluster's master and/or primary and/or secondary (preemptible) worker node(s).

Using PD-SSD

gcloud command

You can create a cluster and select PD-SSD as the boot disk for the cluster's master and/or primary and/or secondary (preemptible) worker node(s) using the gcloud dataproc clusters create command with the --master-boot-disk-type, and/or --worker-boot-disk-type, and/or and/or --preemptible-worker-boot-disk-type flag(s).

The default value for each flag is "pd-standard", which selects PD-Standard (Hard Disk Drive) as the boot disk. To select PD-SSD as the boot disk, pass a value of "pd-ssd" to the --master-boot-disk-type, and/or --worker-boot-disk-type, and/or --preemptible-worker-boot-disk-type flag(s). These flags can be used independently or in combination to select PD-SSD as the boot disk for master and/or primary and/or secondary worker node(s).

gcloud dataproc clusters create cluster-name \
    --master-boot-disk-type=pd-ssd \
    --worker-boot-disk-type=pd-ssd \
    --preemptible-worker-boot-disk-type=pd-ssd \
    other args ...

REST API

You can create a cluster and select PD-SSD as the boot disk for the cluster's master and/or primary and/or secondary (preemptible) worker node(s) by setting the bootDiskType field to "pd-ssd" in the masterConfig, and/or workerConfig, and/or secondaryWorkerConfig InstanceGroupConfig object(s) in your cluster.create API request. If not specified, the default bootDiskType is "pd-standard", which selects PD-Standard (Hard Disk Drive) as the boot disk. Each config can be set independently to select pd-ssd as the boot disk type for master and/or primary and/or secondary (preemptible) worker node(s).

Console

You can create a cluster and select PD-SSD as the boot disk for master and/or primary worker node(s) from the Cloud Dataproc Create a cluster page of the Google Cloud Platform Console.

Currently, you cannot set the PD-SSD disk type for secondary (preemptible) nodes from the GCP Console. You can use the gcloud command-line tool or the Cloud Dataproc API to set the PD-SSD disk type for secondary nodes.