Cloud Dataproc Persistent Solid State Drive (PD-SSD) Boot Disks

Beta

This is a beta release of Cloud Dataproc PD-SSD. This feature might be changed in backward-incompatible ways and is not subject to any SLA or deprecation policy. This feature is not intended for real-time usage in critical applications.

This feature allows you to select Persistent Disk Solid State Drives (PD-SSDs) as boot disks for your cluster's master and/or primary and/or secondary (preemptible) worker node(s).

Using PD-SSD

gcloud command

You can create a cluster and select PD-SSD as the boot disk for the cluster's master and/or primary and/or secondary (preemptible) worker node(s) using the gcloud beta dataproc clusters create command with the ‑‑master-boot-disk-type, and/or ‑‑worker-boot-disk-type, and/or and/or --preemptible-worker-boot-disk-type flag(s).

The default value for each flag is "pd-standard", which selects PD-Standard (Hard Disk Drive) as the boot disk. To select PD-SSD as the boot disk, pass a value of "pd-ssd" to the ‑‑master-boot-disk-type, and/or ‑‑worker-boot-disk-type, and/or --preemptible-worker-boot-disk-type flag(s). These flags can be used independently or in combination to select PD-SSD as the boot disk for master and/or primary and/or secondary worker node(s).

gcloud beta dataproc clusters create cluster-name \
  ‑‑master-boot-disk-type=pd-ssd \
  ‑‑worker-boot-disk-type=pd-ssd \
  --preemptible-worker-boot-disk-type=pd-ssd \
  other args ...

REST API

You can create a cluster and select PD-SSD as the boot disk for the cluster's master and/or primary and/or secondary (preemptible) worker node(s) by setting the bootDiskType field to "pd-ssd" in the masterConfig, and/or workerConfig, and/or secondaryWorkerConfig InstanceGroupConfig object(s) in your cluster.create API request. If not specified, the default bootDiskType is "pd-standard", which selects PD-Standard (Hard Disk Drive) as the boot disk. Each config can be set independently to select pd-ssd as the boot disk type for master and/or primary and/or secondary (preemptible) worker node(s).

Console

You can create a cluster and select PD-SSD as the boot disk for master and/or primary worker node(s) from the Cloud Dataproc Create a cluster page of the Google Cloud Platform Console.

Currently, you cannot set the PD-SSD disk type for secondary (preemptible) nodes from the GCP Console. You can use the gcloud command-line tool or the Cloud Dataproc API to set the PD-SSD disk type for secondary nodes.