A new version of GKE on AWS was released on October 2. See the release notes for more information.

Storage

You create persistent storage for workloads running on GKE on AWS with Kubernetes objects.

Using persistent storage in your GKE on AWS workloads

In GKE on AWS, you use the Kubernetes PersistentVolume (PV), PersistentVolumeClaim (PVC), and StorageClass resources to provide persistent file and block storage to workloads. From version 1.17+, snapshots of persistent storage can be created with the VolumeSnapshot and VolumeSnapshotClass resources. Snapshots are stored in your AWS account.

StorageClass

GKE on AWS clusters have a default Kubernetes StorageClass that dynamically provisions stateful storage for workloads on AWS Elastic Block Storage (EBS) volumes. You can also use a different StorageClass to provision other types of volumes. These options are described in the following section.

VolumeSnapshotClass

GKE on AWS clusters have a default Kubernetes VolumeSnapshotClass that creates snapshots of stateful storage on AWS Elastic Block Storage (EBS) volumes.

Configuring cluster storage

If you want to provision storage volumes with a non-default StorageClass, you can create a new StorageClass in a cluster that uses different parameters or a different storage driver. Then, you can set the StorageClass as the cluster's default, or configure your workloads to use the StorageClass. For example, you can use a StatefulSet to set a specific StorageClass name.

Using volume snapshots

In Kubernetes versions 1.17+, you can use the VolumeSnapshot resource to create snapshots of storage volumes. Then, you can provision new persistent volumes from these snapshots.

Elastic Block Storage (EBS)

GKE on AWS manages AWS EBS volumes with the aws-ebs-csi-driver.

The EBS CSI Driver version is tied to a GKE on AWS Kubernetes master version. This version is typically the latest driver available at the time that the GKE version is released. When the cluster is upgraded, the drivers update automatically.

The driver is pre-installed with GKE on AWS, and it is configured with two StorageClasses:

  • standard-rwo (default): Used for provisioning EBS gp2 volumes.
  • premium-rwo: Used for provisioning EBS io1 volumes.

EBS volumes support the Kubernetes ReadWriteOnce access mode.

Preexisting EBS volumes

You can provision existing EBS volumes in your GKE on AWS workloads. See Importing a preexisting EBS volume for examples on how to use EBS volumes in GKE on AWS.

Additional storage options

Other third-party storage systems can be used with GKE on AWS through third-party Container Storage Interface (CSI) drivers (recommended) or in-tree Kubernetes volume plugins.

CSI drivers

The Container Storage Interface (CSI) is an open standard API that enables Kubernetes to attach arbitrary storage systems to containerized workloads. A non-comprehensive list of CSI drivers can be found in the Kubernetes CSI Developer Documentation. GKE on AWS supports CSI v1.x.

To use a CSI driver in your cluster, you need to install the CSI driver provided by your storage vendor. You can then configure workloads to use the driver's StorageClass or set it as the default StorageClass.

Additional AWS-specific storage drivers

The following volume drivers can be used with GKE on AWS.

Elastic File System (EFS)

GKE on AWS doesn't manage EFS volumes directly. You can manually install the aws-efs-csi-driver, but support is not available from Google.

FSx for Lustre (FSX)

GKE on AWS doesn't manage FSx volumes directly. You can manually install the aws-fsx-csi-driver, but support is not available from Google.

Kubernetes in-tree volume plugins

Kubernetes ships with in-tree (built-in) volume plugins. Supported in-tree drivers include the following:

  • configMap
  • emptyDir
  • hostPath
  • nfs
  • projected
  • secrets

What's next?