Cloud Dataproc Image version list

Google Cloud Dataproc uses image versions to bundle operating system, big data components, and Google Cloud Platform connectors into one package that is deployed on a cluster. For more information, see Cloud Dataproc Versioning.

Supported Cloud Dataproc versions

Debian images

The following Debian9-based image versions are supported in Cloud Dataproc clusters. Note that new clusters will be created to include any sub-minor patches that have been made to a version since its release.

When creating a Debian-based cluster, you can omit the image version OS Distribution Code suffix, for example by specifying "1.3" to select the 1.3-debian9 image. The OS suffix must be used to select an Ubuntu-based image, for example by specifying "1.4-ubuntu18". See Selecting versions for image selection examples.

Version	Last Updated	Released On	Notes
1.4-debian9	2019/09/03	2019/03/22	General availability release.
1.3-debian9	2019/09/03	2018/06/29	This is the default version for new clusters beginning 2019/01/22.
1.2-debian9	2019/09/03	2017/7/21	This was the default version for new clusters beginning 2017/08/08 until 2019/01/22.
1.1-debian9	2019/09/03	2016/08/08	This version will be unsupported after September 30, 2019.

Ubuntu images

The following Ubuntu 18.04 LTS-based image versions are supported in Cloud Dataproc clusters. Note that new clusters will be created to include any sub-minor patches that have been made to a version since its release.

Version	Last Updated	Released On	Notes
1.4-ubuntu18	2019/09/03	2019/03/22
1.3-ubuntu18	2019/09/03	2019/03/22

Unsupported Cloud Dataproc versions

The following Cloud Dataproc versions are unsupported. Cloud Dataproc does not provide updates and support for clusters created with these versions. Although you can continue running a cluster that was created with an unsupported version, replacing the cluster with a new cluster that is created with a supported version is recommended.

Version	Includes	Released On	Last Updated	Notes
1.0-debian9	Apache Spark 1.6.2 Apache Hadoop 2.7.4 Apache Pig 0.15.0 Apache Hive 1.2.1 Cloud Storage connector 1.6.10-hadoop2 BigQuery connector 0.10.11-hadoop2	2016/02/22	2019/05/09	GA image first release. Unsupported as of 2019/04/01. 1.0.119-debian9 is the final released version.
0.2	Apache Spark 1.5.2 Apache Hadoop 2.7.1 Apache Pig 0.15.0 Apache Hive 1.2.1 Cloud Storage connector 1.5.1-hadoop2 BigQuery connector 0.7.7-hadoop2	2015/11/18	2016/08/02	Beta image second release.
0.1	Apache Spark 1.5.0 Apache Hadoop 2.7.1 Apache Pig 0.14.10 Apache Hive 1.0 Cloud Storage connector 1.5.1-hadoop2 BigQuery connector 0.7.7-hadoop2	2015/09/23	2016/08/02	Cloud Dataproc beta release. Spark 1.5 has been compiled against Hive 1.2.