Cloud Dataproc Image version list

Google Cloud Dataproc uses image versions to bundle operating system, big data components, and Google Cloud Platform connectors into one package that is deployed on a cluster. For more information, see Cloud Dataproc Versioning.

Supported Cloud Dataproc versions

Debian images

The following Debian9-based image versions are supported in Cloud Dataproc clusters. Note that new clusters will be created to include any sub-minor patches that have been made to a version since its release.

Version Last Updated Released On Notes
Preview 2019/11/15 2019/11/15 Preview.
1.4-debian9 2019/11/15 2019/03/22 General availability release.
1.3-debian9 2019/11/15 2018/06/29 This is the default version for new clusters beginning 2019/01/22.
1.2-debian9 2019/11/15 2017/7/21 This was the default version for new clusters beginning 2017/08/08 until 2019/01/22.

Ubuntu images

The following Ubuntu 18.04 LTS-based image versions are supported in Dataproc clusters. Note that new clusters will be created to include any sub-minor patches that have been made to a version since its release.

Version Last Updated Released On Notes
1.4-ubuntu18 2019/11/15 2019/03/22
1.3-ubuntu18 2019/11/15 2019/03/22

Unsupported Cloud Dataproc versions

The following Dataproc versions are unsupported. Dataproc does not provide updates and support for clusters created with these versions. Although you can continue running a cluster that was created with an unsupported version, replacing the cluster with a new cluster that is created with a supported version is recommended.

Version Includes Released On Last Updated Notes
1.1-debian9 Apache Spark 2.0.2
Apache Hadoop 2.7.7
Apache Pig 0.16.0
Apache Hive 2.1.1
Cloud Storage connector 1.6.10-hadoop2
BigQuery connector 0.10.11-hadoop2
2016/08/08 2019/09/26 GA image first release.
Unsupported as of 2019/10/01.
1.1.121-debian9 is the final released version.
1.0-debian9 Apache Spark 1.6.2
Apache Hadoop 2.7.4
Apache Pig 0.15.0
Apache Hive 1.2.1
Cloud Storage connector 1.6.10-hadoop2
BigQuery connector 0.10.11-hadoop2
2016/02/22 2019/05/09 GA image first release.
Unsupported as of 2019/04/01.
1.0.119-debian9 is the final released version.
0.2 Apache Spark 1.5.2
Apache Hadoop 2.7.1
Apache Pig 0.15.0
Apache Hive 1.2.1
Cloud Storage connector 1.5.1-hadoop2
BigQuery connector 0.7.7-hadoop2
2015/11/18 2016/08/02 Beta image second release.
0.1 Apache Spark 1.5.0
Apache Hadoop 2.7.1
Apache Pig 0.14.10
Apache Hive 1.0
Cloud Storage connector 1.5.1-hadoop2
BigQuery connector 0.7.7-hadoop2
2015/09/23 2016/08/02 Cloud Dataproc beta release.
Spark 1.5 has been compiled against Hive 1.2.
Var denne side nyttig? Giv os en anmeldelse af den:

Send feedback om...

Cloud Dataproc Documentation
Har du brug for hjælp? Besøg vores supportside.