Known 2.2 image version issues and limitations:
Legacy agents are not installed in 2.2 image version clusters. monitoring-agent-defaults are not available unless the Ops Agent is installed. Note: OSS metrics and logging are available for Dataproc components.
Logging or monitoring for third-party applications are not available unless the Ops Agent is installed.
Notes:
2.2.x-*-arm
images support only the pre-installed components and the following optional components. The other 2.2 optional components and all initialization actions aren't supported:- Apache Hive WebHCat
- Docker
- Zeppelin
- Zookeeper (installed in high availability clusters; optional component in other clusters)
The source code to image 2.2 libraries that are licensed under Reciprocal and Restricted licenses is available at the
/usr/local/share/google/dataproc/third-party-sources
path on Dataproc cluster VMs.The following Hudi procedures are known to not work on a Hudi table backed by the Cloud Storage file system:
run_clustering
run_compaction