You can install additional components when you create a Dataproc cluster using the Optional Components feature. This page describes the Zookeeper component.
The Apache Zookeeper component is centralized service for providing distributed synchronization of data.
Install the component
Install the component when you create a Dataproc cluster.
See Supported Dataproc versions for the component version included in each Dataproc image release.
To create a Dataproc cluster that includes the Zookeeper component,
gcloud dataproc clusters create cluster-name
command with the
--optional-components flag (using image version
1.0 or later).
gcloud dataproc clusters create cluster-name \ --optional-components=ZOOKEEPER \ --region=region \ ... other flags
REST APIThe Zookeeper component can be specified through the Dataproc API using SoftwareConfig.Component as part of a clusters.create request.
- Enable the component.
- In the Cloud Console, open the Dataproc Create a cluster page. Click "Advanced options" at the bottom of the page to view the Optional Components section.
- Click "Select component" to open the Optional components selection panel. Select "Zookeeper" and other optional components to install on your cluster.