You can install additional components when you create a Cloud Dataproc cluster using the Optional Components feature. This page describes the Druid component.
The Apache Druid component is an open source distributed OLAP data store. The Druid component installs Druid services on the Cloud Dataproc cluster master (Coordinator, Broker, and Overlord) and worker (Historical, Realtime and MiddleManager) nodes.
Install the component
Install the component when you create a Cloud Dataproc cluster. Components can be added to clusters created with Cloud Dataproc version 1.3 and later. The Druid component requires the installation of the Zookeeper component (as shown in the gcloud command-line tool example, below).
See Supported Cloud Dataproc versions for the component version included in each Cloud Dataproc image release.
To create a Cloud Dataproc cluster that includes the Druid component,
gcloud dataproc beta clusters create cluster-name
command with the
--optional-components flag (using image version
1.3 or later).
gcloud beta dataproc clusters create cluster-name \ --optional-components=DRUID,ZOOKEEPER \ --image-version=1.3 \ ... other flags
REST APIThe Druid component can be specified through the Cloud Dataproc API using SoftwareConfig.Component as part of a clusters.create request.
- Enable the component.
- In the GCP Console, open the Cloud Dataproc Create a cluster page. Click "Advanced options" at the bottom of the page to view the Optional Components section.
- Click "Select component" to open the Optional components selection panel. Select "Druid" and other optional components to install on your cluster.