Integrations with Cloud Bigtable

This page describes integrations between Cloud Bigtable and other products and services.

Google Cloud Platform services

This section describes the Google Cloud Platform services that Cloud Bigtable integrates with.

Cloud Dataflow

Google Cloud Dataflow is a cloud service and programming model for big data processing. Cloud Dataflow supports both batch and streaming processing using Java. Python is not yet supported. You can use Cloud Dataflow to process data that is stored in Cloud Bigtable or to store the output of your Cloud Dataflow pipeline.

To get started, see "Dataflow Connector for Cloud Bigtable."

Cloud Dataproc

Google Cloud Dataproc provides Apache Hadoop and related products as a managed service in the cloud. With Cloud Dataproc, you can run Hadoop jobs that read from and write to Cloud Bigtable.

For an example of a Hadoop map/reduce job that uses Cloud Bigtable, see the /java/dataproc-wordcount directory in the GitHub repository GoogleCloudPlatform/cloud-bigtable-examples.

Big Data

This section describes Big Data products that Cloud Bigtable integrates with.

Apache Hadoop

Apache Hadoop is a framework that allows for the distributed processing of large data sets across clusters of computers. You can use Cloud Dataproc to create a Hadoop cluster, then run map/reduce jobs that read from and write to Cloud Bigtable.

For an example of a Hadoop map/reduce job that uses Cloud Bigtable, see the /java/dataproc-wordcount directory in the GitHub repository GoogleCloudPlatform/cloud-bigtable-examples.

Time-series databases and monitoring

This section describes time-series databases and monitoring tools that Cloud Bigtable integrates with.

Heroic

Heroic is a monitoring system and time-series database. Heroic can use Cloud Bigtable to store its data.

For more information about Heroic, see the GitHub repository spotify/heroic.

This integration was developed independently by a third party. Google is not affiliated with, and does not endorse, this integration.

OpenTSDB

OpenTSDB is a time-series database. With the AsyncBigtable library, OpenTSDB can use Cloud Bigtable to store its data.

For more information about running OpenTSDB with Cloud Bigtable support, see Pythian's blog post and the OpenTSDB documentation.

This integration was developed independently by a third party. Google is not affiliated with, and does not endorse, this integration.

Send feedback about...

Cloud Bigtable Documentation