Index (Google Cloud Dataflow + Cloud Bigtable Connector 0.3.0 API)

A B C D E F G H I L P R S T W Z 

A

AbstractCloudBigtableTableDoFn<In,Out> - Class in com.google.cloud.bigtable.dataflow
This class can be used as a superclass for DoFns that require a Connection in Dataflow.
AbstractCloudBigtableTableDoFn(CloudBigtableConfiguration) - Constructor for class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 
additionalConfiguration - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
 
apply(PCollection<T>) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableWriteTransform
 

B

build() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
build() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
build() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
Builder() - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
 
Builder(Map<String, String>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
 
Builder() - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
 
Builder(CloudBigtableTableConfiguration) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
 
Builder(Map<String, String>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
 
Builder() - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
 
Builder(Map<String, String>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
 

C

CloudBigtableConfiguration - Class in com.google.cloud.bigtable.dataflow
This class defines configuration that a Cloud Bigtable client needs to connect to a Cloud Bigtable cluster.
CloudBigtableConfiguration(String, String, String, Map<String, String>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Creates a CloudBigtableConfiguration using the specified project ID, zone, and cluster ID.
CloudBigtableConfiguration.Builder - Class in com.google.cloud.bigtable.dataflow
CloudBigtableConnectionPool - Class in com.google.cloud.bigtable.dataflow
Pubsub and other windowed sources can have a large quantity of bundles in short amounts of time.
CloudBigtableConnectionPool() - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableConnectionPool
 
CloudBigtableIO - Class in com.google.cloud.bigtable.dataflow
Utilities to create PTransforms for reading and writing Google Cloud Bigtable entities in a Cloud Dataflow pipeline.
CloudBigtableIO() - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableIO
 
CloudBigtableIO.CloudBigtableMultiTableWriteFn - Class in com.google.cloud.bigtable.dataflow
A DoFn that can write either a bounded or unbounded PCollection of KV of (String tableName, List of Mutations) to the specified table.
CloudBigtableIO.CloudBigtableSingleTableBufferedWriteFn - Class in com.google.cloud.bigtable.dataflow
A DoFn that can write either a bounded or unbounded PCollection of Mutations to a table specified via a CloudBigtableTableConfiguration using the BufferedMutator.
CloudBigtableIO.CloudBigtableSingleTableSerialWriteFn - Class in com.google.cloud.bigtable.dataflow
A DoFn that can write either a bounded or unbounded PCollection of Mutations to a table specified via a CloudBigtableTableConfiguration doing a a single mutation per processElement call.
CloudBigtableIO.CloudBigtableWriteTransform<T> - Class in com.google.cloud.bigtable.dataflow
A PTransform that wraps around a DoFn that will write Mutations to Cloud Bigtable.
CloudBigtableIO.Source<ResultOutputType> - Class in com.google.cloud.bigtable.dataflow
A BoundedSource for a Cloud Bigtable Table, which is potentially filtered by a Scan.
CloudBigtableIO.SourceWithKeys<ResultOutputType> - Class in com.google.cloud.bigtable.dataflow
A BoundedSource for a Cloud Bigtable Table with a start/stop key range, along with a potential filter via a Scan.
CloudBigtableMultiTableWriteFn(CloudBigtableConfiguration) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableMultiTableWriteFn
 
CloudBigtableOptions - Interface in com.google.cloud.bigtable.dataflow
CloudBigtableOptions is an extension of DataflowPipelineOptions containing the options to configure a Dataflow pipeline that uses Cloud Bigtable.
CloudBigtableScanConfiguration - Class in com.google.cloud.bigtable.dataflow
This class defines configuration that a Cloud Bigtable client needs to connect to a user's Cloud Bigtable cluster; a table to connect to in the cluster; and a filter on the table in the form of a Scan.
CloudBigtableScanConfiguration(String, String, String, String, Scan) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
Creates a CloudBigtableScanConfiguration using the specified project ID, zone, cluster ID, table ID and Scan.
CloudBigtableScanConfiguration(String, String, String, String, Scan, Map<String, String>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
Creates a CloudBigtableScanConfiguration using the specified project ID, zone, cluster ID, table ID, Scan and additional connection configuration.
CloudBigtableScanConfiguration.Builder - Class in com.google.cloud.bigtable.dataflow
CloudBigtableSingleTableBufferedWriteFn(CloudBigtableTableConfiguration) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableBufferedWriteFn
 
CloudBigtableSingleTableSerialWriteFn(CloudBigtableTableConfiguration) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableSerialWriteFn
 
CloudBigtableTableConfiguration - Class in com.google.cloud.bigtable.dataflow
This class defines configuration that a Cloud Bigtable client needs to connect to a user's Cloud Bigtable cluster, including a table to connect to in the cluster.
CloudBigtableTableConfiguration(String, String, String, String, Map<String, String>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration
Creates a CloudBigtableTableConfiguration using the specified configuration.
CloudBigtableTableConfiguration.Builder - Class in com.google.cloud.bigtable.dataflow
CloudBigtableWriteTransform(DoFn<T, Void>) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableWriteTransform
 
clusterId - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
 
com.google.cloud.bigtable.dataflow - package com.google.cloud.bigtable.dataflow
Enables you to use Google Cloud Dataflow to read from and write to Cloud Bigtable tables.
config - Variable in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 
connection - Variable in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 
createConnection(Configuration) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConnectionPool
 
createExceptionListener(DoFn<Mutation, Void>.Context) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableBufferedWriteFn
 

D

decode(InputStream, Coder.Context) - Method in class com.google.cloud.bigtable.dataflow.HBaseMutationCoder
 
decode(InputStream, Coder.Context) - Method in class com.google.cloud.bigtable.dataflow.HBaseResultArrayCoder
 
decode(InputStream, Coder.Context) - Method in class com.google.cloud.bigtable.dataflow.HBaseResultCoder
 
DO_SERIAL_WRITES - Static variable in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableSerialWriteFn
 
DOFN_LOG - Variable in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 

E

encode(Mutation, OutputStream, Coder.Context) - Method in class com.google.cloud.bigtable.dataflow.HBaseMutationCoder
 
encode(Result[], OutputStream, Coder.Context) - Method in class com.google.cloud.bigtable.dataflow.HBaseResultArrayCoder
 
encode(Result, OutputStream, Coder.Context) - Method in class com.google.cloud.bigtable.dataflow.HBaseResultCoder
 
equals(Object) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Compares this configuration with the specified object.
equals(Object) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
 
equals(Object) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration
 

F

finishBundle(DoFn<Mutation, Void>.Context) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableBufferedWriteFn
Closes the BufferedMutator and Connection.
finishBundle(DoFn<Mutation, Void>.Context) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableSerialWriteFn
Closes the Table and Connection.
fromCBTOptions(CloudBigtableOptions) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
Converts a CloudBigtableOptions object to a CloudBigtableScanConfiguration object with a default full table Scan.
fromCBTOptions(CloudBigtableOptions, Scan) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
Converts a CloudBigtableOptions object to a CloudBigtableScanConfiguration that will perform the specified Scan on the table.
fromCBTOptions(CloudBigtableOptions) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration

G

getBigtableClusterId() - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
getBigtableProjectId() - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
getBigtableTableId() - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
getBigtableZoneId() - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
getClusterId() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Gets the cluster ID for the Cloud Bigtable cluster.
getCoder(CloudBigtableIO.CoderType) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO
 
getConfiguration() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Gets an immutable copy of the configuration map.
getConnection() - Method in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 
getConnection(Configuration) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConnectionPool
Gets a shared connection where the cluster name from the config is the key.
getConnection(Configuration, String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConnectionPool
 
getEstimatedSize() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
 
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.Source
Gets an estimated size based on data returned from CloudBigtableIO.AbstractSource.getSampleRowKeys().
getEstimatedSizeBytes(PipelineOptions) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
Gets an estimate of the size of the source.
getInstance() - Static method in class com.google.cloud.bigtable.dataflow.HBaseResultArrayCoder
 
getInstance() - Static method in class com.google.cloud.bigtable.dataflow.HBaseResultCoder
 
getProjectId() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Gets the project ID for the Cloud Bigtable cluster.
getScan() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
Gets the Scan used to filter the table.
getStartRow() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
 
getStopRow() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
 
getTableId() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration
Gets the table specified by the configuration.
getZoneId() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Gets the zone where the Cloud Bigtable cluster is located.

H

HBaseMutationCoder - Class in com.google.cloud.bigtable.dataflow
When Dataflow notices a slowdown in executing Puts and Deletes, it will send those Puts and Deletes to be processed on another Dataflow machine.
HBaseMutationCoder() - Constructor for class com.google.cloud.bigtable.dataflow.HBaseMutationCoder
 
HBaseResultArrayCoder - Class in com.google.cloud.bigtable.dataflow
A Coder that serializes and deserializes the Result array using ProtobufUtil.
HBaseResultArrayCoder() - Constructor for class com.google.cloud.bigtable.dataflow.HBaseResultArrayCoder
 
HBaseResultCoder - Class in com.google.cloud.bigtable.dataflow
A Coder that serializes and deserializes the Result objects using ProtobufUtil.
HBaseResultCoder() - Constructor for class com.google.cloud.bigtable.dataflow.HBaseResultCoder
 

I

initializeForWrite(Pipeline) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO
Initializes the coders for the Cloud Bigtable Write PTransform.

L

LOG - Static variable in class com.google.cloud.bigtable.dataflow.CloudBigtableConnectionPool
 
logExceptions(DoFn<In, Out>.Context, RetriesExhaustedWithDetailsException) - Method in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
logRetriesExhaustedWithDetailsException(Logger, String, RetriesExhaustedWithDetailsException) - Static method in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 

P

processElement(DoFn<KV<String, Iterable<Mutation>>, Void>.ProcessContext) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableMultiTableWriteFn
Uses the connection to create a new Table to write the Mutations to.
processElement(DoFn<Mutation, Void>.ProcessContext) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableBufferedWriteFn
Performs an asynchronous mutation via BufferedMutator.mutate(Mutation).
processElement(DoFn<Mutation, Void>.ProcessContext) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.CloudBigtableSingleTableSerialWriteFn
Performs an asynchronous mutation via BufferedMutator.mutate(Mutation).
projectId - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
 

R

read(CloudBigtableScanConfiguration) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO
Creates a BoundedSource for a Cloud Bigtable Table, which is potentially filtered by a Scan.
readBulk(CloudBigtableScanConfiguration, int) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO
Creates a BoundedSource for a Cloud Bigtable Table for multiple Results, which is potentially filtered by a Scan.
rethrowException(RetriesExhaustedWithDetailsException) - Static method in class com.google.cloud.bigtable.dataflow.AbstractCloudBigtableTableDoFn
 

S

scan - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
 
setBigtableClusterId(String) - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
setBigtableProjectId(String) - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
setBigtableTableId(String) - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
setBigtableZoneId(String) - Method in interface com.google.cloud.bigtable.dataflow.CloudBigtableOptions
 
SourceWithKeys(CloudBigtableScanConfiguration, CloudBigtableIO.CoderType, CloudBigtableIO.ScanIterator<ResultOutputType>, long) - Constructor for class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
 
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.Source
Splits the table based on keys that belong to tablets, known as "regions" in the HBase API.
splitIntoBundles(long, PipelineOptions) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
Splits the bundle based on the assumption that the data is distributed evenly between startKey and stopKey.

T

tableId - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
 
tableId - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration
 
toBigtableOptions() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Converts the CloudBigtableConfiguration to a BigtableOptions object.
toBuilder() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Creates a new CloudBigtableConfiguration.Builder object containing the existing configuration.
toBuilder() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration
 
toBuilder() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration
 
toHBaseConfig() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration
Converts the CloudBigtableConfiguration to an HBase Configuration.
toString() - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO.SourceWithKeys
 

W

withClusterId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
Specifies the cluster ID for the Cloud Bigtable cluster.
withClusterId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
Specifies the cluster ID for the Cloud Bigtable cluster.
withClusterId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
Specifies the cluster ID for the Cloud Bigtable cluster.
withConfiguration(String, String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
Adds additional connection configuration.
withConfiguration(String, String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
Adds additional connection configuration.
withConfiguration(String, String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
Adds additional connection configuration.
withProjectId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
Specifies the project ID for the Cloud Bigtable cluster.
withProjectId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
Specifies the project ID for the Cloud Bigtable cluster.
withProjectId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
Specifies the project ID for the Cloud Bigtable cluster.
withScan(Scan) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
Specifies the Scan that will be used to filter the table.
withTableId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
Specifies the table to connect to.
withTableId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
Specifies the table to connect to.
withZoneId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
Specifies the zone where the Cloud Bigtable cluster is located.
withZoneId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableScanConfiguration.Builder
Specifies the zone where the Cloud Bigtable cluster is located.
withZoneId(String) - Method in class com.google.cloud.bigtable.dataflow.CloudBigtableTableConfiguration.Builder
Specifies the zone where the Cloud Bigtable cluster is located.
writeToMultipleTables(CloudBigtableConfiguration) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO
Creates a PTransform that can write either a bounded or unbounded PCollection of KV of (String tableName, List of Mutations) to the specified table.
writeToTable(CloudBigtableTableConfiguration) - Static method in class com.google.cloud.bigtable.dataflow.CloudBigtableIO
Creates a PTransform that can write either a bounded or unbounded PCollection of Mutations to a table specified via a CloudBigtableTableConfiguration.

Z

zoneId - Variable in class com.google.cloud.bigtable.dataflow.CloudBigtableConfiguration.Builder
 
A B C D E F G H I L P R S T W Z