Index (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1

Warning: Dataflow SDK 1.x for Java is unsupported as of October 16, 2018. After August 12, 2020, you can use unsupported SDKs temporarily while you upgrade your pipelines. For more information, see Using an unsupported SDK.

For information on migrating from the 1.x SDK, see Migrating from Dataflow SDK 1.x for Java.

Note: If you are using Cloud Dataflow SDK version 2.x, see the Apache Beam API reference documentation.

A B C D E F G H I J K L M N O P R S T U V W X Y 

A

AccumulatingCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn

 

accumulatingFiredPanes() - Static method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window

Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that accumulates elements in a pane after they are triggered.

accumulatingFiredPanes() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound

Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that accumulates elements in a pane after they are triggered.

accumulatingFiredPanes() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Unbound

Returns a new Window PTransform that uses the registered WindowFn and Triggering behavior, and that accumulates elements in a pane after they are triggered.

add(Iterable<WindowedValue<ElemT>>) - Method in interface com.google.cloud.dataflow.sdk.runners.inprocess.InProcessPipelineRunner.PCollectionViewWriter

 

add(WindowedValue<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.inprocess.InProcessPipelineRunner.UncommittedBundle

Outputs an element to this bundle.

add(Long) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique

Adds a value to the heap, returning whether the value is (large enough to be) in the heap.

add(DisplayData.Item<?>) - Method in interface com.google.cloud.dataflow.sdk.transforms.display.DisplayData.Builder

Register the given display item.

addCollectionToSingletonOutput(String, PValue, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an output with the given name to the previously added CollectionToSingleton Dataflow step, consuming the specified input PValue and producing the specified output PValue.

addComposite(TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode

Adds a composite operation to the transform node.

addElements(T, T...) - Method in class com.google.cloud.dataflow.sdk.testing.TestStream.Builder

Adds the specified elements to the source with timestamp equal to the current watermark.

addElements(TimestampedValue<T>, TimestampedValue<T>...) - Method in class com.google.cloud.dataflow.sdk.testing.TestStream.Builder

Adds the specified elements to the source with the provided timestamps.

addEncodingInput(Coder<?>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Sets the encoding for the current Dataflow step.

addExtensionsFrom(Class<?>...) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder

Deprecated.

use Proto2Coder.withExtensionsFrom(java.lang.Iterable<java.lang.Class<?>>)

addExtensionsFrom(Iterable<Class<?>>) - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder

Deprecated.

use Proto2Coder.withExtensionsFrom(java.lang.Iterable<java.lang.Class<?>>)

addIfNotDefault(DisplayData.Item<T>, T) - Method in interface com.google.cloud.dataflow.sdk.transforms.display.DisplayData.Builder

Register the given display item if the value is different than the specified default.

addIfNotNull(DisplayData.Item<?>) - Method in interface com.google.cloud.dataflow.sdk.transforms.display.DisplayData.Builder

Register the given display item if the value is not null.

addInput(String, Boolean) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an input with the given name and value to the current Dataflow step.

addInput(String, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an input with the given name and value to the current Dataflow step.

addInput(String, Long) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an input with the given name and value to the current Dataflow step.

addInput(String, PInput) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an input with the given name to the previously added Dataflow step, coming from the specified input PValue.

addInput(String, Map<String, Object>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an input that is a dictionary of strings to objects.

addInput(String, List<? extends Map<String, Object>>) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an input that is a list of objects.

addInput(TransformTreeNode, PInput) - Method in class com.google.cloud.dataflow.sdk.runners.TransformHierarchy

Adds an input to the given node.

addInput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique, T) - Method in class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn

 

addInput(InputT) - Method in interface com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator

Adds the given input value to this accumulator, modifying this accumulator.

addInput(AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.AccumulatingCombineFn

 

addInput(double[], Double) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn

 

addInput(Combine.Holder<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn

 

addInput(int[], Integer) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn

 

addInput(long[], Long) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn

 

addInput(AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn

Adds the given input value to the given accumulator, returning the new accumulator value.

addInput(List<V>, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.IterableCombineFn

 

addInput(K, AccumT, InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn

Adds the given input value to the given accumulator, returning the new accumulator value.

addInput(Object[], DataT) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineFns.ComposedCombineFn

 

addInput(Object[], DataT, CombineWithContext.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineFns.ComposedCombineFnWithContext

 

addInput(K, Object[], DataT) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineFns.ComposedKeyedCombineFn

 

addInput(K, Object[], DataT, CombineWithContext.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineFns.ComposedKeyedCombineFnWithContext

 

addInput(AccumT, InputT, CombineWithContext.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineWithContext.CombineFnWithContext

Adds the given input value to the given accumulator, returning the new accumulator value.

addInput(K, AccumT, InputT, CombineWithContext.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext

Adds the given input value to the given accumulator, returning the new accumulator value.

addInput(Top.BoundedHeap<KV<Integer, T>, SerializableComparator<KV<Integer, T>>>, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.FixedSizedSampleFn

 

addInputProducer(PValue, TransformTreeNode) - Method in class com.google.cloud.dataflow.sdk.runners.TransformTreeNode

Adds an input to the transform node.

addInputsRandomly(PerKeyCombineFnRunner<? super K, ? super InputT, AccumT, ?>, K, Iterable<InputT>, Random, DoFn<?, ?>.ProcessContext) - Static method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner.TestCombineDoFn

Create a random list of accumulators from the given list of values.

addOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.

addOutput(InProcessPipelineRunner.UncommittedBundle<?>, InProcessPipelineRunner.UncommittedBundle<?>...) - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.StepTransformResult.Builder

 

addOutput(Collection<InProcessPipelineRunner.UncommittedBundle<?>>) - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.StepTransformResult.Builder

 

addOverrideForClass(Class<?>, DataflowWorkerLoggingOptions.Level) - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides

Overrides the default log level for the passed in class.

addOverrideForName(String, DataflowWorkerLoggingOptions.Level) - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides

Overrides the default log level for the passed in name.

addOverrideForPackage(Package, DataflowWorkerLoggingOptions.Level) - Method in class com.google.cloud.dataflow.sdk.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides

Overrides the default log level for the passed in package.

addStep(PTransform<?, ?>, String) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step type.

addStep(PTransform<?, ? extends PValue>, Step) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds a pre-defined step to the Dataflow workflow.

addTraceFor(AbstractGoogleClient, String) - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer

Creates a GoogleApiDebugOptions.GoogleApiTracer that sets the trace destination on all calls that match the given client type.

addTraceFor(AbstractGoogleClientRequest<?>, String) - Method in class com.google.cloud.dataflow.sdk.options.GoogleApiDebugOptions.GoogleApiTracer

Creates a GoogleApiDebugOptions.GoogleApiTracer that sets the trace traceDestination on all calls that match for the given request type.

addUnprocessedElements(Iterable<? extends WindowedValue<?>>) - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.StepTransformResult.Builder

 

addValue(InputT) - Method in interface com.google.cloud.dataflow.sdk.transforms.Aggregator

Adds a new value into the Aggregator.

addValueInternal(PValue) - Method in class com.google.cloud.dataflow.sdk.Pipeline

Adds the given PValue to this Pipeline.

addValueOnlyOutput(String, PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Adds an output with the given name to the previously added Dataflow step, producing the specified output PValue, including its Coder if a TypedPValue.

advance() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader

Deprecated.

 

advance() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader

 

advance() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader

Advances the reader to the next valid record.

advance() - Method in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader

Advances the reader to the next valid record.

advanceImpl() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader

 

advanceImpl() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource.OffsetBasedReader

Advances to the next record and returns true, or returns false if there is no next record.

advanceProcessingTime(Duration) - Method in class com.google.cloud.dataflow.sdk.testing.TestStream.Builder

Advance the processing time by the specified amount.

advanceWatermarkTo(Instant) - Method in class com.google.cloud.dataflow.sdk.testing.TestStream.Builder

Advance the watermark of this source to the specified instant.

advanceWatermarkToInfinity() - Method in class com.google.cloud.dataflow.sdk.testing.TestStream.Builder

Advance the watermark to infinity, completing this TestStream.

AfterAll<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

Create a Trigger that fires and finishes once after all of its sub-triggers have fired.

AfterDelayFromFirstElement<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A base class for triggers that happen after a processing time delay from the arrival of the first element in a pane.

AfterDelayFromFirstElement(TimeDomain, List<SerializableFunction<Instant, Instant>>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.AfterDelayFromFirstElement

 

AfterEach<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A composite Trigger that executes its sub-triggers in order.

afterElement(WindowedValue<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.inprocess.ModelEnforcement

Called after a call to TransformEvaluator.processElement(WindowedValue) on the provided WindowedValue.

afterFinish(InProcessPipelineRunner.CommittedBundle<T>, InProcessTransformResult, Iterable<? extends InProcessPipelineRunner.CommittedBundle<?>>) - Method in interface com.google.cloud.dataflow.sdk.runners.inprocess.ModelEnforcement

Called after a bundle has been completed and TransformEvaluator.finishBundle() has been called, producing the provided InProcessTransformResult and output bundles.

AfterFirst<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

Create a composite Trigger that fires once after at least one of its sub-triggers have fired.

AfterPane<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

Triggers that fire based on properties of the elements in the current pane.

AfterProcessingTime<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

AfterProcessingTime triggers fire based on the current processing time.

AfterWatermark<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

AfterWatermark triggers fire based on progress of the system watermark.

AfterWatermark.AfterWatermarkEarly<W extends BoundedWindow> - Interface in com.google.cloud.dataflow.sdk.transforms.windowing

Interface for building an AfterWatermarkTrigger with early firings already filled in.

AfterWatermark.AfterWatermarkLate<W extends BoundedWindow> - Interface in com.google.cloud.dataflow.sdk.transforms.windowing

Interface for building an AfterWatermarkTrigger with late firings already filled in.

AfterWatermark.FromEndOfWindow<W extends BoundedWindow> - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A watermark trigger targeted relative to the end of the window.

Aggregator<InputT,OutputT> - Interface in com.google.cloud.dataflow.sdk.transforms

An Aggregator<InputT> enables monitoring of values of type InputT, to be combined across all bundles.

AggregatorPipelineExtractor - Class in com.google.cloud.dataflow.sdk.runners

Retrieves Aggregators at each ParDo and returns a Map of Aggregator to the PTransforms in which it is present.

AggregatorPipelineExtractor(Pipeline) - Constructor for class com.google.cloud.dataflow.sdk.runners.AggregatorPipelineExtractor

Creates an AggregatorPipelineExtractor for the given Pipeline.

AggregatorRetrievalException - Exception in com.google.cloud.dataflow.sdk.runners

Signals that an exception has occurred while retrieving Aggregators.

AggregatorRetrievalException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.runners.AggregatorRetrievalException

Constructs a new AggregatorRetrievalException with the specified detail message and cause.

AggregatorRetriever - Class in com.google.cloud.dataflow.sdk.transforms

An internal class for extracting Aggregators from DoFns.

AggregatorValues<T> - Class in com.google.cloud.dataflow.sdk.runners

A collection of values associated with an Aggregator.

AggregatorValues() - Constructor for class com.google.cloud.dataflow.sdk.runners.AggregatorValues

 

alignedTo(Duration, Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterDelayFromFirstElement

Aligns timestamps to the smallest multiple of size since the offset greater than the timestamp.

alignedTo(Duration) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterDelayFromFirstElement

Aligns the time to be the smallest multiple of size greater than the timestamp since the epoch.

ALL_CONTEXTS - Static variable in class com.google.cloud.dataflow.sdk.testing.CoderProperties

All the contexts, for use in test cases.

ALL_KEYS - Static variable in class com.google.cloud.dataflow.sdk.io.range.ByteKeyRange

The range of all keys, with empty start and end keys.

allowsDynamicSplitting() - Method in class com.google.cloud.dataflow.sdk.io.OffsetBasedSource

Whether this source should allow dynamic splitting of the offset ranges.

and(TupleTag<V>, List<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult

Returns a new CoGbkResult based on this, with the given tag and given data added to it.

and(TupleTag<V>, PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple

Returns a new KeyedPCollectionTuple<K> that is the same as this, appended with the given PCollection.

and(PCollection.IsBounded) - Method in enum com.google.cloud.dataflow.sdk.values.PCollection.IsBounded

Returns the composed IsBounded property.

and(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList

Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollection appended to the end.

and(Iterable<PCollection<T>>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList

Returns a new PCollectionList that has all the PCollections of this PCollectionList plus the given PCollections appended to the end, in order.

and(TupleTag<T>, PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple

Returns a new PCollectionTuple that has each PCollection and TupleTag of this PCollectionTuple plus the given PCollection associated with the given TupleTag.

and(TupleTag<?>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList

Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTag appended to the end.

and(List<TupleTag<?>>) - Method in class com.google.cloud.dataflow.sdk.values.TupleTagList

Returns a new TupleTagList that has all the TupleTags of this TupleTagList plus the given TupleTags appended to the end, in order.

any(long) - Static method in class com.google.cloud.dataflow.sdk.transforms.Sample

Sample#any(long) takes a PCollection<T> and a limit, and produces a new PCollection<T> containing up to limit elements of the input PCollection.

applicableTo(PCollection<?>) - Static method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey

 

ApplicationNameOptions - Interface in com.google.cloud.dataflow.sdk.options

Options that allow setting the application name.

AppliedPTransform<InputT extends PInput,OutputT extends POutput,TransformT extends PTransform<? super InputT,OutputT>> - Class in com.google.cloud.dataflow.sdk.transforms

Represents the application of a PTransform to a specific input to produce a specific output.

apply(InputT) - Method in interface com.google.cloud.dataflow.sdk.coders.DelegateCoder.CodingFunction

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Read.Bound

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.AvroIO.Write.Bound

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Read.Bound

 

apply(PCollection<TableRow>) - Method in class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.io.bigtable.BigtableIO.Read

 

apply(PCollection<KV<ByteString, Iterable<Mutation>>>) - Method in class com.google.cloud.dataflow.sdk.io.bigtable.BigtableIO.Write

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.io.CountingInput.BoundedCountingInput

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.io.CountingInput.UnboundedCountingInput

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.io.datastore.DatastoreV1.Read

Applies this PTransform on the given InputT, and returns its Output.

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Read.Bound

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.Write.Bound

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.PubsubUnboundedSink

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.io.PubsubUnboundedSource

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.Read.Bounded

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.Read.Unbounded

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Read.Bound

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.TextIO.Write.Bound

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.io.Write.Bound

 

apply(PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.Pipeline

Like Pipeline.apply(String, PTransform) but the transform node in the Pipeline graph will be named according to PTransform.getName().

apply(String, PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.Pipeline

Adds a root PTransform, such as Read or Create, to this Pipeline.

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner

 

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner

Applies the given transform to the input.

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner

 

apply(InputT) - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.ForwardingPTransform

 

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.InProcessPipelineRunner

 

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.PipelineRunner

Applies a transform to the given input, returning the output.

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.runners.TemplatingDataflowPipelineRunner

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.GroupThenAssert

 

apply(PCollection<Iterable<T>>) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.GroupThenAssertForSingleton

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.testing.DataflowAssert.OneSideInputAssert

 

apply(PTransform<InputT, OutputT>, InputT) - Method in class com.google.cloud.dataflow.sdk.testing.TestDataflowPipelineRunner

 

apply(PBegin) - Method in class com.google.cloud.dataflow.sdk.testing.TestStream

 

apply(double, double) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn

Applies the binary operation to the two operands, returning the result.

apply(V, V) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn

Applies the binary operation to the two operands, returning the result.

apply(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn

Applies the binary operation to the two operands, returning the result.

apply(long, long) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn

Applies the binary operation to the two operands, returning the result.

apply(Iterable<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn

Applies this CombineFn to a collection of input values to produce a combined output value.

apply(PCollection<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally

 

apply(PCollection<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GloballyAsSingletonView

 

apply(PCollection<? extends KV<K, ? extends Iterable<InputT>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.GroupedValues

 

apply(K, Iterable<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.KeyedCombineFn

Applies this KeyedCombineFn to a key and a collection of input values to produce a combined output value.

apply(PCollection<KV<K, InputT>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKey

 

apply(PCollection<KV<K, InputT>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.PerKeyWithHotKeyFanout

 

apply(K, Iterable<? extends InputT>, CombineWithContext.Context) - Method in class com.google.cloud.dataflow.sdk.transforms.CombineWithContext.KeyedCombineFnWithContext

Applies this KeyedCombineFnWithContext to a key and a collection of input values to produce a combined output value.

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Count.PerElement

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.TimestampedValues

 

apply(PInput) - Method in class com.google.cloud.dataflow.sdk.transforms.Create.Values

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Filter

 

apply(PCollection<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.FlatMapElements

 

apply(PCollection<? extends Iterable<T>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenIterables

 

apply(PCollectionList<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Flatten.FlattenPCollectionList

 

apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey

 

apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupAlsoByWindow

 

apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.GroupByKeyOnly

 

apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.ReifyTimestampsAndWindows

 

apply(PCollection<KV<K, Iterable<WindowedValue<V>>>>) - Method in class com.google.cloud.dataflow.sdk.transforms.GroupByKey.SortValuesByTimestamp

 

apply(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.IntraBundleParallelization.Bound

 

apply(KeyedPCollectionTuple<K>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGroupByKey

 

apply(PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple

Like KeyedPCollectionTuple.apply(String, PTransform) but defaulting to the name provided by the PTransform.

apply(String, PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.join.KeyedPCollectionTuple

Applies the given PTransform to this input KeyedPCollectionTuple and returns its OutputT.

apply(PCollection<? extends KV<K, ?>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Keys

 

apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.KvSwap

 

apply(PCollection<InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.MapElements

 

apply(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Max.MaxFn

 

apply(T, T) - Method in class com.google.cloud.dataflow.sdk.transforms.Min.MinFn

 

apply(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.Bound

 

apply(PCollection<? extends InputT>) - Method in class com.google.cloud.dataflow.sdk.transforms.ParDo.BoundMulti

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Partition

 

apply(InputT) - Method in class com.google.cloud.dataflow.sdk.transforms.PTransform

Applies this PTransform on the given InputT, and returns its Output.

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.RemoveDuplicates.WithRepresentativeValues

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.Sample.SampleAny

 

apply(InputT) - Method in interface com.google.cloud.dataflow.sdk.transforms.SerializableFunction

Returns the result of invoking this function on the given input.

apply(double, double) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumDoubleFn

 

apply(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumIntegerFn

 

apply(long, long) - Method in class com.google.cloud.dataflow.sdk.transforms.Sum.SumLongFn

 

apply(PCollection<? extends KV<?, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.Values

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsIterable

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsList

 

apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMap

 

apply(PCollection<KV<K, V>>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsMultimap

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.AsSingleton

 

apply(PCollection<ElemT>) - Method in class com.google.cloud.dataflow.sdk.transforms.View.CreatePCollectionView

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Bound

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Window.Remerge

 

apply(PCollection<V>) - Method in class com.google.cloud.dataflow.sdk.transforms.WithKeys

 

apply(PCollection<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.WithTimestamps

 

apply(PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PBegin

Like PBegin.apply(String, PTransform) but defaulting to the name of the PTransform.

apply(String, PTransform<? super PBegin, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PBegin

Applies the given PTransform to this input PBegin, using name to identify this specific application of the transform.

apply(PTransform<? super PCollection<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection

Like PCollection.apply(String, PTransform) but defaulting to the name of the PTransform.

apply(String, PTransform<? super PCollection<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollection

Applies the given PTransform to this input PCollection, using name to identify this specific application of the transform.

apply(PTransform<PCollectionList<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList

Like PCollectionList.apply(String, PTransform) but defaulting to the name of the PTransform.

apply(String, PTransform<PCollectionList<T>, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionList

Applies the given PTransform to this input PCollectionList, using name to identify this specific application of the transform.

apply(PTransform<PCollectionTuple, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple

Like PCollectionTuple.apply(String, PTransform) but defaulting to the name of the PTransform.

apply(String, PTransform<PCollectionTuple, OutputT>) - Method in class com.google.cloud.dataflow.sdk.values.PCollectionTuple

Applies the given PTransform to this input PCollectionTuple, using name to identify this specific application of the transform.

applyTransform(InputT, PTransform<? super InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.Pipeline

Like Pipeline.applyTransform(String, PInput, PTransform) but defaulting to the name provided by the PTransform.

applyTransform(String, InputT, PTransform<? super InputT, OutputT>) - Static method in class com.google.cloud.dataflow.sdk.Pipeline

Applies the given PTransform to this input InputT and returns its OutputT.

ApproximateQuantiles - Class in com.google.cloud.dataflow.sdk.transforms

PTransforms for getting an idea of a PCollection's data distribution using approximate N-tiles (e.g.

ApproximateQuantiles.ApproximateQuantilesCombineFn<T,ComparatorT extends Comparator<T> & Serializable> - Class in com.google.cloud.dataflow.sdk.transforms

The ApproximateQuantilesCombineFn combiner gives an idea of the distribution of a collection of values using approximate N-tiles.

ApproximateUnique - Class in com.google.cloud.dataflow.sdk.transforms

PTransforms for estimating the number of distinct elements in a PCollection, or the number of distinct values associated with each key in a PCollection of KVs.

ApproximateUnique() - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique

 

ApproximateUnique.ApproximateUniqueCombineFn<T> - Class in com.google.cloud.dataflow.sdk.transforms

CombineFn that computes an estimate of the number of distinct values that were combined.

ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique - Class in com.google.cloud.dataflow.sdk.transforms

A heap utility class to efficiently track the largest added elements.

ApproximateUniqueCombineFn(long, Coder<T>) - Constructor for class com.google.cloud.dataflow.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn

 

areAllSubtriggersFinished() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.Trigger.TriggerInfo

Returns true if all the sub-triggers of the current trigger are marked finished.

as(Class<T>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions

Transforms this object into an object of type <T> saving each property that has been manipulated.

as(Class<T>) - Static method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory

Creates and returns an object that implements <T>.

as(Class<T>) - Method in class com.google.cloud.dataflow.sdk.options.PipelineOptionsFactory.Builder

Creates and returns an object that implements <T> using the values configured on this builder during construction.

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.AvroCoder

 

asCloudObject() - Method in interface com.google.cloud.dataflow.sdk.coders.Coder

Returns the CloudObject that represents this Coder.

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.CustomCoder

Returns the CloudObject that represents this Coder.

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.IterableCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.JAXBCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.KvCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.Proto2Coder

Deprecated.

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.protobuf.ProtoCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.SerializableCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.coders.StandardCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResult.CoGbkResultCoder

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.transforms.join.CoGbkResultSchema

 

asCloudObject() - Method in class com.google.cloud.dataflow.sdk.values.TupleTag

 

asIterable() - Static method in class com.google.cloud.dataflow.sdk.transforms.View

Returns a View.AsIterable transform that takes a PCollection as input and produces a PCollectionView mapping each window to an Iterable of the values in that window.

asKeyedFn() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn

 

asKeyedFn() - Method in interface com.google.cloud.dataflow.sdk.transforms.CombineFnBase.GlobalCombineFn

Converts this GloballyCombineFn into an equivalent CombineFnBase.PerKeyCombineFn that ignores the keys passed to it and combines the values according to this GloballyCombineFn.

asKeyedFn() - Method in class com.google.cloud.dataflow.sdk.transforms.CombineWithContext.CombineFnWithContext

 

asList() - Static method in class com.google.cloud.dataflow.sdk.transforms.View

Returns a View.AsList transform that takes a PCollection and returns a PCollectionView mapping each window to a List containing all of the elements in the window.

asMap() - Method in class com.google.cloud.dataflow.sdk.transforms.display.DisplayData

 

asMap() - Static method in class com.google.cloud.dataflow.sdk.transforms.View

Returns a View.AsMap transform that takes a PCollection<KV<K, V>> as input and produces a PCollectionView mapping each window to a Map<K, V>.

asMultimap() - Static method in class com.google.cloud.dataflow.sdk.transforms.View

Returns a View.AsMultimap transform that takes a PCollection<KV&ltK, V>> as input and produces a PCollectionView mapping each window to its contents as a Map<K, Iterable<V>> for use as a side input.

asOutputReference(PValue) - Method in interface com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator.TranslationContext

Encode a PValue reference as an output reference.

asPath() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubSubscription

Returns the string representation of this subscription as a path used in the Cloud Pub/Sub API.

asPath() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic

Returns the string representation of this topic as a path used in the Cloud Pub/Sub API.

assertSourcesEqualReferenceSource(BoundedSource<T>, List<? extends BoundedSource<T>>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.SourceTestUtils

Given a reference Source and a list of Sources, assert that the union of the records read from the list of sources is equal to the records read from the reference source.

assertSplitAtFractionBehavior(BoundedSource<T>, int, double, SourceTestUtils.ExpectedSplitOutcome, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.SourceTestUtils

Asserts that the source's reader either fails to splitAtFraction(fraction) after reading numItemsToReadBeforeSplit items, or succeeds in a way that is consistent according to SourceTestUtils.assertSplitAtFractionSucceedsAndConsistent(com.google.cloud.dataflow.sdk.io.BoundedSource<T>, int, double, com.google.cloud.dataflow.sdk.options.PipelineOptions).

assertSplitAtFractionExhaustive(BoundedSource<T>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.SourceTestUtils

Asserts that for each possible start position, BoundedSource.BoundedReader#splitAtFraction at every interesting fraction (halfway between two fractions that differ by at least one item) can be called successfully and the results are consistent if a split succeeds.

assertSplitAtFractionFails(BoundedSource<T>, int, double, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.SourceTestUtils

Asserts that the source's reader fails to splitAtFraction(fraction) after reading numItemsToReadBeforeSplit items.

assertSplitAtFractionSucceedsAndConsistent(BoundedSource<T>, int, double, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.SourceTestUtils

Verifies some consistency properties of BoundedSource.BoundedReader#splitAtFraction on the given source.

assertUnstartedReaderReadsSameAsItsSource(BoundedSource.BoundedReader<T>, PipelineOptions) - Static method in class com.google.cloud.dataflow.sdk.testing.SourceTestUtils

Assert that a Reader returns a Source that, when read from, produces the same records as the reader.

AssignContext() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn.AssignContext

 

assignedWindows(WindowFn<T, W>, long) - Static method in class com.google.cloud.dataflow.sdk.testing.WindowFnTestUtils

 

assignOutputTime(Instant, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.OutputTimeFn

Returns the output timestamp to use for data depending on the given inputTimestamp in the specified window.

assignOutputTime(W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow

Returns the output timestamp to use for data in the specified window.

assignOutputTime(Instant, W) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.OutputTimeFn.DependsOnlyOnWindow

Returns the output timestamp to use for data depending on the given inputTimestamp in the specified window.

assignsToSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows

 

assignsToSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn

 

assignsToSingleWindow() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn

Returns true if this WindowFn assigns each element to a single window.

assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.DaysWindows

 

assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows

 

assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows

 

assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.FixedWindows

 

assignWindow(Instant) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn

Returns the single window to which elements with this timestamp belong.

assignWindows(WindowFn<Object, GlobalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.GlobalWindows

 

assignWindows(WindowFn<Object, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.InvalidWindows

 

assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.PartitioningWindowFn

 

assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Sessions

 

assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.SlidingWindows

 

assignWindows(WindowFn<T, W>.AssignContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.WindowFn

Given a timestamp and element, returns the set of windows into which it should be placed.

asSingleton() - Static method in class com.google.cloud.dataflow.sdk.transforms.View

Returns a View.AsSingleton transform that takes a PCollection with a single value per window as input and produces a PCollectionView that returns the value in the main input window when read as a side input.

asSingletonView() - Method in class com.google.cloud.dataflow.sdk.transforms.Combine.Globally

Returns a PTransform that produces a PCollectionView whose elements are the result of combining elements per-window in the input PCollection.

asV1Beta1Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubSubscription

Deprecated.

the v1beta1 API for Cloud Pub/Sub is deprecated.

asV1Beta1Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic

Deprecated.

the v1beta1 API for Cloud Pub/Sub is deprecated.

asV1Beta2Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubSubscription

Deprecated.

the v1beta2 API for Cloud Pub/Sub is deprecated.

asV1Beta2Path() - Method in class com.google.cloud.dataflow.sdk.io.PubsubIO.PubsubTopic

Deprecated.

the v1beta2 API for Cloud Pub/Sub is deprecated.

AtomicCoder<T> - Class in com.google.cloud.dataflow.sdk.coders

A Coder that has no component Coders or other state.

AtomicCoder() - Constructor for class com.google.cloud.dataflow.sdk.coders.AtomicCoder

 

AtomicLongFactory() - Constructor for class com.google.cloud.dataflow.sdk.options.PipelineOptions.AtomicLongFactory

 

AvroCoder<T> - Class in com.google.cloud.dataflow.sdk.coders

A Coder using Avro binary format.

AvroCoder(Class<T>, Schema) - Constructor for class com.google.cloud.dataflow.sdk.coders.AvroCoder

 

AvroIO - Class in com.google.cloud.dataflow.sdk.io

PTransforms for reading and writing Avro files.

AvroIO.Read - Class in com.google.cloud.dataflow.sdk.io

A root PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a PCollection containing the decoding of each record.

AvroIO.Read.Bound<T> - Class in com.google.cloud.dataflow.sdk.io

A PTransform that reads from an Avro file (or multiple Avro files matching a pattern) and returns a bounded PCollection containing the decoding of each record.

AvroIO.Write - Class in com.google.cloud.dataflow.sdk.io

A root PTransform that writes a PCollection to an Avro file (or multiple Avro files matching a sharding pattern).

AvroIO.Write.Bound<T> - Class in com.google.cloud.dataflow.sdk.io

A PTransform that writes a bounded PCollection to an Avro file (or multiple Avro files matching a sharding pattern).

AvroReader(AvroSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.AvroSource.AvroReader

Reads Avro records of type T from the specified source.

AvroSource<T> - Class in com.google.cloud.dataflow.sdk.io

A FileBasedSource for reading Avro files.

AvroSource.AvroReader<T> - Class in com.google.cloud.dataflow.sdk.io

A BlockBasedSource.BlockBasedReader for reading blocks from Avro files.

awaitCompletion() - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.InProcessPipelineRunner.InProcessPipelineResult

Blocks until the Pipeline execution represented by this InProcessPipelineRunner.InProcessPipelineResult is complete, returning the terminal state.

B

BACKLOG_UNKNOWN - Static variable in class com.google.cloud.dataflow.sdk.io.UnboundedSource.UnboundedReader

Constant representing an unknown amount of backlog.

baseOutputFilename - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink

Base filename for final output files.

baseTemporaryFilename - Variable in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation

Base filename used for temporary output files.

BATCH_WORKER_HARNESS_CONTAINER_IMAGE - Static variable in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner

 

BatchBigQueryIONativeReadTranslator() - Constructor for class com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner.BatchBigQueryIONativeReadTranslator

 

beforeElement(WindowedValue<T>) - Method in interface com.google.cloud.dataflow.sdk.runners.inprocess.ModelEnforcement

Called before a call to TransformEvaluator.processElement(WindowedValue) on the provided WindowedValue.

begin() - Method in class com.google.cloud.dataflow.sdk.Pipeline

Returns a PBegin owned by this Pipeline.

beginningOnDay(int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.MonthsWindows

 

beginningOnDay(int, int) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows.YearsWindows

 

BigEndianIntegerCoder - Class in com.google.cloud.dataflow.sdk.coders

A BigEndianIntegerCoder encodes Integers in 4 bytes, big-endian.

BigEndianLongCoder - Class in com.google.cloud.dataflow.sdk.coders

A BigEndianLongCoder encodes Longs in 8 bytes, big-endian.

BigQueryIO - Class in com.google.cloud.dataflow.sdk.io

PTransforms for reading and writing BigQuery tables.

BigQueryIO.Read - Class in com.google.cloud.dataflow.sdk.io

A PTransform that reads from a BigQuery table and returns a PCollection of TableRows containing each of the rows of the table.

BigQueryIO.Read.Bound - Class in com.google.cloud.dataflow.sdk.io

A PTransform that reads from a BigQuery table and returns a bounded PCollection of TableRows.

BigQueryIO.Write - Class in com.google.cloud.dataflow.sdk.io

A PTransform that writes a PCollection containing TableRows to a BigQuery table.

BigQueryIO.Write.Bound - Class in com.google.cloud.dataflow.sdk.io

A PTransform that can write either a bounded or unbounded PCollection of TableRows to a BigQuery table.

BigQueryIO.Write.CreateDisposition - Enum in com.google.cloud.dataflow.sdk.io

An enumeration type for the BigQuery create disposition strings.

BigQueryIO.Write.WriteDisposition - Enum in com.google.cloud.dataflow.sdk.io

An enumeration type for the BigQuery write disposition strings.

BigQueryOptions - Interface in com.google.cloud.dataflow.sdk.options

Properties needed when using BigQuery with the Dataflow SDK.

BigtableIO - Class in com.google.cloud.dataflow.sdk.io.bigtable

A bounded source and sink for Google Cloud Bigtable.

BigtableIO.Read - Class in com.google.cloud.dataflow.sdk.io.bigtable

A PTransform that reads from Google Cloud Bigtable.

BigtableIO.Write - Class in com.google.cloud.dataflow.sdk.io.bigtable

A PTransform that writes to Google Cloud Bigtable.

BinaryCombineDoubleFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineDoubleFn

 

BinaryCombineFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineFn

 

BinaryCombineIntegerFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineIntegerFn

 

BinaryCombineLongFn() - Constructor for class com.google.cloud.dataflow.sdk.transforms.Combine.BinaryCombineLongFn

 

Block() - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource.Block

 

BlockBasedReader(BlockBasedSource<T>) - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource.BlockBasedReader

 

BlockBasedSource<T> - Class in com.google.cloud.dataflow.sdk.io

A BlockBasedSource is a FileBasedSource where a file consists of blocks of records.

BlockBasedSource(String, long) - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource

Creates a BlockBasedSource based on a file name or pattern.

BlockBasedSource(String, long, long, long) - Constructor for class com.google.cloud.dataflow.sdk.io.BlockBasedSource

Creates a BlockBasedSource for a single file.

BlockBasedSource.Block<T> - Class in com.google.cloud.dataflow.sdk.io

A Block represents a block of records that can be read.

BlockBasedSource.BlockBasedReader<T> - Class in com.google.cloud.dataflow.sdk.io

A Reader that reads records from a BlockBasedSource.

BlockingDataflowPipelineOptions - Interface in com.google.cloud.dataflow.sdk.options

Options that are used to configure the BlockingDataflowPipelineRunner.

BlockingDataflowPipelineOptions.StandardOutputFactory - Class in com.google.cloud.dataflow.sdk.options

Returns a default of System.out.

BlockingDataflowPipelineRunner - Class in com.google.cloud.dataflow.sdk.runners

A PipelineRunner that's like DataflowPipelineRunner but that waits for the launched job to finish.

BlockingDataflowPipelineRunner(DataflowPipelineRunner, BlockingDataflowPipelineOptions) - Constructor for class com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner

 

Bound() - Constructor for class com.google.cloud.dataflow.sdk.io.BigQueryIO.Write.Bound

Deprecated.

Should be private. Instead, use one of the factory methods in BigQueryIO.Write, such as BigQueryIO.Write.to(String), to create an instance of this class.

BoundedReader() - Constructor for class com.google.cloud.dataflow.sdk.io.BoundedSource.BoundedReader

 

BoundedSource<T> - Class in com.google.cloud.dataflow.sdk.io

A Source that reads a finite amount of input and, because of that, supports some additional operations.

BoundedSource() - Constructor for class com.google.cloud.dataflow.sdk.io.BoundedSource

 

BoundedSource.BoundedReader<T> - Class in com.google.cloud.dataflow.sdk.io

A Reader that reads a bounded amount of input and supports some additional operations, such as progress estimation and dynamic work rebalancing.

BoundedWindow - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A BoundedWindow represents a finite grouping of elements, with an upper bound (larger timestamps represent more recent data) on the timestamps of elements that can be placed in the window.

BoundedWindow() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.BoundedWindow

 

build() - Method in class com.google.cloud.dataflow.sdk.runners.inprocess.StepTransformResult.Builder

 

buildTemporaryFilename(String, String) - Static method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriteOperation

Build a temporary filename using the temporary filename separator with the given prefix and suffix.

buildTrigger() - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger

 

buildTrigger() - Method in interface com.google.cloud.dataflow.sdk.transforms.windowing.TriggerBuilder

Return the Trigger built by this builder.

by(PredicateT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter

Deprecated.

use Filter.byPredicate(PredicateT), which returns a Filter transform instead of a ParDo.Bound.

byPredicate(PredicateT) - Static method in class com.google.cloud.dataflow.sdk.transforms.Filter

Returns a PTransform that takes an input PCollection<T> and returns a PCollection<T> with elements that satisfy the given predicate.

ByteArrayCoder - Class in com.google.cloud.dataflow.sdk.coders

A Coder for byte[].

ByteCoder - Class in com.google.cloud.dataflow.sdk.coders

A ByteCoder encodes Byte values in 1 byte using Java serialization.

ByteKey - Class in com.google.cloud.dataflow.sdk.io.range

A class representing a key consisting of an array of bytes.

ByteKeyRange - Class in com.google.cloud.dataflow.sdk.io.range

A class representing a range of ByteKeys.

ByteKeyRangeTracker - Class in com.google.cloud.dataflow.sdk.io.range

A RangeTracker for ByteKeys in ByteKeyRanges.

ByteStringCoder - Class in com.google.cloud.dataflow.sdk.coders

A Coder for ByteString objects based on their encoded Protocol Buffer form.

C

CalendarWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A collection of WindowFns that windows values into calendar-based windows such as spans of days, months, or years.

CalendarWindows() - Constructor for class com.google.cloud.dataflow.sdk.transforms.windowing.CalendarWindows

 

CalendarWindows.DaysWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A WindowFn that windows elements into periods measured by days.

CalendarWindows.MonthsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A WindowFn that windows elements into periods measured by months.

CalendarWindows.YearsWindows - Class in com.google.cloud.dataflow.sdk.transforms.windowing

A WindowFn that windows elements into periods measured by years.

cancel() - Method in class com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob

Cancels the job.

CannotProvideCoderException - Exception in com.google.cloud.dataflow.sdk.coders

The exception thrown when a CoderProvider cannot provide a Coder that has been requested.

CannotProvideCoderException(String) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException

 

CannotProvideCoderException(String, CannotProvideCoderException.ReasonCode) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException

 

CannotProvideCoderException(String, Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException

 

CannotProvideCoderException(String, Throwable, CannotProvideCoderException.ReasonCode) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException

 

CannotProvideCoderException(Throwable) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException

 

CannotProvideCoderException(Throwable, CannotProvideCoderException.ReasonCode) - Constructor for exception com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException

 

CannotProvideCoderException.ReasonCode - Enum in com.google.cloud.dataflow.sdk.coders

Indicates the reason that Coder inference failed.

clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterDelayFromFirstElement

 

clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.AfterPane

 

clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.DefaultTrigger

 

clear(Trigger<W>.TriggerContext) - Method in class com.google.cloud.dataflow.sdk.transforms.windowing.Trigger

Clear any state associated with this trigger in the given window.

clearOutputElements() - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester

Clears the record of the elements output so far to the main output.

clearSideOutputElements(TupleTag<T>) - Method in class com.google.cloud.dataflow.sdk.transforms.DoFnTester

Clears the record of the elements output so far to the side output with the given tag.

Clock - Interface in com.google.cloud.dataflow.sdk.runners.inprocess

Access to the current time.

cloneAs(Class<T>) - Method in interface com.google.cloud.dataflow.sdk.options.PipelineOptions

Makes a deep clone of this object, and transforms the cloned object into the specified type kls.

close() - Method in class com.google.cloud.dataflow.sdk.io.DatastoreIO.DatastoreReader

Deprecated.

 

close() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSink.FileBasedWriter

Closes the channel and return the bundle result.

close() - Method in class com.google.cloud.dataflow.sdk.io.FileBasedSource.FileBasedReader

Closes any ReadableByteChannel created for the current reader.

close() - Method in class com.google.cloud.dataflow.sdk.io.Sink.Writer

Finishes writing the bundle.

close() - Method in class com.google.cloud.dataflow.sdk.io.Source.Reader

Closes the reader.

CloudDebuggerOptions - Interface in com.google.cloud.dataflow.sdk.options

Options for controlling Cloud Debugger.

Coder<T> - Interface in com.google.cloud.dataflow.sdk.coders

A Coder<T> defines how to encode and decode values of type T into byte streams.

Coder.Context - Class in com.google.cloud.dataflow.sdk.coders

The context in which encoding or decoding is being done.

Coder.NonDeterministicException - Class in com.google.cloud.dataflow.sdk.coders

Exception thrown by Coder.verifyDeterministic() if the encoding is not deterministic, including details of why the encoding is not deterministic.

coderAllowsEncoding(Coder<T>, String) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

 

coderConsistentWithEquals(Coder<T>, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

 

coderConsistentWithEqualsInContext(Coder<T>, Coder.Context, T, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

 

coderDecodeEncodeContentsEqual(Coder<CollectionT>, CollectionT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

Verifies that for the given Coder<Collection<T>>, and value of type Collection<T>, encoding followed by decoding yields an equal value of type Collection<T>, in any Coder.Context.

coderDecodeEncodeContentsEqualInContext(Coder<CollectionT>, Coder.Context, CollectionT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

Verifies that for the given Coder<Collection<T>>, and value of type Collection<T>, encoding followed by decoding yields an equal value of type Collection<T>, in the given Coder.Context.

coderDecodeEncodeContentsInSameOrder(Coder<IterableT>, IterableT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

Verifies that for the given Coder<Collection<T>>, and value of type Collection<T>, encoding followed by decoding yields an equal value of type Collection<T>, in any Coder.Context.

coderDecodeEncodeContentsInSameOrderInContext(Coder<IterableT>, Coder.Context, IterableT) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

Verifies that for the given Coder<Iterable<T>>, and value of type Iterable<T>, encoding followed by decoding yields an equal value of type Collection<T>, in the given Coder.Context.

coderDecodeEncodeEqual(Coder<T>, T) - Static method in class com.google.cloud.dataflow.sdk.testing.CoderProperties

Verifies that for the given Coder<T>, and value of type T, encoding followed by decoding yields an equal value of type