Google Cloud Dataflow SDK for Java, version 1.9.1
Interface Summary Interface Description AfterWatermark.AfterWatermarkEarly<W extends BoundedWindow>Interface for building an AfterWatermarkTrigger with early firings already filled in. AfterWatermark.AfterWatermarkLate<W extends BoundedWindow>Interface for building an AfterWatermarkTrigger with late firings already filled in. Trigger.MergingTriggerInfo<W extends BoundedWindow>Interact with properties of the trigger being executed, with extensions to deal with the merging windows. Trigger.TriggerInfo<W extends BoundedWindow>Interface for accessing information about the trigger being executed and other triggers in the same tree. TriggerBuilder<W extends BoundedWindow>Anything that can be used to create an instance of a
Triggerimplements this interface.
Class Summary Class Description AfterAll<W extends BoundedWindow>Create a
Triggerthat fires and finishes once after all of its sub-triggers have fired.
AfterDelayFromFirstElement<W extends BoundedWindow>A base class for triggers that happen after a processing time delay from the arrival of the first element in a pane. AfterEach<W extends BoundedWindow>A composite
Triggerthat executes its sub-triggers in order.
AfterFirst<W extends BoundedWindow>Create a composite
Triggerthat fires once after at least one of its sub-triggers have fired.
AfterPane<W extends BoundedWindow>
Triggers that fire based on properties of the elements in the current pane.
AfterProcessingTime<W extends BoundedWindow>
AfterProcessingTimetriggers fire based on the current processing time.
AfterWatermark<W extends BoundedWindow>
AfterWatermarktriggers fire based on progress of the system watermark.
AfterWatermark.FromEndOfWindow<W extends BoundedWindow>A watermark trigger targeted relative to the end of the window. BoundedWindowA
BoundedWindowrepresents a finite grouping of elements, with an upper bound (larger timestamps represent more recent data) on the timestamps of elements that can be placed in the window.
CalendarWindowsA collection of
WindowFns that windows values into calendar-based windows such as spans of days, months, or years.
WindowFnthat windows elements into periods measured by days.
WindowFnthat windows elements into periods measured by months.
WindowFnthat windows elements into periods measured by years.
DefaultTrigger<W extends BoundedWindow>A trigger that is equivalent to
WindowFnthat windows values into fixed-size timestamp-based windows.
GlobalWindowThe default window into which all data is placed (via
GlobalWindow.Coderfor encoding and decoding
WindowFnthat assigns all data to the same window.
IntervalWindow InvalidWindows<W extends BoundedWindow>A
WindowFnthat represents an invalid pipeline state.
MergeOverlappingIntervalWindowsA utility function for merging overlapping
NeverA trigger which never fires. NonMergingWindowFn<T,W extends BoundedWindow>Abstract base class for
WindowFns that do not merge windows.
OutputTimeFn<W extends BoundedWindow>(Experimental) A function from timestamps of input values to the timestamp for a computed value. OutputTimeFn.Defaults<W extends BoundedWindow>(Experimental) Default method implementations for
OutputTimeFnwhere the output time depends on the input element timestamps and possibly the window.
OutputTimeFn.DependsOnlyOnWindow<W extends BoundedWindow>(Experimental) Default method implementations for
OutputTimeFnwhen the output time depends only on the window.
OutputTimeFns(Experimental) Static utility methods and provided implementations for
PaneInfoProvides information about the pane an element belongs to. PaneInfo.PaneInfoCoderA Coder for encoding PaneInfo instances. PartitioningWindowFn<T,W extends BoundedWindow>A
WindowFnthat places each value into exactly one window based on its timestamp and never merges windows.
Repeatedly<W extends BoundedWindow>Repeat a trigger, either until some condition is met or forever. Sessions SlidingWindowsA
WindowFnthat windows values into possibly overlapping fixed-size timestamp-based windows.
Trigger<W extends BoundedWindow>
Triggers control when the elements for a specific key and window are output.
Trigger.OnceTrigger<W extends BoundedWindow> Window Window.Bound<T>A
PTransformthat windows the elements of a
PCollection<T>, into finite windows according to a user-specified
PTransformthat does not change assigned windows, but will cause windows to be merged again as part of the next
Windowtransform, with unbound input/output type.
WindowFn<T,W extends BoundedWindow>The argument to the
Windowtransform used to assign elements into windows and to determine how windows are merged.
Enum Summary Enum Description PaneInfo.TimingEnumerates the possibilities for the timing of this pane firing related to the input and output watermarks for its computation. Window.ClosingBehaviorSpecifies the conditions under which a final pane will be created when a window is permanently closed.
Package com.google.cloud.dataflow.sdk.transforms.windowing Description
Windowtransform for dividing the elements in a PCollection into windows, and the
Triggerfor controlling when those elements are output.
Window logically divides up or groups the elements of a
PCollection into finite windows according to a
The output of
Window contains the same elements as input, but they
have been logically assigned to windows. The next
GroupByKeys, including one
within composite transforms, will group by the combination of keys and
PCollection allows chunks of it to be processed
individually, before the entire
PCollection is available. This is
especially important for
PCollections with unbounded size, since the full
PCollection is never available at once.
PCollections with a bounded size, by default, all data is implicitly in a
single window, and this replicates conventional batch mode. However, windowing can still be a
convenient way to express time-sliced algorithms over bounded
As elements are assigned to a window, they are are placed into a pane. When the trigger fires all of the elements in the current pane are output.