Google Cloud Dataflow SDK for Java, version 1.9.1
com.google.cloud.dataflow.sdk.runners.inprocess
Class InProcessPipelineRunner
- java.lang.Object
-
- com.google.cloud.dataflow.sdk.runners.PipelineRunner<InProcessPipelineRunner.InProcessPipelineResult>
-
- com.google.cloud.dataflow.sdk.runners.inprocess.InProcessPipelineRunner
-
@Experimental public class InProcessPipelineRunner extends PipelineRunner<InProcessPipelineRunner.InProcessPipelineResult>
An In-Memory implementation of the Dataflow Programming Model. Supports UnboundedPCollections
.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class and Description static interface
InProcessPipelineRunner.CommittedBundle<T>
Part of aPCollection
.static class
InProcessPipelineRunner.InProcessPipelineResult
The result of running aPipeline
with theInProcessPipelineRunner
.static interface
InProcessPipelineRunner.PCollectionViewWriter<ElemT,ViewT>
AInProcessPipelineRunner.PCollectionViewWriter
is responsible for writing contents of aPCollection
to a storage mechanism that can be read from while constructing aPCollectionView
.static interface
InProcessPipelineRunner.UncommittedBundle<T>
Part of aPCollection
.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method and Description <OutputT extends POutput,InputT extends PInput>
OutputTapply(PTransform<InputT,OutputT> transform, InputT input)
Applies a transform to the given input, returning the output.static InProcessPipelineRunner
fromOptions(PipelineOptions options)
InProcessPipelineOptions
getPipelineOptions()
Returns thePipelineOptions
used to create thisInProcessPipelineRunner
.InProcessPipelineRunner.InProcessPipelineResult
run(Pipeline pipeline)
Processes the given Pipeline, returning the results.
-
-
-
Method Detail
-
fromOptions
public static InProcessPipelineRunner fromOptions(PipelineOptions options)
-
getPipelineOptions
public InProcessPipelineOptions getPipelineOptions()
Returns thePipelineOptions
used to create thisInProcessPipelineRunner
.
-
apply
public <OutputT extends POutput,InputT extends PInput> OutputT apply(PTransform<InputT,OutputT> transform, InputT input)
Description copied from class:PipelineRunner
Applies a transform to the given input, returning the output.The default implementation calls PTransform.apply(input), but can be overridden to customize behavior for a particular runner.
- Overrides:
apply
in classPipelineRunner<InProcessPipelineRunner.InProcessPipelineResult>
-
run
public InProcessPipelineRunner.InProcessPipelineResult run(Pipeline pipeline)
Description copied from class:PipelineRunner
Processes the given Pipeline, returning the results.- Specified by:
run
in classPipelineRunner<InProcessPipelineRunner.InProcessPipelineResult>
-
-