Google Cloud Dataflow SDK for Java, version 1.9.1
com.google.cloud.dataflow.sdk.runners
Class DataflowPipelineTranslator
- java.lang.Object
-
- com.google.cloud.dataflow.sdk.runners.DataflowPipelineTranslator
-
public class DataflowPipelineTranslator extends Object
DataflowPipelineTranslator
knows how to translatePipeline
objects into Cloud Dataflow Service APIJob
s.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class and Description static class
DataflowPipelineTranslator.JobSpecification
The result of a job translation.static interface
DataflowPipelineTranslator.TransformTranslator<TransformT extends PTransform>
ADataflowPipelineTranslator.TransformTranslator
knows how to translate a particular subclass ofPTransform
for the Cloud Dataflow service.static interface
DataflowPipelineTranslator.TranslationContext
The interface provided to registered callbacks for interacting with theDataflowPipelineRunner
, including reading and writing the values ofPCollection
s and side inputs (PCollectionView
s).
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method and Description static DataflowPipelineTranslator
fromOptions(DataflowPipelineOptions options)
Constructs a translator from the provided options.<TransformT extends PTransform>
DataflowPipelineTranslator.TransformTranslator<TransformT>getTransformTranslator(Class<TransformT> transformClass)
Returns theDataflowPipelineTranslator.TransformTranslator
to use for instances of the specified PTransform class, or null if none registered.static String
jobToString(com.google.api.services.dataflow.model.Job job)
Renders aJob
as a string.static <TransformT extends PTransform>
voidregisterTransformTranslator(Class<TransformT> transformClass, DataflowPipelineTranslator.TransformTranslator<? extends TransformT> transformTranslator)
Records that instances of the specified PTransform class should be translated by default by the correspondingDataflowPipelineTranslator.TransformTranslator
.String
toString()
DataflowPipelineTranslator.JobSpecification
translate(Pipeline pipeline, DataflowPipelineRunner runner, List<com.google.api.services.dataflow.model.DataflowPackage> packages)
Translates aPipeline
into aJobSpecification
.
-
-
-
Method Detail
-
fromOptions
public static DataflowPipelineTranslator fromOptions(DataflowPipelineOptions options)
Constructs a translator from the provided options.- Parameters:
options
- Properties that configure the translator.- Returns:
- The newly created translator.
-
translate
public DataflowPipelineTranslator.JobSpecification translate(Pipeline pipeline, DataflowPipelineRunner runner, List<com.google.api.services.dataflow.model.DataflowPackage> packages)
Translates aPipeline
into aJobSpecification
.
-
jobToString
public static String jobToString(com.google.api.services.dataflow.model.Job job)
Renders aJob
as a string.
-
registerTransformTranslator
public static <TransformT extends PTransform> void registerTransformTranslator(Class<TransformT> transformClass, DataflowPipelineTranslator.TransformTranslator<? extends TransformT> transformTranslator)
Records that instances of the specified PTransform class should be translated by default by the correspondingDataflowPipelineTranslator.TransformTranslator
.
-
getTransformTranslator
public <TransformT extends PTransform> DataflowPipelineTranslator.TransformTranslator<TransformT> getTransformTranslator(Class<TransformT> transformClass)
Returns theDataflowPipelineTranslator.TransformTranslator
to use for instances of the specified PTransform class, or null if none registered.
-
-