Aggregator (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1

com.google.cloud.dataflow.sdk.transforms

Interface Aggregator<InputT,OutputT>

  • Type Parameters:
    InputT - the type of input values
    OutputT - the type of output values


    public interface Aggregator<InputT,OutputT>
    An Aggregator<InputT> enables monitoring of values of type InputT, to be combined across all bundles.

    Aggregators are created by calling DoFn.createAggregator(java.lang.String, com.google.cloud.dataflow.sdk.transforms.Combine.CombineFn<? super AggInputT, ?, AggOutputT>), typically from the DoFn constructor. Elements can be added to the Aggregator by calling addValue(InputT).

    Aggregators are visible in the monitoring UI, when the pipeline is run using DataflowPipelineRunner or BlockingDataflowPipelineRunner, along with their current value. Aggregators may not become visible until the system begins executing the ParDo transform that created them and/or their initial value is changed.

    Example:

     class MyDoFn extends DoFn {
       private Aggregator myAggregator;
    
       public MyDoFn() {
         myAggregator = createAggregator("myAggregator", new Sum.SumIntegerFn());
       }


Hai trovato utile questa pagina? Facci sapere cosa ne pensi:

Invia feedback per...

Hai bisogno di assistenza? Visita la nostra pagina di assistenza.