CombineFnBase.GlobalCombineFn (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1

Warning: Dataflow SDK 1.x for Java is unsupported as of October 16, 2018. After August 12, 2020, you can use unsupported SDKs temporarily while you upgrade your pipelines. For more information, see Using an unsupported SDK.

For information on migrating from the 1.x SDK, see Migrating from Dataflow SDK 1.x for Java.

Note: If you are using Cloud Dataflow SDK version 2.x, see the Apache Beam API reference documentation.

com.google.cloud.dataflow.sdk.transforms

Interface CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT>

• Type Parameters:

  InputT - type of input values

  AccumT - type of mutable accumulator values

  OutputT - type of output values

  All Superinterfaces:

  HasDisplayData, Serializable

  All Known Implementing Classes:

  ApproximateQuantiles.ApproximateQuantilesCombineFn, ApproximateUnique.ApproximateUniqueCombineFn, Combine.AccumulatingCombineFn, Combine.BinaryCombineDoubleFn, Combine.BinaryCombineFn, Combine.BinaryCombineIntegerFn, Combine.BinaryCombineLongFn, Combine.CombineFn, Combine.IterableCombineFn, Combine.SimpleCombineFn, CombineFns.ComposedCombineFn, CombineFns.ComposedCombineFnWithContext, CombineWithContext.CombineFnWithContext, Max.MaxDoubleFn, Max.MaxFn, Max.MaxIntegerFn, Max.MaxLongFn, Min.MinDoubleFn, Min.MinFn, Min.MinIntegerFn, Min.MinLongFn, Sample.FixedSizedSampleFn, Sum.SumDoubleFn, Sum.SumIntegerFn, Sum.SumLongFn, Top.TopCombineFn

  Enclosing class:

  CombineFnBase

  ---

  
  

  public static interface CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT>
  extends Serializable, HasDisplayData

  A GloballyCombineFn<InputT, AccumT, OutputT> specifies how to combine a collection of input values of type InputT into a single output value of type OutputT. It does this via one or more intermediate mutable accumulator values of type AccumT.

  Do not implement this interface directly. Extends Combine.CombineFn and CombineWithContext.CombineFnWithContext instead.

• • Method Summary

    All Methods Instance Methods Abstract Methods 

    Modifier and Type	Method and Description
    <K> CombineFnBase.PerKeyCombineFn<K,InputT,AccumT,OutputT>	asKeyedFn() Converts this GloballyCombineFn into an equivalent CombineFnBase.PerKeyCombineFn that ignores the keys passed to it and combines the values according to this GloballyCombineFn.
    OutputT	defaultValue() Returns the default value when there are no values added to the accumulator.
    Coder<AccumT>	getAccumulatorCoder(CoderRegistry registry, Coder<InputT> inputCoder) Returns the Coder to use for accumulator AccumT values, or null if it is not able to be inferred.
    Coder<OutputT>	getDefaultOutputCoder(CoderRegistry registry, Coder<InputT> inputCoder) Returns the Coder to use by default for output OutputT values, or null if it is not able to be inferred.
    String	getIncompatibleGlobalWindowErrorMessage() Returns the error message for not supported default values in Combine.globally().

    • Methods inherited from interface com.google.cloud.dataflow.sdk.transforms.display.HasDisplayData

      populateDisplayData

• • Method Detail

    • getAccumulatorCoder

      Coder<AccumT> getAccumulatorCoder(CoderRegistry registry,
                                        Coder<InputT> inputCoder)
                                 throws CannotProvideCoderException

      Returns the Coder to use for accumulator AccumT values, or null if it is not able to be inferred.

      By default, uses the knowledge of the Coder being used for InputT values and the enclosing Pipeline's CoderRegistry to try to infer the Coder for AccumT values.

      This is the Coder used to send data through a communication-intensive shuffle step, so a compact and efficient representation may have significant performance benefits.

      Throws:

      CannotProvideCoderException

    • getDefaultOutputCoder

      Coder<OutputT> getDefaultOutputCoder(CoderRegistry registry,
                                           Coder<InputT> inputCoder)
                                    throws CannotProvideCoderException

      Returns the Coder to use by default for output OutputT values, or null if it is not able to be inferred.

      By default, uses the knowledge of the Coder being used for input InputT values and the enclosing Pipeline's CoderRegistry to try to infer the Coder for OutputT values.

      Throws:

      CannotProvideCoderException

    • getIncompatibleGlobalWindowErrorMessage

      String getIncompatibleGlobalWindowErrorMessage()

      Returns the error message for not supported default values in Combine.globally().

    • defaultValue

      OutputT defaultValue()

      Returns the default value when there are no values added to the accumulator.

    • asKeyedFn

      <K> CombineFnBase.PerKeyCombineFn<K,InputT,AccumT,OutputT> asKeyedFn()

      Converts this GloballyCombineFn into an equivalent CombineFnBase.PerKeyCombineFn that ignores the keys passed to it and combines the values according to this GloballyCombineFn.

      Type Parameters:

      K - the type of the (ignored) keys