Read.Unbounded (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1

com.google.cloud.dataflow.sdk.io

Class Read.Unbounded<T>

    • Method Detail

      • named

        public Read.Unbounded<T> named(String name)
        Returns a new Unbounded PTransform that's like this one but has the given name.

        Does not modify this object.

      • withMaxNumRecords

        public com.google.cloud.dataflow.sdk.io.BoundedReadFromUnboundedSource<T> withMaxNumRecords(long maxNumRecords)
        Returns a new BoundedReadFromUnboundedSource that reads a bounded amount of data from the given UnboundedSource. The bound is specified as a number of records to read.

        This may take a long time to execute if the splits of this source are slow to read records.

      • withMaxReadTime

        public com.google.cloud.dataflow.sdk.io.BoundedReadFromUnboundedSource<T> withMaxReadTime(Duration maxReadTime)
        Returns a new BoundedReadFromUnboundedSource that reads a bounded amount of data from the given UnboundedSource. The bound is specified as an amount of time to read for. Each split of the source will read for this much time.
      • getSource

        public UnboundedSource<T,?> getSource()
        Returns the UnboundedSource used to create this Read PTransform.
      • getKindString

        public String getKindString()
        Description copied from class: PTransform
        Returns the name to use by default for this PTransform (not including the names of any enclosing PTransforms).

        By default, returns the base name of this PTransform's class.

        The caller is responsible for ensuring that names of applied PTransforms are unique, e.g., by adding a uniquifying suffix when needed.

        Overrides:
        getKindString in class PTransform<PInput,PCollection<T>>
      • populateDisplayData

        public void populateDisplayData(DisplayData.Builder builder)
        Description copied from class: PTransform
        Register display data for the given transform or component.

        populateDisplayData(DisplayData.Builder) is invoked by Pipeline runners to collect display data via DisplayData.from(HasDisplayData). Implementations may call super.populateDisplayData(builder) in order to register display data in the current namespace, but should otherwise use subcomponent.populateDisplayData(builder) to use the namespace of the subcomponent.

        By default, does not register any display data. Implementors may override this method to provide their own display data.

        Specified by:
        populateDisplayData in interface HasDisplayData
        Overrides:
        populateDisplayData in class PTransform<PInput,PCollection<T>>
        Parameters:
        builder - The builder to populate with display data.
        See Also:
        HasDisplayData


Was this page helpful? Let us know how we did:

Send feedback about...

Cloud Dataflow