UnboundedSource.CheckpointMark (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1

Warning: Cloud Dataflow SDK 1.x for Java is unsupported as of October 16, 2018. See Migrating from Cloud Dataflow SDK 1.x for Java for migration guidance.

Note: If you are using Cloud Dataflow SDK version 2.x, see the Apache Beam API reference documentation.

com.google.cloud.dataflow.sdk.io

Interface UnboundedSource.CheckpointMark

• All Known Implementing Classes:

  CountingSource.CounterMark

  Enclosing class:

  UnboundedSource<OutputT,CheckpointMarkT extends UnboundedSource.CheckpointMark>

  ---

  
  

  public static interface UnboundedSource.CheckpointMark

  A marker representing the progress and state of an UnboundedSource.UnboundedReader.

  For example, this could be offsets in a set of files being read.

• • Method Summary

    All Methods Instance Methods Abstract Methods 

    Modifier and Type	Method and Description
    void	finalizeCheckpoint() Perform any finalization that needs to happen after a bundle of data read from the source has been processed and committed.

• • Method Detail

    • finalizeCheckpoint

      void finalizeCheckpoint()
                       throws IOException

      Perform any finalization that needs to happen after a bundle of data read from the source has been processed and committed.

      For example, this could be sending acknowledgement requests to an external data source such as Pub/Sub.

      This may be called from any thread, potentially at the same time as calls to the UnboundedReader that created it.

      Throws:

      IOException