UnboundedSource.CheckpointMark (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1

Warning: Dataflow SDK 1.x for Java is unsupported as of October 16, 2018. After August 12, 2020, you can use unsupported SDKs temporarily while you upgrade your pipelines. For more information, see Using an unsupported SDK.

For information on migrating from the 1.x SDK, see Migrating from Dataflow SDK 1.x for Java.

Note: If you are using Cloud Dataflow SDK version 2.x, see the Apache Beam API reference documentation.

com.google.cloud.dataflow.sdk.io

Interface UnboundedSource.CheckpointMark

• All Known Implementing Classes:

  CountingSource.CounterMark

  Enclosing class:

  UnboundedSource<OutputT,CheckpointMarkT extends UnboundedSource.CheckpointMark>

  ---

  
  

  public static interface UnboundedSource.CheckpointMark

  A marker representing the progress and state of an UnboundedSource.UnboundedReader.

  For example, this could be offsets in a set of files being read.

• • Method Summary

    All Methods Instance Methods Abstract Methods 

    Modifier and Type	Method and Description
    void	finalizeCheckpoint() Perform any finalization that needs to happen after a bundle of data read from the source has been processed and committed.

• • Method Detail

    • finalizeCheckpoint

      void finalizeCheckpoint()
                       throws IOException

      Perform any finalization that needs to happen after a bundle of data read from the source has been processed and committed.

      For example, this could be sending acknowledgement requests to an external data source such as Pub/Sub.

      This may be called from any thread, potentially at the same time as calls to the UnboundedReader that created it.

      Throws:

      IOException