Package com.google.cloud.pubsublite.spark (1.0.0)

Classes

BaseDataStream

Constants

PslContinuousInputPartition

PslContinuousPartitionReader

PslContinuousPartitionReaderFactory

PslContinuousStream

PslDataWriter

PslDataWriterFactory

PslMicroBatchInputPartition

PslMicroBatchInputPartitionReader

PslMicroBatchPartitionReaderFactory

PslMicroBatchStream

PslPartitionOffset

PslPartitionOffset.Builder

PslReadDataSourceOptions

PslReadDataSourceOptions.Builder

PslScanBuilder

Both Scan and ScanBuilder implementation, otherwise estimateStatistics() is not called due to bug in DataSourceV2Relation.

Information from https://github.com/GoogleCloudDataproc/spark-bigquery-connector/blob/b0b2a8add37bd044e5a9976ce635bb4230957f29/spark-bigquery-dsv2/spark-3.1-bigquery/src/main/java/com/google/cloud/spark/bigquery/v2/BigQueryScanBuilder.java#L30

PslSourceOffset

PslSourceOffset.Builder

PslSparkUtils

PslTable

PslTableProvider

PslWrite

Pub/Sub Lite class for writing.

Note that SupportsStreamingUpdateAsAppend is the same hack that kafka uses to opt-in to writing aggregates without requiring windowing.

PslWriteDataSourceOptions

PslWriteDataSourceOptions.Builder

PslWriterCommitMessage

SparkSourceOffset

SparkStructs