AvroIO.Read.Bound (Google Cloud Dataflow SDK 1.9.1 API)

Google Cloud Dataflow SDK for Java, version 1.9.1


Class AvroIO.Read.Bound<T>

    • Method Detail

      • withSchema

        public <X> AvroIO.Read.Bound<X> withSchema(Class<X> type)
        Returns a new PTransform that's like this one but that reads Avro file(s) containing records whose type is the specified Avro-generated class.

        Does not modify this object.

        Type Parameters:
        X - the type of the decoded elements and the elements of the resulting PCollection
      • withSchema

        public AvroIO.Read.Bound<GenericRecord> withSchema(String schema)
        Returns a new PTransform that's like this one but that reads Avro file(s) containing records of the specified schema in a JSON-encoded string form.

        Does not modify this object.

      • withoutValidation

        public AvroIO.Read.Bound<T> withoutValidation()
        Returns a new PTransform that's like this one but that has GCS input path validation on pipeline creation disabled.

        Does not modify this object.

        This can be useful in the case where the GCS input location does not exist at the pipeline creation time, but is expected to be available at execution time.

      • populateDisplayData

        public void populateDisplayData(DisplayData.Builder builder)
        Description copied from class: PTransform
        Register display data for the given transform or component.

        populateDisplayData(DisplayData.Builder) is invoked by Pipeline runners to collect display data via DisplayData.from(HasDisplayData). Implementations may call super.populateDisplayData(builder) in order to register display data in the current namespace, but should otherwise use subcomponent.populateDisplayData(builder) to use the namespace of the subcomponent.

        By default, does not register any display data. Implementors may override this method to provide their own display data.

        Specified by:
        populateDisplayData in interface HasDisplayData
        populateDisplayData in class PTransform<PInput,PCollection<T>>
        builder - The builder to populate with display data.
        See Also:
      • getFilepattern

        public String getFilepattern()
      • getSchema

        public Schema getSchema()
      • needsValidation

        public boolean needsValidation()

¿Te ha resultado útil esta página? Enviar comentarios:

Enviar comentarios sobre...

Dataflow: Stream & Batch Processing
Si necesitas ayuda, visita nuestra página de asistencia.