Class StorageFormat (1.4.2)

Stay organized with collections Save and categorize content based on your preferences.
StorageFormat(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes the format of the data within its storage location.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof:


Output only. The data format associated with the stored data, which represents content type values. The value is inferred from mime type.
Optional. The compression type associated with the stored data. If unspecified, the data is uncompressed.
mime_type str
Required. The mime type descriptor for the data. Must match the pattern {type}/{subtype}. Supported values: - application/x-parquet - application/x-avro - application/x-orc - application/x-tfrecord - application/x-parquet+iceberg - application/x-avro+iceberg - application/x-orc+iceberg - application/json - application/{subtypes} - text/csv - text/
Optional. Additional information about CSV formatted data. This field is a member of oneof_ options.
Optional. Additional information about CSV formatted data. This field is a member of oneof_ options.
Optional. Additional information about iceberg tables. This field is a member of oneof_ options.




The specific compressed file format of the data.

Values: COMPRESSION_FORMAT_UNSPECIFIED (0): CompressionFormat unspecified. Implies uncompressed data. GZIP (2): GZip compressed set of files. BZIP2 (3): BZip2 compressed set of files.


CsvOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes CSV and similar semi-structured data formats.



The specific file format of the data.

Values: FORMAT_UNSPECIFIED (0): Format unspecified. PARQUET (1): Parquet-formatted structured data. AVRO (2): Avro-formatted structured data. ORC (3): Orc-formatted structured data. CSV (100): Csv-formatted semi-structured data. JSON (101): Json-formatted semi-structured data. IMAGE (200): Image data formats (such as jpg and png). AUDIO (201): Audio data formats (such as mp3, and wav). VIDEO (202): Video data formats (such as mp4 and mpg). TEXT (203): Textual data formats (such as txt and xml). TFRECORD (204): TensorFlow record format. OTHER (1000): Data that doesn't match a specific format. UNKNOWN (1001): Data of an unknown format.


IcebergOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes Iceberg data format.


JsonOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes JSON data format.