StorageFormat(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Describes the format of the data within its storage location.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Attributes | |
---|---|
Name | Description |
format_ |
google.cloud.dataplex_v1.types.StorageFormat.Format
Output only. The data format associated with the stored data, which represents content type values. The value is inferred from mime type. |
compression_format |
google.cloud.dataplex_v1.types.StorageFormat.CompressionFormat
Optional. The compression type associated with the stored data. If unspecified, the data is uncompressed. |
mime_type |
str
Required. The mime type descriptor for the data. Must match the pattern {type}/{subtype}. Supported values: - application/x-parquet - application/x-avro - application/x-orc - application/x-tfrecord - application/x-parquet+iceberg - application/x-avro+iceberg - application/x-orc+iceberg - application/json - application/{subtypes} - text/csv - text/ |
csv |
google.cloud.dataplex_v1.types.StorageFormat.CsvOptions
Optional. Additional information about CSV formatted data. This field is a member of oneof _ options .
|
json |
google.cloud.dataplex_v1.types.StorageFormat.JsonOptions
Optional. Additional information about CSV formatted data. This field is a member of oneof _ options .
|
iceberg |
google.cloud.dataplex_v1.types.StorageFormat.IcebergOptions
Optional. Additional information about iceberg tables. This field is a member of oneof _ options .
|
Classes
CompressionFormat
CompressionFormat(value)
The specific compressed file format of the data.
Values: COMPRESSION_FORMAT_UNSPECIFIED (0): CompressionFormat unspecified. Implies uncompressed data. GZIP (2): GZip compressed set of files. BZIP2 (3): BZip2 compressed set of files.
CsvOptions
CsvOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Describes CSV and similar semi-structured data formats.
Format
Format(value)
The specific file format of the data.
Values: FORMAT_UNSPECIFIED (0): Format unspecified. PARQUET (1): Parquet-formatted structured data. AVRO (2): Avro-formatted structured data. ORC (3): Orc-formatted structured data. CSV (100): Csv-formatted semi-structured data. JSON (101): Json-formatted semi-structured data. IMAGE (200): Image data formats (such as jpg and png). AUDIO (201): Audio data formats (such as mp3, and wav). VIDEO (202): Video data formats (such as mp4 and mpg). TEXT (203): Textual data formats (such as txt and xml). TFRECORD (204): TensorFlow record format. OTHER (1000): Data that doesn't match a specific format. UNKNOWN (1001): Data of an unknown format.
IcebergOptions
IcebergOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Describes Iceberg data format.
JsonOptions
JsonOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Describes JSON data format.