Class StorageConfig (2.4.0)

StorageConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Configurations related to Cloud Storage as the data source.

Attributes

Name Description
include_patterns MutableSequence[str]
Optional. Defines the data to include during discovery when only a subset of the data should be considered. Provide a list of patterns that identify the data to include. For Cloud Storage bucket assets, these patterns are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these patterns are interpreted as patterns to match table names.
exclude_patterns MutableSequence[str]
Optional. Defines the data to exclude during discovery. Provide a list of patterns that identify the data to exclude. For Cloud Storage bucket assets, these patterns are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these patterns are interpreted as patterns to match table names.
csv_options google.cloud.dataplex_v1.types.DataDiscoverySpec.StorageConfig.CsvOptions
Optional. Configuration for CSV data.
json_options google.cloud.dataplex_v1.types.DataDiscoverySpec.StorageConfig.JsonOptions
Optional. Configuration for JSON data.

Classes

CsvOptions

CsvOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes CSV and similar semi-structured data formats.

JsonOptions

JsonOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes JSON data format.