StorageConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Configurations related to Cloud Storage as the data source.
Attributes |
|
---|---|
Name | Description |
include_patterns |
MutableSequence[str]
Optional. Defines the data to include during discovery when only a subset of the data should be considered. Provide a list of patterns that identify the data to include. For Cloud Storage bucket assets, these patterns are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these patterns are interpreted as patterns to match table names. |
exclude_patterns |
MutableSequence[str]
Optional. Defines the data to exclude during discovery. Provide a list of patterns that identify the data to exclude. For Cloud Storage bucket assets, these patterns are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these patterns are interpreted as patterns to match table names. |
csv_options |
google.cloud.dataplex_v1.types.DataDiscoverySpec.StorageConfig.CsvOptions
Optional. Configuration for CSV data. |
json_options |
google.cloud.dataplex_v1.types.DataDiscoverySpec.StorageConfig.JsonOptions
Optional. Configuration for JSON data. |
Classes
CsvOptions
CsvOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Describes CSV and similar semi-structured data formats.
JsonOptions
JsonOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Describes JSON data format.