Class StorageConfig (2.5.0)

Version latest

• 2.5.0 (latest)
• 2.4.0
• 2.3.1
• 2.2.2
• 2.1.0
• 2.0.1
• 1.13.0
• 1.12.3
• 1.11.0
• 1.10.0
• 1.9.0
• 1.8.1
• 1.7.0
• 1.6.2
• 1.5.1
• 1.4.3
• 1.3.0
• 1.2.0
• 1.1.3
• 1.0.1
• 0.2.1
• 0.1.0

StorageConfig(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Configurations related to Cloud Storage as the data source.

Attributes
Name	Description
include_patterns	MutableSequence[str] Optional. Defines the data to include during discovery when only a subset of the data should be considered. Provide a list of patterns that identify the data to include. For Cloud Storage bucket assets, these patterns are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these patterns are interpreted as patterns to match table names.
exclude_patterns	MutableSequence[str] Optional. Defines the data to exclude during discovery. Provide a list of patterns that identify the data to exclude. For Cloud Storage bucket assets, these patterns are interpreted as glob patterns used to match object names. For BigQuery dataset assets, these patterns are interpreted as patterns to match table names.
csv_options	google.cloud.dataplex_v1.types.DataDiscoverySpec.StorageConfig.CsvOptions Optional. Configuration for CSV data.
json_options	google.cloud.dataplex_v1.types.DataDiscoverySpec.StorageConfig.JsonOptions Optional. Configuration for JSON data.

Classes

CsvOptions

CsvOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes CSV and similar semi-structured data formats.

JsonOptions

JsonOptions(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Describes JSON data format.