API documentation for dataplex_v1.types package.
Classes
Action
Action represents an issue requiring administrator action for resolution.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Asset
An asset represents a cloud resource that is being managed within a lake as a member of a zone.
AssetStatus
Aggregated status of the underlying assets of a lake or zone.
CancelJobRequest
Cancel task jobs.
Content
Content represents a user-visible notebook or a sql script
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
CreateAssetRequest
Create asset request.
CreateContentRequest
Create content request.
CreateDataScanRequest
Create dataScan request.
CreateEntityRequest
Create a metadata entity request.
CreateEnvironmentRequest
Create environment request.
CreateLakeRequest
Create lake request.
CreatePartitionRequest
Create metadata partition request.
CreateTaskRequest
Create task request.
CreateZoneRequest
Create zone request.
DataProfileResult
DataProfileResult defines the output of DataProfileScan. Each field of the table will have field type specific profile result.
DataProfileSpec
DataProfileScan related setting.
DataQualityDimensionResult
DataQualityDimensionResult provides a more detailed, per-dimension level view of the results.
DataQualityResult
The output of a DataQualityScan.
DataQualityRule
A rule captures data quality intent about a data source.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
DataQualityRuleResult
DataQualityRuleResult provides a more detailed, per-rule level view of the results.
DataQualitySpec
DataQualityScan related setting.
DataScan
Represents a user-visible job which provides the insights for the related data source.
For example:
- Data Quality: generates queries based on the rules and runs against the data to get data quality check results.
- Data Profile: analyzes the data in table(s) and generates insights about the structure, content and relationships (such as null percent, cardinality, min/max/mean, etc).
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
DataScanEvent
These messages contain information about the execution of a datascan. The monitored resource is 'DataScan'
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
DataScanJob
A DataScanJob represents an instance of a data scan.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
DataScanType
The type of DataScan.
Values: DATA_SCAN_TYPE_UNSPECIFIED (0): The DataScan Type is unspecified. DATA_QUALITY (1): Data Quality Scan. DATA_PROFILE (2): Data Profile Scan.
DataSource
The data source for DataScan.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
DeleteAssetRequest
Delete asset request.
DeleteContentRequest
Delete content request.
DeleteDataScanRequest
Delete dataScan request.
DeleteEntityRequest
Delete a metadata entity request.
DeleteEnvironmentRequest
Delete environment request.
DeleteLakeRequest
Delete lake request.
DeletePartitionRequest
Delete metadata partition request.
DeleteTaskRequest
Delete task request.
DeleteZoneRequest
Delete zone request.
DiscoveryEvent
The payload associated with Discovery data processing.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Entity
Represents tables and fileset metadata contained within a zone.
Environment
Environment represents a user-visible compute infrastructure for analytics within a lake.
GetAssetRequest
Get asset request.
GetContentRequest
Get content request.
GetDataScanJobRequest
Get DataScanJob request.
GetDataScanRequest
Get dataScan request.
GetEntityRequest
Get metadata entity request.
GetEnvironmentRequest
Get environment request.
GetJobRequest
Get job request.
GetLakeRequest
Get lake request.
GetPartitionRequest
Get metadata partition request.
GetTaskRequest
Get task request.
GetZoneRequest
Get zone request.
Job
A job represents an instance of a task.
JobEvent
The payload associated with Job logs that contains events describing jobs that have run within a Lake.
Lake
A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.
ListActionsResponse
List actions response.
ListAssetActionsRequest
List asset actions request.
ListAssetsRequest
List assets request.
ListAssetsResponse
List assets response.
ListContentRequest
List content request. Returns the BASIC Content view.
ListContentResponse
List content response.
ListDataScanJobsRequest
List DataScanJobs request.
ListDataScanJobsResponse
List DataScanJobs response.
ListDataScansRequest
List dataScans request.
ListDataScansResponse
List dataScans response.
ListEntitiesRequest
List metadata entities request.
ListEntitiesResponse
List metadata entities response.
ListEnvironmentsRequest
List environments request.
ListEnvironmentsResponse
List environments response.
ListJobsRequest
List jobs request.
ListJobsResponse
List jobs response.
ListLakeActionsRequest
List lake actions request.
ListLakesRequest
List lakes request.
ListLakesResponse
List lakes response.
ListPartitionsRequest
List metadata partitions request.
ListPartitionsResponse
List metadata partitions response.
ListSessionsRequest
List sessions request.
ListSessionsResponse
List sessions response.
ListTasksRequest
List tasks request.
ListTasksResponse
List tasks response.
ListZoneActionsRequest
List zone actions request.
ListZonesRequest
List zones request.
ListZonesResponse
List zones response.
OperationMetadata
Represents the metadata of a long-running operation.
Partition
Represents partition metadata contained within entity instances.
RunDataScanRequest
Run DataScan Request
RunDataScanResponse
Run DataScan Response.
ScannedData
The data scanned during processing (e.g. in incremental DataScan)
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Schema
Schema information describing the structure and layout of the data.
Session
Represents an active analyze session running for a user.
SessionEvent
These messages contain information about sessions within an environment. The monitored resource is 'Environment'.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
State
State of a resource.
Values: STATE_UNSPECIFIED (0): State is not specified. ACTIVE (1): Resource is active, i.e., ready to use. CREATING (2): Resource is under creation. DELETING (3): Resource is under deletion. ACTION_REQUIRED (4): Resource is active but has unresolved actions.
StorageFormat
Describes the format of the data within its storage location.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
StorageSystem
Identifies the cloud system that manages the data storage.
Values: STORAGE_SYSTEM_UNSPECIFIED (0): Storage system unspecified. CLOUD_STORAGE (1): The entity data is contained within a Cloud Storage bucket. BIGQUERY (2): The entity data is contained within a BigQuery dataset.
Task
A task represents a user-visible job.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Trigger
DataScan scheduling and trigger settings.
This message has oneof_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
UpdateAssetRequest
Update asset request.
UpdateContentRequest
Update content request.
UpdateDataScanRequest
Update dataScan request.
UpdateEntityRequest
Update a metadata entity request. The exiting entity will be fully replaced by the entity in the request. The entity ID is mutable. To modify the ID, use the current entity ID in the request URL and specify the new ID in the request body.
UpdateEnvironmentRequest
Update environment request.
UpdateLakeRequest
Update lake request.
UpdateTaskRequest
Update task request.
UpdateZoneRequest
Update zone request.
Zone
A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.