Classes
Asset
An asset represents a cloud resource that is being managed within a lake as a member of a zone.
Protobuf type google.events.cloud.dataplex.v1.Asset
Asset.Builder
An asset represents a cloud resource that is being managed within a lake as a member of a zone.
Protobuf type google.events.cloud.dataplex.v1.Asset
Asset.DiscoverySpec
Settings to manage the metadata discovery and publishing for an asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec
Asset.DiscoverySpec.Builder
Settings to manage the metadata discovery and publishing for an asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec
Asset.DiscoverySpec.CsvOptions
Describe CSV and similar semi-structured data formats.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.CsvOptions
Asset.DiscoverySpec.CsvOptions.Builder
Describe CSV and similar semi-structured data formats.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.CsvOptions
Asset.DiscoverySpec.JsonOptions
Describe JSON data format.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.JsonOptions
Asset.DiscoverySpec.JsonOptions.Builder
Describe JSON data format.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoverySpec.JsonOptions
Asset.DiscoveryStatus
Status of discovery for an asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus
Asset.DiscoveryStatus.Builder
Status of discovery for an asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus
Asset.DiscoveryStatus.Stats
The aggregated data statistics for the asset reported by discovery.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus.Stats
Asset.DiscoveryStatus.Stats.Builder
The aggregated data statistics for the asset reported by discovery.
Protobuf type google.events.cloud.dataplex.v1.Asset.DiscoveryStatus.Stats
Asset.ResourceSpec
Identifies the cloud resource that is referenced by this asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceSpec
Asset.ResourceSpec.Builder
Identifies the cloud resource that is referenced by this asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceSpec
Asset.ResourceStatus
Status of the resource referenced by an asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceStatus
Asset.ResourceStatus.Builder
Status of the resource referenced by an asset.
Protobuf type google.events.cloud.dataplex.v1.Asset.ResourceStatus
Asset.SecurityStatus
Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.
Protobuf type google.events.cloud.dataplex.v1.Asset.SecurityStatus
Asset.SecurityStatus.Builder
Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.
Protobuf type google.events.cloud.dataplex.v1.Asset.SecurityStatus
AssetEventData
The data within all Asset events.
Protobuf type google.events.cloud.dataplex.v1.AssetEventData
AssetEventData.Builder
The data within all Asset events.
Protobuf type google.events.cloud.dataplex.v1.AssetEventData
AssetStatus
Aggregated status of the underlying assets of a lake or zone.
Protobuf type google.events.cloud.dataplex.v1.AssetStatus
AssetStatus.Builder
Aggregated status of the underlying assets of a lake or zone.
Protobuf type google.events.cloud.dataplex.v1.AssetStatus
Data
DataAccessSpec
DataAccessSpec holds the access control configuration to be enforced on data stored within resources (eg: rows, columns in BigQuery Tables). When associated with data, the data is only accessible to principals explicitly granted access through the DataAccessSpec. Principals with access to the containing resource are not implicitly granted access.
Protobuf type google.events.cloud.dataplex.v1.DataAccessSpec
DataAccessSpec.Builder
DataAccessSpec holds the access control configuration to be enforced on data stored within resources (eg: rows, columns in BigQuery Tables). When associated with data, the data is only accessible to principals explicitly granted access through the DataAccessSpec. Principals with access to the containing resource are not implicitly granted access.
Protobuf type google.events.cloud.dataplex.v1.DataAccessSpec
DataAttribute
Denotes one dataAttribute in a dataTaxonomy, for example, PII.
DataAttribute resources can be defined in a hierarchy.
A single dataAttribute resource can contain specs of multiple types
`
PII
- ResourceAccessSpec :
- readers :foo@bar.com
- DataAccessSpec :
- readers :bar@foo.com
Protobuf type google.events.cloud.dataplex.v1.DataAttribute
DataAttribute.Builder
Denotes one dataAttribute in a dataTaxonomy, for example, PII.
DataAttribute resources can be defined in a hierarchy.
A single dataAttribute resource can contain specs of multiple types
`
PII
- ResourceAccessSpec :
- readers :foo@bar.com
- DataAccessSpec :
- readers :bar@foo.com
Protobuf type google.events.cloud.dataplex.v1.DataAttribute
DataAttributeBinding
DataAttributeBinding represents binding of attributes to resources. Eg: Bind 'CustomerInfo' entity with 'PII' attribute.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding
DataAttributeBinding.Builder
DataAttributeBinding represents binding of attributes to resources. Eg: Bind 'CustomerInfo' entity with 'PII' attribute.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding
DataAttributeBinding.Path
Represents a subresource of a given resource, and associated bindings with it.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding.Path
DataAttributeBinding.Path.Builder
Represents a subresource of a given resource, and associated bindings with it.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeBinding.Path
DataAttributeBindingEventData
The data within all DataAttributeBinding events.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeBindingEventData
DataAttributeBindingEventData.Builder
The data within all DataAttributeBinding events.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeBindingEventData
DataAttributeEventData
The data within all DataAttribute events.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeEventData
DataAttributeEventData.Builder
The data within all DataAttribute events.
Protobuf type google.events.cloud.dataplex.v1.DataAttributeEventData
DataProfileResult
DataProfileResult defines the output of DataProfileScan. Each field of the table will have field type specific profile result.
Protobuf type google.events.cloud.dataplex.v1.DataProfileResult
DataProfileResult.Builder
DataProfileResult defines the output of DataProfileScan. Each field of the table will have field type specific profile result.
Protobuf type google.events.cloud.dataplex.v1.DataProfileResult
DataProfileResult.Profile
Contains name, type, mode and field type specific profile information.
Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile
DataProfileResult.Profile.Builder
Contains name, type, mode and field type specific profile information.
Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile
DataProfileResult.Profile.Field
A field within a table.
Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field
DataProfileResult.Profile.Field.Builder
A field within a table.
Protobuf type google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field
DataProfileResult.Profile.Field.ProfileInfo
The profile information for each field type.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo
DataProfileResult.Profile.Field.ProfileInfo.Builder
The profile information for each field type.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo
DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo
The profile information for a double type field.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo
DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo.Builder
The profile information for a double type field.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfo
DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo
The profile information for an integer type field.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo
DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo.Builder
The profile information for an integer type field.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfo
DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo
The profile information for a string type field.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo
DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo.Builder
The profile information for a string type field.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfo
DataProfileResult.Profile.Field.ProfileInfo.TopNValue
Top N non-null values in the scanned data.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.TopNValue
DataProfileResult.Profile.Field.ProfileInfo.TopNValue.Builder
Top N non-null values in the scanned data.
Protobuf type
google.events.cloud.dataplex.v1.DataProfileResult.Profile.Field.ProfileInfo.TopNValue
DataProfileSpec
DataProfileScan related setting.
Protobuf type google.events.cloud.dataplex.v1.DataProfileSpec
DataProfileSpec.Builder
DataProfileScan related setting.
Protobuf type google.events.cloud.dataplex.v1.DataProfileSpec
DataQualityDimensionResult
DataQualityDimensionResult provides a more detailed, per-dimension view of the results.
Protobuf type google.events.cloud.dataplex.v1.DataQualityDimensionResult
DataQualityDimensionResult.Builder
DataQualityDimensionResult provides a more detailed, per-dimension view of the results.
Protobuf type google.events.cloud.dataplex.v1.DataQualityDimensionResult
DataQualityResult
The output of a DataQualityScan.
Protobuf type google.events.cloud.dataplex.v1.DataQualityResult
DataQualityResult.Builder
The output of a DataQualityScan.
Protobuf type google.events.cloud.dataplex.v1.DataQualityResult
DataQualityRule
A rule captures data quality intent about a data source.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule
DataQualityRule.Builder
A rule captures data quality intent about a data source.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule
DataQualityRule.NonNullExpectation
Evaluates whether each column value is null.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.NonNullExpectation
DataQualityRule.NonNullExpectation.Builder
Evaluates whether each column value is null.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.NonNullExpectation
DataQualityRule.RangeExpectation
Evaluates whether each column value lies between a specified range.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RangeExpectation
DataQualityRule.RangeExpectation.Builder
Evaluates whether each column value lies between a specified range.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RangeExpectation
DataQualityRule.RegexExpectation
Evaluates whether each column value matches a specified regex.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RegexExpectation
DataQualityRule.RegexExpectation.Builder
Evaluates whether each column value matches a specified regex.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RegexExpectation
DataQualityRule.RowConditionExpectation
Evaluates whether each row passes the specified condition. The SQL expression needs to use BigQuery standard SQL syntax and should produce a boolean value per row as the result. Example: col1 >= 0 AND col2 < 10
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RowConditionExpectation
DataQualityRule.RowConditionExpectation.Builder
Evaluates whether each row passes the specified condition. The SQL expression needs to use BigQuery standard SQL syntax and should produce a boolean value per row as the result. Example: col1 >= 0 AND col2 < 10
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.RowConditionExpectation
DataQualityRule.SetExpectation
Evaluates whether each column value is contained by a specified set.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.SetExpectation
DataQualityRule.SetExpectation.Builder
Evaluates whether each column value is contained by a specified set.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.SetExpectation
DataQualityRule.StatisticRangeExpectation
Evaluates whether the column aggregate statistic lies between a specified range.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.StatisticRangeExpectation
DataQualityRule.StatisticRangeExpectation.Builder
Evaluates whether the column aggregate statistic lies between a specified range.
Protobuf type
google.events.cloud.dataplex.v1.DataQualityRule.StatisticRangeExpectation
DataQualityRule.TableConditionExpectation
Evaluates whether the provided expression is true. The SQL expression needs to use BigQuery standard SQL syntax and should produce a scalar boolean result. Example: MIN(col1) >= 0
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.TableConditionExpectation
DataQualityRule.TableConditionExpectation.Builder
Evaluates whether the provided expression is true. The SQL expression needs to use BigQuery standard SQL syntax and should produce a scalar boolean result. Example: MIN(col1) >= 0
Protobuf type
google.events.cloud.dataplex.v1.DataQualityRule.TableConditionExpectation
DataQualityRule.UniquenessExpectation
Evaluates whether the column has duplicates.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.UniquenessExpectation
DataQualityRule.UniquenessExpectation.Builder
Evaluates whether the column has duplicates.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRule.UniquenessExpectation
DataQualityRuleResult
DataQualityRuleResult provides a more detailed, per-rule view of the results.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRuleResult
DataQualityRuleResult.Builder
DataQualityRuleResult provides a more detailed, per-rule view of the results.
Protobuf type google.events.cloud.dataplex.v1.DataQualityRuleResult
DataQualitySpec
DataQualityScan related setting.
Protobuf type google.events.cloud.dataplex.v1.DataQualitySpec
DataQualitySpec.Builder
DataQualityScan related setting.
Protobuf type google.events.cloud.dataplex.v1.DataQualitySpec
DataScan
Represents a user-visible job which provides the insights for the related data source. For example:
- Data Quality: generates queries based on the rules and runs against the data to get data quality check results.
- Data Profile: analyzes the data in table(s) and generates insights about the structure, content and relationships (such as null percent, cardinality, min/max/mean, etc).
Protobuf type google.events.cloud.dataplex.v1.DataScan
DataScan.Builder
Represents a user-visible job which provides the insights for the related data source. For example:
- Data Quality: generates queries based on the rules and runs against the data to get data quality check results.
- Data Profile: analyzes the data in table(s) and generates insights about the structure, content and relationships (such as null percent, cardinality, min/max/mean, etc).
Protobuf type google.events.cloud.dataplex.v1.DataScan
DataScan.ExecutionSpec
DataScan execution settings.
Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionSpec
DataScan.ExecutionSpec.Builder
DataScan execution settings.
Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionSpec
DataScan.ExecutionStatus
Status of the data scan execution.
Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionStatus
DataScan.ExecutionStatus.Builder
Status of the data scan execution.
Protobuf type google.events.cloud.dataplex.v1.DataScan.ExecutionStatus
DataScanEventData
The data within all DataScan events.
Protobuf type google.events.cloud.dataplex.v1.DataScanEventData
DataScanEventData.Builder
The data within all DataScan events.
Protobuf type google.events.cloud.dataplex.v1.DataScanEventData
DataSource
The data source for DataScan.
Protobuf type google.events.cloud.dataplex.v1.DataSource
DataSource.Builder
The data source for DataScan.
Protobuf type google.events.cloud.dataplex.v1.DataSource
DataTaxonomy
DataTaxonomy represents a set of hierarchical DataAttributes resources, grouped with a common theme Eg: 'SensitiveDataTaxonomy' can have attributes to manage PII data. It is defined at project level.
Protobuf type google.events.cloud.dataplex.v1.DataTaxonomy
DataTaxonomy.Builder
DataTaxonomy represents a set of hierarchical DataAttributes resources, grouped with a common theme Eg: 'SensitiveDataTaxonomy' can have attributes to manage PII data. It is defined at project level.
Protobuf type google.events.cloud.dataplex.v1.DataTaxonomy
DataTaxonomyEventData
The data within all DataTaxonomy events.
Protobuf type google.events.cloud.dataplex.v1.DataTaxonomyEventData
DataTaxonomyEventData.Builder
The data within all DataTaxonomy events.
Protobuf type google.events.cloud.dataplex.v1.DataTaxonomyEventData
Environment
Environment represents a user-visible compute infrastructure for analytics within a lake.
Protobuf type google.events.cloud.dataplex.v1.Environment
Environment.Builder
Environment represents a user-visible compute infrastructure for analytics within a lake.
Protobuf type google.events.cloud.dataplex.v1.Environment
Environment.Endpoints
URI Endpoints to access sessions associated with the Environment.
Protobuf type google.events.cloud.dataplex.v1.Environment.Endpoints
Environment.Endpoints.Builder
URI Endpoints to access sessions associated with the Environment.
Protobuf type google.events.cloud.dataplex.v1.Environment.Endpoints
Environment.InfrastructureSpec
Configuration for the underlying infrastructure used to run workloads.
Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec
Environment.InfrastructureSpec.Builder
Configuration for the underlying infrastructure used to run workloads.
Protobuf type google.events.cloud.dataplex.v1.Environment.InfrastructureSpec
Environment.InfrastructureSpec.ComputeResources
Compute resources associated with the analyze interactive workloads.
Protobuf type
google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.ComputeResources
Environment.InfrastructureSpec.ComputeResources.Builder
Compute resources associated with the analyze interactive workloads.
Protobuf type
google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.ComputeResources
Environment.InfrastructureSpec.OsImageRuntime
Software Runtime Configuration to run Analyze.
Protobuf type
google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.OsImageRuntime
Environment.InfrastructureSpec.OsImageRuntime.Builder
Software Runtime Configuration to run Analyze.
Protobuf type
google.events.cloud.dataplex.v1.Environment.InfrastructureSpec.OsImageRuntime
Environment.SessionSpec
Configuration for sessions created for this environment.
Protobuf type google.events.cloud.dataplex.v1.Environment.SessionSpec
Environment.SessionSpec.Builder
Configuration for sessions created for this environment.
Protobuf type google.events.cloud.dataplex.v1.Environment.SessionSpec
Environment.SessionStatus
Status of sessions created for this environment.
Protobuf type google.events.cloud.dataplex.v1.Environment.SessionStatus
Environment.SessionStatus.Builder
Status of sessions created for this environment.
Protobuf type google.events.cloud.dataplex.v1.Environment.SessionStatus
EnvironmentEventData
The data within all Environment events.
Protobuf type google.events.cloud.dataplex.v1.EnvironmentEventData
EnvironmentEventData.Builder
The data within all Environment events.
Protobuf type google.events.cloud.dataplex.v1.EnvironmentEventData
Job
A job represents an instance of a task.
Protobuf type google.events.cloud.dataplex.v1.Job
Job.Builder
A job represents an instance of a task.
Protobuf type google.events.cloud.dataplex.v1.Job
Lake
A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.
Protobuf type google.events.cloud.dataplex.v1.Lake
Lake.Builder
A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.
Protobuf type google.events.cloud.dataplex.v1.Lake
Lake.Metastore
Settings to manage association of Dataproc Metastore with a lake.
Protobuf type google.events.cloud.dataplex.v1.Lake.Metastore
Lake.Metastore.Builder
Settings to manage association of Dataproc Metastore with a lake.
Protobuf type google.events.cloud.dataplex.v1.Lake.Metastore
Lake.MetastoreStatus
Status of Lake and Dataproc Metastore service instance association.
Protobuf type google.events.cloud.dataplex.v1.Lake.MetastoreStatus
Lake.MetastoreStatus.Builder
Status of Lake and Dataproc Metastore service instance association.
Protobuf type google.events.cloud.dataplex.v1.Lake.MetastoreStatus
LakeEventData
The data within all Lake events.
Protobuf type google.events.cloud.dataplex.v1.LakeEventData
LakeEventData.Builder
The data within all Lake events.
Protobuf type google.events.cloud.dataplex.v1.LakeEventData
ResourceAccessSpec
ResourceAccessSpec holds the access control configuration to be enforced on the resources, for example, Cloud Storage bucket, BigQuery dataset, BigQuery table.
Protobuf type google.events.cloud.dataplex.v1.ResourceAccessSpec
ResourceAccessSpec.Builder
ResourceAccessSpec holds the access control configuration to be enforced on the resources, for example, Cloud Storage bucket, BigQuery dataset, BigQuery table.
Protobuf type google.events.cloud.dataplex.v1.ResourceAccessSpec
ScannedData
The data scanned during processing (e.g. in incremental DataScan)
Protobuf type google.events.cloud.dataplex.v1.ScannedData
ScannedData.Builder
The data scanned during processing (e.g. in incremental DataScan)
Protobuf type google.events.cloud.dataplex.v1.ScannedData
ScannedData.IncrementalField
A data range denoted by a pair of start/end values of a field.
Protobuf type google.events.cloud.dataplex.v1.ScannedData.IncrementalField
ScannedData.IncrementalField.Builder
A data range denoted by a pair of start/end values of a field.
Protobuf type google.events.cloud.dataplex.v1.ScannedData.IncrementalField
Task
A task represents a user-visible job.
Protobuf type google.events.cloud.dataplex.v1.Task
Task.Builder
A task represents a user-visible job.
Protobuf type google.events.cloud.dataplex.v1.Task
Task.ExecutionSpec
Execution related settings, like retry and service_account.
Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionSpec
Task.ExecutionSpec.Builder
Execution related settings, like retry and service_account.
Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionSpec
Task.ExecutionStatus
Status of the task execution (e.g. Jobs).
Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionStatus
Task.ExecutionStatus.Builder
Status of the task execution (e.g. Jobs).
Protobuf type google.events.cloud.dataplex.v1.Task.ExecutionStatus
Task.InfrastructureSpec
Configuration for the underlying infrastructure used to run workloads.
Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec
Task.InfrastructureSpec.BatchComputeResources
Batch compute resources associated with the task.
Protobuf type
google.events.cloud.dataplex.v1.Task.InfrastructureSpec.BatchComputeResources
Task.InfrastructureSpec.BatchComputeResources.Builder
Batch compute resources associated with the task.
Protobuf type
google.events.cloud.dataplex.v1.Task.InfrastructureSpec.BatchComputeResources
Task.InfrastructureSpec.Builder
Configuration for the underlying infrastructure used to run workloads.
Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec
Task.InfrastructureSpec.ContainerImageRuntime
Container Image Runtime Configuration used with Batch execution.
Protobuf type
google.events.cloud.dataplex.v1.Task.InfrastructureSpec.ContainerImageRuntime
Task.InfrastructureSpec.ContainerImageRuntime.Builder
Container Image Runtime Configuration used with Batch execution.
Protobuf type
google.events.cloud.dataplex.v1.Task.InfrastructureSpec.ContainerImageRuntime
Task.InfrastructureSpec.VpcNetwork
Cloud VPC Network used to run the infrastructure.
Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.VpcNetwork
Task.InfrastructureSpec.VpcNetwork.Builder
Cloud VPC Network used to run the infrastructure.
Protobuf type google.events.cloud.dataplex.v1.Task.InfrastructureSpec.VpcNetwork
Task.NotebookTaskConfig
Config for running scheduled notebooks.
Protobuf type google.events.cloud.dataplex.v1.Task.NotebookTaskConfig
Task.NotebookTaskConfig.Builder
Config for running scheduled notebooks.
Protobuf type google.events.cloud.dataplex.v1.Task.NotebookTaskConfig
Task.SparkTaskConfig
User-specified config for running a Spark task.
Protobuf type google.events.cloud.dataplex.v1.Task.SparkTaskConfig
Task.SparkTaskConfig.Builder
User-specified config for running a Spark task.
Protobuf type google.events.cloud.dataplex.v1.Task.SparkTaskConfig
Task.TriggerSpec
Task scheduling and trigger settings.
Protobuf type google.events.cloud.dataplex.v1.Task.TriggerSpec
Task.TriggerSpec.Builder
Task scheduling and trigger settings.
Protobuf type google.events.cloud.dataplex.v1.Task.TriggerSpec
TaskEventData
The data within all Task events.
Protobuf type google.events.cloud.dataplex.v1.TaskEventData
TaskEventData.Builder
The data within all Task events.
Protobuf type google.events.cloud.dataplex.v1.TaskEventData
Trigger
DataScan scheduling and trigger settings.
Protobuf type google.events.cloud.dataplex.v1.Trigger
Trigger.Builder
DataScan scheduling and trigger settings.
Protobuf type google.events.cloud.dataplex.v1.Trigger
Trigger.OnDemand
The scan runs once via RunDataScan API.
Protobuf type google.events.cloud.dataplex.v1.Trigger.OnDemand
Trigger.OnDemand.Builder
The scan runs once via RunDataScan API.
Protobuf type google.events.cloud.dataplex.v1.Trigger.OnDemand
Trigger.Schedule
The scan is scheduled to run periodically.
Protobuf type google.events.cloud.dataplex.v1.Trigger.Schedule
Trigger.Schedule.Builder
The scan is scheduled to run periodically.
Protobuf type google.events.cloud.dataplex.v1.Trigger.Schedule
Zone
A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.
Protobuf type google.events.cloud.dataplex.v1.Zone
Zone.Builder
A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.
Protobuf type google.events.cloud.dataplex.v1.Zone
Zone.DiscoverySpec
Settings to manage the metadata discovery and publishing in a zone.
Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec
Zone.DiscoverySpec.Builder
Settings to manage the metadata discovery and publishing in a zone.
Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec
Zone.DiscoverySpec.CsvOptions
Describe CSV and similar semi-structured data formats.
Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.CsvOptions
Zone.DiscoverySpec.CsvOptions.Builder
Describe CSV and similar semi-structured data formats.
Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.CsvOptions
Zone.DiscoverySpec.JsonOptions
Describe JSON data format.
Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.JsonOptions
Zone.DiscoverySpec.JsonOptions.Builder
Describe JSON data format.
Protobuf type google.events.cloud.dataplex.v1.Zone.DiscoverySpec.JsonOptions
Zone.ResourceSpec
Settings for resources attached as assets within a zone.
Protobuf type google.events.cloud.dataplex.v1.Zone.ResourceSpec
Zone.ResourceSpec.Builder
Settings for resources attached as assets within a zone.
Protobuf type google.events.cloud.dataplex.v1.Zone.ResourceSpec
ZoneEventData
The data within all Zone events.
Protobuf type google.events.cloud.dataplex.v1.ZoneEventData
ZoneEventData.Builder
The data within all Zone events.
Protobuf type google.events.cloud.dataplex.v1.ZoneEventData
Interfaces
Asset.DiscoverySpec.CsvOptionsOrBuilder
Asset.DiscoverySpec.JsonOptionsOrBuilder
Asset.DiscoverySpecOrBuilder
Asset.DiscoveryStatus.StatsOrBuilder
Asset.DiscoveryStatusOrBuilder
Asset.ResourceSpecOrBuilder
Asset.ResourceStatusOrBuilder
Asset.SecurityStatusOrBuilder
AssetEventDataOrBuilder
AssetOrBuilder
AssetStatusOrBuilder
DataAccessSpecOrBuilder
DataAttributeBinding.PathOrBuilder
DataAttributeBindingEventDataOrBuilder
DataAttributeBindingOrBuilder
DataAttributeEventDataOrBuilder
DataAttributeOrBuilder
DataProfileResult.Profile.Field.ProfileInfo.DoubleFieldInfoOrBuilder
DataProfileResult.Profile.Field.ProfileInfo.IntegerFieldInfoOrBuilder
DataProfileResult.Profile.Field.ProfileInfo.StringFieldInfoOrBuilder
DataProfileResult.Profile.Field.ProfileInfo.TopNValueOrBuilder
DataProfileResult.Profile.Field.ProfileInfoOrBuilder
DataProfileResult.Profile.FieldOrBuilder
DataProfileResult.ProfileOrBuilder
DataProfileResultOrBuilder
DataProfileSpecOrBuilder
DataQualityDimensionResultOrBuilder
DataQualityResultOrBuilder
DataQualityRule.NonNullExpectationOrBuilder
DataQualityRule.RangeExpectationOrBuilder
DataQualityRule.RegexExpectationOrBuilder
DataQualityRule.RowConditionExpectationOrBuilder
DataQualityRule.SetExpectationOrBuilder
DataQualityRule.StatisticRangeExpectationOrBuilder
DataQualityRule.TableConditionExpectationOrBuilder
DataQualityRule.UniquenessExpectationOrBuilder
DataQualityRuleOrBuilder
DataQualityRuleResultOrBuilder
DataQualitySpecOrBuilder
DataScan.ExecutionSpecOrBuilder
DataScan.ExecutionStatusOrBuilder
DataScanEventDataOrBuilder
DataScanOrBuilder
DataSourceOrBuilder
DataTaxonomyEventDataOrBuilder
DataTaxonomyOrBuilder
Environment.EndpointsOrBuilder
Environment.InfrastructureSpec.ComputeResourcesOrBuilder
Environment.InfrastructureSpec.OsImageRuntimeOrBuilder
Environment.InfrastructureSpecOrBuilder
Environment.SessionSpecOrBuilder
Environment.SessionStatusOrBuilder
EnvironmentEventDataOrBuilder
EnvironmentOrBuilder
JobOrBuilder
Lake.MetastoreOrBuilder
Lake.MetastoreStatusOrBuilder
LakeEventDataOrBuilder
LakeOrBuilder
ResourceAccessSpecOrBuilder
ScannedData.IncrementalFieldOrBuilder
ScannedDataOrBuilder
Task.ExecutionSpecOrBuilder
Task.ExecutionStatusOrBuilder
Task.InfrastructureSpec.BatchComputeResourcesOrBuilder
Task.InfrastructureSpec.ContainerImageRuntimeOrBuilder
Task.InfrastructureSpec.VpcNetworkOrBuilder
Task.InfrastructureSpecOrBuilder
Task.NotebookTaskConfigOrBuilder
Task.SparkTaskConfigOrBuilder
Task.TriggerSpecOrBuilder
TaskEventDataOrBuilder
TaskOrBuilder
Trigger.OnDemandOrBuilder
Trigger.ScheduleOrBuilder
TriggerOrBuilder
Zone.DiscoverySpec.CsvOptionsOrBuilder
Zone.DiscoverySpec.JsonOptionsOrBuilder
Zone.DiscoverySpecOrBuilder
Zone.ResourceSpecOrBuilder
ZoneEventDataOrBuilder
ZoneOrBuilder
Enums
Asset.DiscoverySpec.TriggerCase
Asset.DiscoveryStatus.State
Current state of discovery.
Protobuf enum google.events.cloud.dataplex.v1.Asset.DiscoveryStatus.State
Asset.ResourceSpec.AccessMode
Access Mode determines how data stored within the resource is read. This is only applicable to storage bucket assets.
Protobuf enum google.events.cloud.dataplex.v1.Asset.ResourceSpec.AccessMode
Asset.ResourceSpec.Type
Type of resource.
Protobuf enum google.events.cloud.dataplex.v1.Asset.ResourceSpec.Type
Asset.ResourceStatus.State
The state of a resource.
Protobuf enum google.events.cloud.dataplex.v1.Asset.ResourceStatus.State
Asset.SecurityStatus.State
The state of the security policy.
Protobuf enum google.events.cloud.dataplex.v1.Asset.SecurityStatus.State
DataAttributeBinding.ResourceReferenceCase
DataProfileResult.Profile.Field.ProfileInfo.FieldInfoCase
DataQualityRule.RuleTypeCase
DataQualityRule.StatisticRangeExpectation.ColumnStatistic
Protobuf enum
google.events.cloud.dataplex.v1.DataQualityRule.StatisticRangeExpectation.ColumnStatistic
DataScan.ExecutionSpec.IncrementalCase
DataScan.ResultCase
DataScan.SpecCase
DataScanType
The type of DataScan.
Protobuf enum google.events.cloud.dataplex.v1.DataScanType
DataSource.SourceCase
Environment.InfrastructureSpec.ResourcesCase
Environment.InfrastructureSpec.RuntimeCase
Job.Service
Protobuf enum google.events.cloud.dataplex.v1.Job.Service
Job.State
Protobuf enum google.events.cloud.dataplex.v1.Job.State
Lake.MetastoreStatus.State
Current state of association.
Protobuf enum google.events.cloud.dataplex.v1.Lake.MetastoreStatus.State
ScannedData.DataRangeCase
State
State of a resource.
Protobuf enum google.events.cloud.dataplex.v1.State
Task.ConfigCase
Task.InfrastructureSpec.NetworkCase
Task.InfrastructureSpec.ResourcesCase
Task.InfrastructureSpec.RuntimeCase
Task.InfrastructureSpec.VpcNetwork.NetworkNameCase
Task.SparkTaskConfig.DriverCase
Task.TriggerSpec.TriggerCase
Task.TriggerSpec.Type
Determines how often and when the job will run.
Protobuf enum google.events.cloud.dataplex.v1.Task.TriggerSpec.Type
Trigger.ModeCase
Zone.DiscoverySpec.TriggerCase
Zone.ResourceSpec.LocationType
Location type of the resources attached to a zone.
Protobuf enum google.events.cloud.dataplex.v1.Zone.ResourceSpec.LocationType
Zone.Type
Type of zone.
Protobuf enum google.events.cloud.dataplex.v1.Zone.Type