Package com.google.cloud.dataplex.v1 (1.0.1)

A client to Cloud Dataplex API

The interfaces provided are listed below, along with usage samples.

ContentServiceClient

Service Description: ContentService manages Notebook and SQL Scripts for Dataplex.

Sample for ContentServiceClient:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 try (ContentServiceClient contentServiceClient = ContentServiceClient.create()) {
   LakeName parent = LakeName.of("[PROJECT]", "[LOCATION]", "[LAKE]");
   Content content = Content.newBuilder().build();
   Content response = contentServiceClient.createContent(parent, content);
 }

MetadataServiceClient

Service Description: Metadata service manages metadata resources such as tables, filesets and partitions.

Sample for MetadataServiceClient:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 try (MetadataServiceClient metadataServiceClient = MetadataServiceClient.create()) {
   ZoneName parent = ZoneName.of("[PROJECT]", "[LOCATION]", "[LAKE]", "[ZONE]");
   Entity entity = Entity.newBuilder().build();
   Entity response = metadataServiceClient.createEntity(parent, entity);
 }

DataplexServiceClient

Service Description: Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

Sample for DataplexServiceClient:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 try (DataplexServiceClient dataplexServiceClient = DataplexServiceClient.create()) {
   LakeName name = LakeName.of("[PROJECT]", "[LOCATION]", "[LAKE]");
   Lake response = dataplexServiceClient.getLake(name);
 }

Classes

Action

Action represents an issue requiring administrator action for resolution.

Protobuf type google.cloud.dataplex.v1.Action

Action.Builder

Action represents an issue requiring administrator action for resolution.

Protobuf type google.cloud.dataplex.v1.Action

Action.FailedSecurityPolicyApply

Failed to apply security policy to the managed resource(s) under a lake, zone or an asset. For a lake or zone resource, one or more underlying assets has a failure applying security policy to the associated managed resource.

Protobuf type google.cloud.dataplex.v1.Action.FailedSecurityPolicyApply

Action.FailedSecurityPolicyApply.Builder

Failed to apply security policy to the managed resource(s) under a lake, zone or an asset. For a lake or zone resource, one or more underlying assets has a failure applying security policy to the associated managed resource.

Protobuf type google.cloud.dataplex.v1.Action.FailedSecurityPolicyApply

Action.IncompatibleDataSchema

Action details for incompatible schemas detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.IncompatibleDataSchema

Action.IncompatibleDataSchema.Builder

Action details for incompatible schemas detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.IncompatibleDataSchema

Action.InvalidDataFormat

Action details for invalid or unsupported data files detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.InvalidDataFormat

Action.InvalidDataFormat.Builder

Action details for invalid or unsupported data files detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.InvalidDataFormat

Action.InvalidDataOrganization

Action details for invalid data arrangement.

Protobuf type google.cloud.dataplex.v1.Action.InvalidDataOrganization

Action.InvalidDataOrganization.Builder

Action details for invalid data arrangement.

Protobuf type google.cloud.dataplex.v1.Action.InvalidDataOrganization

Action.InvalidDataPartition

Action details for invalid or unsupported partitions detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.InvalidDataPartition

Action.InvalidDataPartition.Builder

Action details for invalid or unsupported partitions detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.InvalidDataPartition

Action.MissingData

Action details for absence of data detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.MissingData

Action.MissingData.Builder

Action details for absence of data detected by discovery.

Protobuf type google.cloud.dataplex.v1.Action.MissingData

Action.MissingResource

Action details for resource references in assets that cannot be located.

Protobuf type google.cloud.dataplex.v1.Action.MissingResource

Action.MissingResource.Builder

Action details for resource references in assets that cannot be located.

Protobuf type google.cloud.dataplex.v1.Action.MissingResource

Action.UnauthorizedResource

Action details for unauthorized resource issues raised to indicate that the service account associated with the lake instance is not authorized to access or manage the resource associated with an asset.

Protobuf type google.cloud.dataplex.v1.Action.UnauthorizedResource

Action.UnauthorizedResource.Builder

Action details for unauthorized resource issues raised to indicate that the service account associated with the lake instance is not authorized to access or manage the resource associated with an asset.

Protobuf type google.cloud.dataplex.v1.Action.UnauthorizedResource

AnalyzeProto

Asset

An asset represents a cloud resource that is being managed within a lake as a member of a zone.

Protobuf type google.cloud.dataplex.v1.Asset

Asset.Builder

An asset represents a cloud resource that is being managed within a lake as a member of a zone.

Protobuf type google.cloud.dataplex.v1.Asset

Asset.DiscoverySpec

Settings to manage the metadata discovery and publishing for an asset.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoverySpec

Asset.DiscoverySpec.Builder

Settings to manage the metadata discovery and publishing for an asset.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoverySpec

Asset.DiscoverySpec.CsvOptions

Describe CSV and similar semi-structured data formats.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoverySpec.CsvOptions

Asset.DiscoverySpec.CsvOptions.Builder

Describe CSV and similar semi-structured data formats.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoverySpec.CsvOptions

Asset.DiscoverySpec.JsonOptions

Describe JSON data format.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoverySpec.JsonOptions

Asset.DiscoverySpec.JsonOptions.Builder

Describe JSON data format.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoverySpec.JsonOptions

Asset.DiscoveryStatus

Status of discovery for an asset.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoveryStatus

Asset.DiscoveryStatus.Builder

Status of discovery for an asset.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoveryStatus

Asset.DiscoveryStatus.Stats

The aggregated data statistics for the asset reported by discovery.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoveryStatus.Stats

Asset.DiscoveryStatus.Stats.Builder

The aggregated data statistics for the asset reported by discovery.

Protobuf type google.cloud.dataplex.v1.Asset.DiscoveryStatus.Stats

Asset.ResourceSpec

Identifies the cloud resource that is referenced by this asset.

Protobuf type google.cloud.dataplex.v1.Asset.ResourceSpec

Asset.ResourceSpec.Builder

Identifies the cloud resource that is referenced by this asset.

Protobuf type google.cloud.dataplex.v1.Asset.ResourceSpec

Asset.ResourceStatus

Status of the resource referenced by an asset.

Protobuf type google.cloud.dataplex.v1.Asset.ResourceStatus

Asset.ResourceStatus.Builder

Status of the resource referenced by an asset.

Protobuf type google.cloud.dataplex.v1.Asset.ResourceStatus

Asset.SecurityStatus

Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.

Protobuf type google.cloud.dataplex.v1.Asset.SecurityStatus

Asset.SecurityStatus.Builder

Security policy status of the asset. Data security policy, i.e., readers, writers & owners, should be specified in the lake/zone/asset IAM policy.

Protobuf type google.cloud.dataplex.v1.Asset.SecurityStatus

AssetName

AssetName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/zones/{zone}/assets/{asset}.

AssetStatus

Aggregated status of the underlying assets of a lake or zone.

Protobuf type google.cloud.dataplex.v1.AssetStatus

AssetStatus.Builder

Aggregated status of the underlying assets of a lake or zone.

Protobuf type google.cloud.dataplex.v1.AssetStatus

CancelJobRequest

Cancel task jobs.

Protobuf type google.cloud.dataplex.v1.CancelJobRequest

CancelJobRequest.Builder

Cancel task jobs.

Protobuf type google.cloud.dataplex.v1.CancelJobRequest

Content

Content represents a user-visible notebook or a sql script

Protobuf type google.cloud.dataplex.v1.Content

Content.Builder

Content represents a user-visible notebook or a sql script

Protobuf type google.cloud.dataplex.v1.Content

Content.Notebook

Configuration for Notebook content.

Protobuf type google.cloud.dataplex.v1.Content.Notebook

Content.Notebook.Builder

Configuration for Notebook content.

Protobuf type google.cloud.dataplex.v1.Content.Notebook

Content.SqlScript

Configuration for the Sql Script content.

Protobuf type google.cloud.dataplex.v1.Content.SqlScript

Content.SqlScript.Builder

Configuration for the Sql Script content.

Protobuf type google.cloud.dataplex.v1.Content.SqlScript

ContentName

ContentName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/content/{content}.

ContentProto

ContentServiceClient

Service Description: ContentService manages Notebook and SQL Scripts for Dataplex.

This class provides the ability to make remote calls to the backing service through method calls that map to API methods. Sample code to get started:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 try (ContentServiceClient contentServiceClient = ContentServiceClient.create()) {
   LakeName parent = LakeName.of("[PROJECT]", "[LOCATION]", "[LAKE]");
   Content content = Content.newBuilder().build();
   Content response = contentServiceClient.createContent(parent, content);
 }

Note: close() needs to be called on the ContentServiceClient object to clean up resources such as threads. In the example above, try-with-resources is used, which automatically calls close().

The surface of this class includes several types of Java methods for each of the API's methods:

  1. A "flattened" method. With this type of method, the fields of the request type have been converted into function parameters. It may be the case that not all fields are available as parameters, and not every API method will have a flattened method entry point.
  2. A "request object" method. This type of method only takes one parameter, a request object, which must be constructed before the call. Not every API method will have a request object method.
  3. A "callable" method. This type of method takes no parameters and returns an immutable API callable object, which can be used to initiate calls to the service.

See the individual methods for example code.

Many parameters require resource names to be formatted in a particular way. To assist with these names, this class includes a format method for each type of name, and additionally a parse method to extract the individual identifiers contained within names that are returned.

This class can be customized by passing in a custom instance of ContentServiceSettings to create(). For example:

To customize credentials:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 ContentServiceSettings contentServiceSettings =
     ContentServiceSettings.newBuilder()
         .setCredentialsProvider(FixedCredentialsProvider.create(myCredentials))
         .build();
 ContentServiceClient contentServiceClient = ContentServiceClient.create(contentServiceSettings);

To customize the endpoint:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 ContentServiceSettings contentServiceSettings =
     ContentServiceSettings.newBuilder().setEndpoint(myEndpoint).build();
 ContentServiceClient contentServiceClient = ContentServiceClient.create(contentServiceSettings);

Please refer to the GitHub repository's samples for more quickstart code snippets.

ContentServiceClient.ListContentFixedSizeCollection

ContentServiceClient.ListContentPage

ContentServiceClient.ListContentPagedResponse

ContentServiceGrpc

ContentService manages Notebook and SQL Scripts for Dataplex.

ContentServiceGrpc.ContentServiceBlockingStub

ContentService manages Notebook and SQL Scripts for Dataplex.

ContentServiceGrpc.ContentServiceFutureStub

ContentService manages Notebook and SQL Scripts for Dataplex.

ContentServiceGrpc.ContentServiceImplBase

ContentService manages Notebook and SQL Scripts for Dataplex.

ContentServiceGrpc.ContentServiceStub

ContentService manages Notebook and SQL Scripts for Dataplex.

ContentServiceSettings

Settings class to configure an instance of ContentServiceClient.

The default instance has everything set to sensible defaults:

  • The default service address (dataplex.googleapis.com) and default port (443) are used.
  • Credentials are acquired automatically through Application Default Credentials.
  • Retries are configured for idempotent methods but not for non-idempotent methods.

The builder of this class is recursive, so contained classes are themselves builders. When build() is called, the tree of builders is called to create the complete settings object.

For example, to set the total timeout of createContent to 30 seconds:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 ContentServiceSettings.Builder contentServiceSettingsBuilder =
     ContentServiceSettings.newBuilder();
 contentServiceSettingsBuilder
     .createContentSettings()
     .setRetrySettings(
         contentServiceSettingsBuilder
             .createContentSettings()
             .getRetrySettings()
             .toBuilder()
             .setTotalTimeout(Duration.ofSeconds(30))
             .build());
 ContentServiceSettings contentServiceSettings = contentServiceSettingsBuilder.build();

ContentServiceSettings.Builder

Builder for ContentServiceSettings.

CreateAssetRequest

Create asset request.

Protobuf type google.cloud.dataplex.v1.CreateAssetRequest

CreateAssetRequest.Builder

Create asset request.

Protobuf type google.cloud.dataplex.v1.CreateAssetRequest

CreateContentRequest

Create content request.

Protobuf type google.cloud.dataplex.v1.CreateContentRequest

CreateContentRequest.Builder

Create content request.

Protobuf type google.cloud.dataplex.v1.CreateContentRequest

CreateEntityRequest

Create a metadata entity request.

Protobuf type google.cloud.dataplex.v1.CreateEntityRequest

CreateEntityRequest.Builder

Create a metadata entity request.

Protobuf type google.cloud.dataplex.v1.CreateEntityRequest

CreateEnvironmentRequest

Create environment request.

Protobuf type google.cloud.dataplex.v1.CreateEnvironmentRequest

CreateEnvironmentRequest.Builder

Create environment request.

Protobuf type google.cloud.dataplex.v1.CreateEnvironmentRequest

CreateLakeRequest

Create lake request.

Protobuf type google.cloud.dataplex.v1.CreateLakeRequest

CreateLakeRequest.Builder

Create lake request.

Protobuf type google.cloud.dataplex.v1.CreateLakeRequest

CreatePartitionRequest

Create metadata partition request.

Protobuf type google.cloud.dataplex.v1.CreatePartitionRequest

CreatePartitionRequest.Builder

Create metadata partition request.

Protobuf type google.cloud.dataplex.v1.CreatePartitionRequest

CreateTaskRequest

Create task request.

Protobuf type google.cloud.dataplex.v1.CreateTaskRequest

CreateTaskRequest.Builder

Create task request.

Protobuf type google.cloud.dataplex.v1.CreateTaskRequest

CreateZoneRequest

Create zone request.

Protobuf type google.cloud.dataplex.v1.CreateZoneRequest

CreateZoneRequest.Builder

Create zone request.

Protobuf type google.cloud.dataplex.v1.CreateZoneRequest

DataplexServiceClient

Service Description: Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

This class provides the ability to make remote calls to the backing service through method calls that map to API methods. Sample code to get started:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 try (DataplexServiceClient dataplexServiceClient = DataplexServiceClient.create()) {
   LakeName name = LakeName.of("[PROJECT]", "[LOCATION]", "[LAKE]");
   Lake response = dataplexServiceClient.getLake(name);
 }

Note: close() needs to be called on the DataplexServiceClient object to clean up resources such as threads. In the example above, try-with-resources is used, which automatically calls close().

The surface of this class includes several types of Java methods for each of the API's methods:

  1. A "flattened" method. With this type of method, the fields of the request type have been converted into function parameters. It may be the case that not all fields are available as parameters, and not every API method will have a flattened method entry point.
  2. A "request object" method. This type of method only takes one parameter, a request object, which must be constructed before the call. Not every API method will have a request object method.
  3. A "callable" method. This type of method takes no parameters and returns an immutable API callable object, which can be used to initiate calls to the service.

See the individual methods for example code.

Many parameters require resource names to be formatted in a particular way. To assist with these names, this class includes a format method for each type of name, and additionally a parse method to extract the individual identifiers contained within names that are returned.

This class can be customized by passing in a custom instance of DataplexServiceSettings to create(). For example:

To customize credentials:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 DataplexServiceSettings dataplexServiceSettings =
     DataplexServiceSettings.newBuilder()
         .setCredentialsProvider(FixedCredentialsProvider.create(myCredentials))
         .build();
 DataplexServiceClient dataplexServiceClient =
     DataplexServiceClient.create(dataplexServiceSettings);

To customize the endpoint:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 DataplexServiceSettings dataplexServiceSettings =
     DataplexServiceSettings.newBuilder().setEndpoint(myEndpoint).build();
 DataplexServiceClient dataplexServiceClient =
     DataplexServiceClient.create(dataplexServiceSettings);

Please refer to the GitHub repository's samples for more quickstart code snippets.

DataplexServiceClient.ListAssetActionsFixedSizeCollection

DataplexServiceClient.ListAssetActionsPage

DataplexServiceClient.ListAssetActionsPagedResponse

DataplexServiceClient.ListAssetsFixedSizeCollection

DataplexServiceClient.ListAssetsPage

DataplexServiceClient.ListAssetsPagedResponse

DataplexServiceClient.ListEnvironmentsFixedSizeCollection

DataplexServiceClient.ListEnvironmentsPage

DataplexServiceClient.ListEnvironmentsPagedResponse

DataplexServiceClient.ListJobsFixedSizeCollection

DataplexServiceClient.ListJobsPage

DataplexServiceClient.ListJobsPagedResponse

DataplexServiceClient.ListLakeActionsFixedSizeCollection

DataplexServiceClient.ListLakeActionsPage

DataplexServiceClient.ListLakeActionsPagedResponse

DataplexServiceClient.ListLakesFixedSizeCollection

DataplexServiceClient.ListLakesPage

DataplexServiceClient.ListLakesPagedResponse

DataplexServiceClient.ListSessionsFixedSizeCollection

DataplexServiceClient.ListSessionsPage

DataplexServiceClient.ListSessionsPagedResponse

DataplexServiceClient.ListTasksFixedSizeCollection

DataplexServiceClient.ListTasksPage

DataplexServiceClient.ListTasksPagedResponse

DataplexServiceClient.ListZoneActionsFixedSizeCollection

DataplexServiceClient.ListZoneActionsPage

DataplexServiceClient.ListZoneActionsPagedResponse

DataplexServiceClient.ListZonesFixedSizeCollection

DataplexServiceClient.ListZonesPage

DataplexServiceClient.ListZonesPagedResponse

DataplexServiceGrpc

Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

DataplexServiceGrpc.DataplexServiceBlockingStub

Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

DataplexServiceGrpc.DataplexServiceFutureStub

Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

DataplexServiceGrpc.DataplexServiceImplBase

Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

DataplexServiceGrpc.DataplexServiceStub

Dataplex service provides data lakes as a service. The primary resources offered by this service are Lakes, Zones and Assets which collectively allow a data adminstrator to organize, manage, secure and catalog data across their organization located across cloud projects in a variety of storage systems including Cloud Storage and BigQuery.

DataplexServiceSettings

Settings class to configure an instance of DataplexServiceClient.

The default instance has everything set to sensible defaults:

  • The default service address (dataplex.googleapis.com) and default port (443) are used.
  • Credentials are acquired automatically through Application Default Credentials.
  • Retries are configured for idempotent methods but not for non-idempotent methods.

The builder of this class is recursive, so contained classes are themselves builders. When build() is called, the tree of builders is called to create the complete settings object.

For example, to set the total timeout of getLake to 30 seconds:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 DataplexServiceSettings.Builder dataplexServiceSettingsBuilder =
     DataplexServiceSettings.newBuilder();
 dataplexServiceSettingsBuilder
     .getLakeSettings()
     .setRetrySettings(
         dataplexServiceSettingsBuilder
             .getLakeSettings()
             .getRetrySettings()
             .toBuilder()
             .setTotalTimeout(Duration.ofSeconds(30))
             .build());
 DataplexServiceSettings dataplexServiceSettings = dataplexServiceSettingsBuilder.build();

DataplexServiceSettings.Builder

Builder for DataplexServiceSettings.

DeleteAssetRequest

Delete asset request.

Protobuf type google.cloud.dataplex.v1.DeleteAssetRequest

DeleteAssetRequest.Builder

Delete asset request.

Protobuf type google.cloud.dataplex.v1.DeleteAssetRequest

DeleteContentRequest

Delete content request.

Protobuf type google.cloud.dataplex.v1.DeleteContentRequest

DeleteContentRequest.Builder

Delete content request.

Protobuf type google.cloud.dataplex.v1.DeleteContentRequest

DeleteEntityRequest

Delete a metadata entity request.

Protobuf type google.cloud.dataplex.v1.DeleteEntityRequest

DeleteEntityRequest.Builder

Delete a metadata entity request.

Protobuf type google.cloud.dataplex.v1.DeleteEntityRequest

DeleteEnvironmentRequest

Delete environment request.

Protobuf type google.cloud.dataplex.v1.DeleteEnvironmentRequest

DeleteEnvironmentRequest.Builder

Delete environment request.

Protobuf type google.cloud.dataplex.v1.DeleteEnvironmentRequest

DeleteLakeRequest

Delete lake request.

Protobuf type google.cloud.dataplex.v1.DeleteLakeRequest

DeleteLakeRequest.Builder

Delete lake request.

Protobuf type google.cloud.dataplex.v1.DeleteLakeRequest

DeletePartitionRequest

Delete metadata partition request.

Protobuf type google.cloud.dataplex.v1.DeletePartitionRequest

DeletePartitionRequest.Builder

Delete metadata partition request.

Protobuf type google.cloud.dataplex.v1.DeletePartitionRequest

DeleteTaskRequest

Delete task request.

Protobuf type google.cloud.dataplex.v1.DeleteTaskRequest

DeleteTaskRequest.Builder

Delete task request.

Protobuf type google.cloud.dataplex.v1.DeleteTaskRequest

DeleteZoneRequest

Delete zone request.

Protobuf type google.cloud.dataplex.v1.DeleteZoneRequest

DeleteZoneRequest.Builder

Delete zone request.

Protobuf type google.cloud.dataplex.v1.DeleteZoneRequest

DiscoveryEvent

The payload associated with Discovery data processing.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent

DiscoveryEvent.ActionDetails

Details about the action.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.ActionDetails

DiscoveryEvent.ActionDetails.Builder

Details about the action.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.ActionDetails

DiscoveryEvent.Builder

The payload associated with Discovery data processing.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent

DiscoveryEvent.ConfigDetails

Details about configuration events.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.ConfigDetails

DiscoveryEvent.ConfigDetails.Builder

Details about configuration events.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.ConfigDetails

DiscoveryEvent.EntityDetails

Details about the entity.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.EntityDetails

DiscoveryEvent.EntityDetails.Builder

Details about the entity.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.EntityDetails

DiscoveryEvent.PartitionDetails

Details about the partition.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.PartitionDetails

DiscoveryEvent.PartitionDetails.Builder

Details about the partition.

Protobuf type google.cloud.dataplex.v1.DiscoveryEvent.PartitionDetails

Entity

Represents tables and fileset metadata contained within a zone.

Protobuf type google.cloud.dataplex.v1.Entity

Entity.Builder

Represents tables and fileset metadata contained within a zone.

Protobuf type google.cloud.dataplex.v1.Entity

Entity.CompatibilityStatus

Provides compatibility information for various metadata stores.

Protobuf type google.cloud.dataplex.v1.Entity.CompatibilityStatus

Entity.CompatibilityStatus.Builder

Provides compatibility information for various metadata stores.

Protobuf type google.cloud.dataplex.v1.Entity.CompatibilityStatus

Entity.CompatibilityStatus.Compatibility

Provides compatibility information for a specific metadata store.

Protobuf type google.cloud.dataplex.v1.Entity.CompatibilityStatus.Compatibility

Entity.CompatibilityStatus.Compatibility.Builder

Provides compatibility information for a specific metadata store.

Protobuf type google.cloud.dataplex.v1.Entity.CompatibilityStatus.Compatibility

EntityName

EntityName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/zones/{zone}/entities/{entity}.

Environment

Environment represents a user-visible compute infrastructure for analytics within a lake.

Protobuf type google.cloud.dataplex.v1.Environment

Environment.Builder

Environment represents a user-visible compute infrastructure for analytics within a lake.

Protobuf type google.cloud.dataplex.v1.Environment

Environment.Endpoints

Protobuf type google.cloud.dataplex.v1.Environment.Endpoints

Environment.Endpoints.Builder

Protobuf type google.cloud.dataplex.v1.Environment.Endpoints

Environment.InfrastructureSpec

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.cloud.dataplex.v1.Environment.InfrastructureSpec

Environment.InfrastructureSpec.Builder

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.cloud.dataplex.v1.Environment.InfrastructureSpec

Environment.InfrastructureSpec.ComputeResources

Compute resources associated with the analyze interactive workloads.

Protobuf type google.cloud.dataplex.v1.Environment.InfrastructureSpec.ComputeResources

Environment.InfrastructureSpec.ComputeResources.Builder

Compute resources associated with the analyze interactive workloads.

Protobuf type google.cloud.dataplex.v1.Environment.InfrastructureSpec.ComputeResources

Environment.InfrastructureSpec.OsImageRuntime

Software Runtime Configuration to run Analyze.

Protobuf type google.cloud.dataplex.v1.Environment.InfrastructureSpec.OsImageRuntime

Environment.InfrastructureSpec.OsImageRuntime.Builder

Software Runtime Configuration to run Analyze.

Protobuf type google.cloud.dataplex.v1.Environment.InfrastructureSpec.OsImageRuntime

Environment.SessionSpec

Protobuf type google.cloud.dataplex.v1.Environment.SessionSpec

Environment.SessionSpec.Builder

Protobuf type google.cloud.dataplex.v1.Environment.SessionSpec

Environment.SessionStatus

Protobuf type google.cloud.dataplex.v1.Environment.SessionStatus

Environment.SessionStatus.Builder

Protobuf type google.cloud.dataplex.v1.Environment.SessionStatus

EnvironmentName

EnvironmentName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/environments/{environment}.

GetAssetRequest

Get asset request.

Protobuf type google.cloud.dataplex.v1.GetAssetRequest

GetAssetRequest.Builder

Get asset request.

Protobuf type google.cloud.dataplex.v1.GetAssetRequest

GetContentRequest

Get content request.

Protobuf type google.cloud.dataplex.v1.GetContentRequest

GetContentRequest.Builder

Get content request.

Protobuf type google.cloud.dataplex.v1.GetContentRequest

GetEntityRequest

Get metadata entity request.

Protobuf type google.cloud.dataplex.v1.GetEntityRequest

GetEntityRequest.Builder

Get metadata entity request.

Protobuf type google.cloud.dataplex.v1.GetEntityRequest

GetEnvironmentRequest

Get environment request.

Protobuf type google.cloud.dataplex.v1.GetEnvironmentRequest

GetEnvironmentRequest.Builder

Get environment request.

Protobuf type google.cloud.dataplex.v1.GetEnvironmentRequest

GetJobRequest

Get job request.

Protobuf type google.cloud.dataplex.v1.GetJobRequest

GetJobRequest.Builder

Get job request.

Protobuf type google.cloud.dataplex.v1.GetJobRequest

GetLakeRequest

Get lake request.

Protobuf type google.cloud.dataplex.v1.GetLakeRequest

GetLakeRequest.Builder

Get lake request.

Protobuf type google.cloud.dataplex.v1.GetLakeRequest

GetPartitionRequest

Get metadata partition request.

Protobuf type google.cloud.dataplex.v1.GetPartitionRequest

GetPartitionRequest.Builder

Get metadata partition request.

Protobuf type google.cloud.dataplex.v1.GetPartitionRequest

GetTaskRequest

Get task request.

Protobuf type google.cloud.dataplex.v1.GetTaskRequest

GetTaskRequest.Builder

Get task request.

Protobuf type google.cloud.dataplex.v1.GetTaskRequest

GetZoneRequest

Get zone request.

Protobuf type google.cloud.dataplex.v1.GetZoneRequest

GetZoneRequest.Builder

Get zone request.

Protobuf type google.cloud.dataplex.v1.GetZoneRequest

Job

A job represents an instance of a task.

Protobuf type google.cloud.dataplex.v1.Job

Job.Builder

A job represents an instance of a task.

Protobuf type google.cloud.dataplex.v1.Job

JobEvent

The payload associated with Job logs that contains events describing jobs that have run within a Lake.

Protobuf type google.cloud.dataplex.v1.JobEvent

JobEvent.Builder

The payload associated with Job logs that contains events describing jobs that have run within a Lake.

Protobuf type google.cloud.dataplex.v1.JobEvent

JobName

JobName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/tasks/{task}/jobs/{job}.

Lake

A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.

Protobuf type google.cloud.dataplex.v1.Lake

Lake.Builder

A lake is a centralized repository for managing enterprise data across the organization distributed across many cloud projects, and stored in a variety of storage services such as Google Cloud Storage and BigQuery. The resources attached to a lake are referred to as managed resources. Data within these managed resources can be structured or unstructured. A lake provides data admins with tools to organize, secure and manage their data at scale, and provides data scientists and data engineers an integrated experience to easily search, discover, analyze and transform data and associated metadata.

Protobuf type google.cloud.dataplex.v1.Lake

Lake.Metastore

Settings to manage association of Dataproc Metastore with a lake.

Protobuf type google.cloud.dataplex.v1.Lake.Metastore

Lake.Metastore.Builder

Settings to manage association of Dataproc Metastore with a lake.

Protobuf type google.cloud.dataplex.v1.Lake.Metastore

Lake.MetastoreStatus

Status of Lake and Dataproc Metastore service instance association.

Protobuf type google.cloud.dataplex.v1.Lake.MetastoreStatus

Lake.MetastoreStatus.Builder

Status of Lake and Dataproc Metastore service instance association.

Protobuf type google.cloud.dataplex.v1.Lake.MetastoreStatus

LakeName

LakeName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}.

ListActionsResponse

List actions response.

Protobuf type google.cloud.dataplex.v1.ListActionsResponse

ListActionsResponse.Builder

List actions response.

Protobuf type google.cloud.dataplex.v1.ListActionsResponse

ListAssetActionsRequest

List asset actions request.

Protobuf type google.cloud.dataplex.v1.ListAssetActionsRequest

ListAssetActionsRequest.Builder

List asset actions request.

Protobuf type google.cloud.dataplex.v1.ListAssetActionsRequest

ListAssetsRequest

List assets request.

Protobuf type google.cloud.dataplex.v1.ListAssetsRequest

ListAssetsRequest.Builder

List assets request.

Protobuf type google.cloud.dataplex.v1.ListAssetsRequest

ListAssetsResponse

List assets response.

Protobuf type google.cloud.dataplex.v1.ListAssetsResponse

ListAssetsResponse.Builder

List assets response.

Protobuf type google.cloud.dataplex.v1.ListAssetsResponse

ListContentRequest

List content request. Returns the BASIC Content view.

Protobuf type google.cloud.dataplex.v1.ListContentRequest

ListContentRequest.Builder

List content request. Returns the BASIC Content view.

Protobuf type google.cloud.dataplex.v1.ListContentRequest

ListContentResponse

List content response.

Protobuf type google.cloud.dataplex.v1.ListContentResponse

ListContentResponse.Builder

List content response.

Protobuf type google.cloud.dataplex.v1.ListContentResponse

ListEntitiesRequest

List metadata entities request.

Protobuf type google.cloud.dataplex.v1.ListEntitiesRequest

ListEntitiesRequest.Builder

List metadata entities request.

Protobuf type google.cloud.dataplex.v1.ListEntitiesRequest

ListEntitiesResponse

List metadata entities response.

Protobuf type google.cloud.dataplex.v1.ListEntitiesResponse

ListEntitiesResponse.Builder

List metadata entities response.

Protobuf type google.cloud.dataplex.v1.ListEntitiesResponse

ListEnvironmentsRequest

List environments request.

Protobuf type google.cloud.dataplex.v1.ListEnvironmentsRequest

ListEnvironmentsRequest.Builder

List environments request.

Protobuf type google.cloud.dataplex.v1.ListEnvironmentsRequest

ListEnvironmentsResponse

List environments response.

Protobuf type google.cloud.dataplex.v1.ListEnvironmentsResponse

ListEnvironmentsResponse.Builder

List environments response.

Protobuf type google.cloud.dataplex.v1.ListEnvironmentsResponse

ListJobsRequest

List jobs request.

Protobuf type google.cloud.dataplex.v1.ListJobsRequest

ListJobsRequest.Builder

List jobs request.

Protobuf type google.cloud.dataplex.v1.ListJobsRequest

ListJobsResponse

List jobs response.

Protobuf type google.cloud.dataplex.v1.ListJobsResponse

ListJobsResponse.Builder

List jobs response.

Protobuf type google.cloud.dataplex.v1.ListJobsResponse

ListLakeActionsRequest

List lake actions request.

Protobuf type google.cloud.dataplex.v1.ListLakeActionsRequest

ListLakeActionsRequest.Builder

List lake actions request.

Protobuf type google.cloud.dataplex.v1.ListLakeActionsRequest

ListLakesRequest

List lakes request.

Protobuf type google.cloud.dataplex.v1.ListLakesRequest

ListLakesRequest.Builder

List lakes request.

Protobuf type google.cloud.dataplex.v1.ListLakesRequest

ListLakesResponse

List lakes response.

Protobuf type google.cloud.dataplex.v1.ListLakesResponse

ListLakesResponse.Builder

List lakes response.

Protobuf type google.cloud.dataplex.v1.ListLakesResponse

ListPartitionsRequest

List metadata partitions request.

Protobuf type google.cloud.dataplex.v1.ListPartitionsRequest

ListPartitionsRequest.Builder

List metadata partitions request.

Protobuf type google.cloud.dataplex.v1.ListPartitionsRequest

ListPartitionsResponse

List metadata partitions response.

Protobuf type google.cloud.dataplex.v1.ListPartitionsResponse

ListPartitionsResponse.Builder

List metadata partitions response.

Protobuf type google.cloud.dataplex.v1.ListPartitionsResponse

ListSessionsRequest

List sessions request.

Protobuf type google.cloud.dataplex.v1.ListSessionsRequest

ListSessionsRequest.Builder

List sessions request.

Protobuf type google.cloud.dataplex.v1.ListSessionsRequest

ListSessionsResponse

List sessions response.

Protobuf type google.cloud.dataplex.v1.ListSessionsResponse

ListSessionsResponse.Builder

List sessions response.

Protobuf type google.cloud.dataplex.v1.ListSessionsResponse

ListTasksRequest

List tasks request.

Protobuf type google.cloud.dataplex.v1.ListTasksRequest

ListTasksRequest.Builder

List tasks request.

Protobuf type google.cloud.dataplex.v1.ListTasksRequest

ListTasksResponse

List tasks response.

Protobuf type google.cloud.dataplex.v1.ListTasksResponse

ListTasksResponse.Builder

List tasks response.

Protobuf type google.cloud.dataplex.v1.ListTasksResponse

ListZoneActionsRequest

List zone actions request.

Protobuf type google.cloud.dataplex.v1.ListZoneActionsRequest

ListZoneActionsRequest.Builder

List zone actions request.

Protobuf type google.cloud.dataplex.v1.ListZoneActionsRequest

ListZonesRequest

List zones request.

Protobuf type google.cloud.dataplex.v1.ListZonesRequest

ListZonesRequest.Builder

List zones request.

Protobuf type google.cloud.dataplex.v1.ListZonesRequest

ListZonesResponse

List zones response.

Protobuf type google.cloud.dataplex.v1.ListZonesResponse

ListZonesResponse.Builder

List zones response.

Protobuf type google.cloud.dataplex.v1.ListZonesResponse

LocationName

LocationName.Builder

Builder for projects/{project}/locations/{location}.

LogsProto

MetadataProto

MetadataServiceClient

Service Description: Metadata service manages metadata resources such as tables, filesets and partitions.

This class provides the ability to make remote calls to the backing service through method calls that map to API methods. Sample code to get started:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 try (MetadataServiceClient metadataServiceClient = MetadataServiceClient.create()) {
   ZoneName parent = ZoneName.of("[PROJECT]", "[LOCATION]", "[LAKE]", "[ZONE]");
   Entity entity = Entity.newBuilder().build();
   Entity response = metadataServiceClient.createEntity(parent, entity);
 }

Note: close() needs to be called on the MetadataServiceClient object to clean up resources such as threads. In the example above, try-with-resources is used, which automatically calls close().

The surface of this class includes several types of Java methods for each of the API's methods:

  1. A "flattened" method. With this type of method, the fields of the request type have been converted into function parameters. It may be the case that not all fields are available as parameters, and not every API method will have a flattened method entry point.
  2. A "request object" method. This type of method only takes one parameter, a request object, which must be constructed before the call. Not every API method will have a request object method.
  3. A "callable" method. This type of method takes no parameters and returns an immutable API callable object, which can be used to initiate calls to the service.

See the individual methods for example code.

Many parameters require resource names to be formatted in a particular way. To assist with these names, this class includes a format method for each type of name, and additionally a parse method to extract the individual identifiers contained within names that are returned.

This class can be customized by passing in a custom instance of MetadataServiceSettings to create(). For example:

To customize credentials:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 MetadataServiceSettings metadataServiceSettings =
     MetadataServiceSettings.newBuilder()
         .setCredentialsProvider(FixedCredentialsProvider.create(myCredentials))
         .build();
 MetadataServiceClient metadataServiceClient =
     MetadataServiceClient.create(metadataServiceSettings);

To customize the endpoint:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 MetadataServiceSettings metadataServiceSettings =
     MetadataServiceSettings.newBuilder().setEndpoint(myEndpoint).build();
 MetadataServiceClient metadataServiceClient =
     MetadataServiceClient.create(metadataServiceSettings);

Please refer to the GitHub repository's samples for more quickstart code snippets.

MetadataServiceClient.ListEntitiesFixedSizeCollection

MetadataServiceClient.ListEntitiesPage

MetadataServiceClient.ListEntitiesPagedResponse

MetadataServiceClient.ListPartitionsFixedSizeCollection

MetadataServiceClient.ListPartitionsPage

MetadataServiceClient.ListPartitionsPagedResponse

MetadataServiceGrpc

Metadata service manages metadata resources such as tables, filesets and partitions.

MetadataServiceGrpc.MetadataServiceBlockingStub

Metadata service manages metadata resources such as tables, filesets and partitions.

MetadataServiceGrpc.MetadataServiceFutureStub

Metadata service manages metadata resources such as tables, filesets and partitions.

MetadataServiceGrpc.MetadataServiceImplBase

Metadata service manages metadata resources such as tables, filesets and partitions.

MetadataServiceGrpc.MetadataServiceStub

Metadata service manages metadata resources such as tables, filesets and partitions.

MetadataServiceSettings

Settings class to configure an instance of MetadataServiceClient.

The default instance has everything set to sensible defaults:

  • The default service address (dataplex.googleapis.com) and default port (443) are used.
  • Credentials are acquired automatically through Application Default Credentials.
  • Retries are configured for idempotent methods but not for non-idempotent methods.

The builder of this class is recursive, so contained classes are themselves builders. When build() is called, the tree of builders is called to create the complete settings object.

For example, to set the total timeout of createEntity to 30 seconds:


 // This snippet has been automatically generated for illustrative purposes only.
 // It may require modifications to work in your environment.
 MetadataServiceSettings.Builder metadataServiceSettingsBuilder =
     MetadataServiceSettings.newBuilder();
 metadataServiceSettingsBuilder
     .createEntitySettings()
     .setRetrySettings(
         metadataServiceSettingsBuilder
             .createEntitySettings()
             .getRetrySettings()
             .toBuilder()
             .setTotalTimeout(Duration.ofSeconds(30))
             .build());
 MetadataServiceSettings metadataServiceSettings = metadataServiceSettingsBuilder.build();

MetadataServiceSettings.Builder

Builder for MetadataServiceSettings.

OperationMetadata

Represents the metadata of a long-running operation.

Protobuf type google.cloud.dataplex.v1.OperationMetadata

OperationMetadata.Builder

Represents the metadata of a long-running operation.

Protobuf type google.cloud.dataplex.v1.OperationMetadata

Partition

Represents partition metadata contained within entity instances.

Protobuf type google.cloud.dataplex.v1.Partition

Partition.Builder

Represents partition metadata contained within entity instances.

Protobuf type google.cloud.dataplex.v1.Partition

PartitionName

PartitionName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/zones/{zone}/entities/{entity}/partitions/{partition}.

ResourcesProto

Schema

Schema information describing the structure and layout of the data.

Protobuf type google.cloud.dataplex.v1.Schema

Schema.Builder

Schema information describing the structure and layout of the data.

Protobuf type google.cloud.dataplex.v1.Schema

Schema.PartitionField

Represents a key field within the entity's partition structure. You could have up to 20 partition fields, but only the first 10 partitions have the filtering ability due to performance consideration.

Protobuf type google.cloud.dataplex.v1.Schema.PartitionField

Schema.PartitionField.Builder

Represents a key field within the entity's partition structure. You could have up to 20 partition fields, but only the first 10 partitions have the filtering ability due to performance consideration.

Protobuf type google.cloud.dataplex.v1.Schema.PartitionField

Schema.SchemaField

Represents a column field within a table schema.

Protobuf type google.cloud.dataplex.v1.Schema.SchemaField

Schema.SchemaField.Builder

Represents a column field within a table schema.

Protobuf type google.cloud.dataplex.v1.Schema.SchemaField

ServiceProto

Session

Represents an active analyze session running for a user.

Protobuf type google.cloud.dataplex.v1.Session

Session.Builder

Represents an active analyze session running for a user.

Protobuf type google.cloud.dataplex.v1.Session

SessionEvent

These messages contain information about sessions within an environment. The monitored resource is 'Environment'.

Protobuf type google.cloud.dataplex.v1.SessionEvent

SessionEvent.Builder

These messages contain information about sessions within an environment. The monitored resource is 'Environment'.

Protobuf type google.cloud.dataplex.v1.SessionEvent

SessionEvent.QueryDetail

Execution details of the query.

Protobuf type google.cloud.dataplex.v1.SessionEvent.QueryDetail

SessionEvent.QueryDetail.Builder

Execution details of the query.

Protobuf type google.cloud.dataplex.v1.SessionEvent.QueryDetail

StorageFormat

Describes the format of the data within its storage location.

Protobuf type google.cloud.dataplex.v1.StorageFormat

StorageFormat.Builder

Describes the format of the data within its storage location.

Protobuf type google.cloud.dataplex.v1.StorageFormat

StorageFormat.CsvOptions

Describes CSV and similar semi-structured data formats.

Protobuf type google.cloud.dataplex.v1.StorageFormat.CsvOptions

StorageFormat.CsvOptions.Builder

Describes CSV and similar semi-structured data formats.

Protobuf type google.cloud.dataplex.v1.StorageFormat.CsvOptions

StorageFormat.JsonOptions

Describes JSON data format.

Protobuf type google.cloud.dataplex.v1.StorageFormat.JsonOptions

StorageFormat.JsonOptions.Builder

Describes JSON data format.

Protobuf type google.cloud.dataplex.v1.StorageFormat.JsonOptions

Task

A task represents a user-visible job.

Protobuf type google.cloud.dataplex.v1.Task

Task.Builder

A task represents a user-visible job.

Protobuf type google.cloud.dataplex.v1.Task

Task.ExecutionSpec

Execution related settings, like retry and service_account.

Protobuf type google.cloud.dataplex.v1.Task.ExecutionSpec

Task.ExecutionSpec.Builder

Execution related settings, like retry and service_account.

Protobuf type google.cloud.dataplex.v1.Task.ExecutionSpec

Task.InfrastructureSpec

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec

Task.InfrastructureSpec.BatchComputeResources

Batch compute resources associated with the task.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec.BatchComputeResources

Task.InfrastructureSpec.BatchComputeResources.Builder

Batch compute resources associated with the task.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec.BatchComputeResources

Task.InfrastructureSpec.Builder

Configuration for the underlying infrastructure used to run workloads.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec

Task.InfrastructureSpec.ContainerImageRuntime

Container Image Runtime Configuration used with Batch execution.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec.ContainerImageRuntime

Task.InfrastructureSpec.ContainerImageRuntime.Builder

Container Image Runtime Configuration used with Batch execution.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec.ContainerImageRuntime

Task.InfrastructureSpec.VpcNetwork

Cloud VPC Network used to run the infrastructure.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec.VpcNetwork

Task.InfrastructureSpec.VpcNetwork.Builder

Cloud VPC Network used to run the infrastructure.

Protobuf type google.cloud.dataplex.v1.Task.InfrastructureSpec.VpcNetwork

Task.SparkTaskConfig

User-specified config for running a Spark task.

Protobuf type google.cloud.dataplex.v1.Task.SparkTaskConfig

Task.SparkTaskConfig.Builder

User-specified config for running a Spark task.

Protobuf type google.cloud.dataplex.v1.Task.SparkTaskConfig

Task.TriggerSpec

Task scheduling and trigger settings.

Protobuf type google.cloud.dataplex.v1.Task.TriggerSpec

Task.TriggerSpec.Builder

Task scheduling and trigger settings.

Protobuf type google.cloud.dataplex.v1.Task.TriggerSpec

TaskName

TaskName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/tasks/{task}.

TasksProto

UpdateAssetRequest

Update asset request.

Protobuf type google.cloud.dataplex.v1.UpdateAssetRequest

UpdateAssetRequest.Builder

Update asset request.

Protobuf type google.cloud.dataplex.v1.UpdateAssetRequest

UpdateContentRequest

Update content request.

Protobuf type google.cloud.dataplex.v1.UpdateContentRequest

UpdateContentRequest.Builder

Update content request.

Protobuf type google.cloud.dataplex.v1.UpdateContentRequest

UpdateEntityRequest

Update a metadata entity request. The exiting entity will be fully replaced by the entity in the request. The entity ID is mutable. To modify the ID, use the current entity ID in the request URL and specify the new ID in the request body.

Protobuf type google.cloud.dataplex.v1.UpdateEntityRequest

UpdateEntityRequest.Builder

Update a metadata entity request. The exiting entity will be fully replaced by the entity in the request. The entity ID is mutable. To modify the ID, use the current entity ID in the request URL and specify the new ID in the request body.

Protobuf type google.cloud.dataplex.v1.UpdateEntityRequest

UpdateEnvironmentRequest

Update environment request.

Protobuf type google.cloud.dataplex.v1.UpdateEnvironmentRequest

UpdateEnvironmentRequest.Builder

Update environment request.

Protobuf type google.cloud.dataplex.v1.UpdateEnvironmentRequest

UpdateLakeRequest

Update lake request.

Protobuf type google.cloud.dataplex.v1.UpdateLakeRequest

UpdateLakeRequest.Builder

Update lake request.

Protobuf type google.cloud.dataplex.v1.UpdateLakeRequest

UpdateTaskRequest

Update task request.

Protobuf type google.cloud.dataplex.v1.UpdateTaskRequest

UpdateTaskRequest.Builder

Update task request.

Protobuf type google.cloud.dataplex.v1.UpdateTaskRequest

UpdateZoneRequest

Update zone request.

Protobuf type google.cloud.dataplex.v1.UpdateZoneRequest

UpdateZoneRequest.Builder

Update zone request.

Protobuf type google.cloud.dataplex.v1.UpdateZoneRequest

Zone

A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.

Protobuf type google.cloud.dataplex.v1.Zone

Zone.Builder

A zone represents a logical group of related assets within a lake. A zone can be used to map to organizational structure or represent stages of data readiness from raw to curated. It provides managing behavior that is shared or inherited by all contained assets.

Protobuf type google.cloud.dataplex.v1.Zone

Zone.DiscoverySpec

Settings to manage the metadata discovery and publishing in a zone.

Protobuf type google.cloud.dataplex.v1.Zone.DiscoverySpec

Zone.DiscoverySpec.Builder

Settings to manage the metadata discovery and publishing in a zone.

Protobuf type google.cloud.dataplex.v1.Zone.DiscoverySpec

Zone.DiscoverySpec.CsvOptions

Describe CSV and similar semi-structured data formats.

Protobuf type google.cloud.dataplex.v1.Zone.DiscoverySpec.CsvOptions

Zone.DiscoverySpec.CsvOptions.Builder

Describe CSV and similar semi-structured data formats.

Protobuf type google.cloud.dataplex.v1.Zone.DiscoverySpec.CsvOptions

Zone.DiscoverySpec.JsonOptions

Describe JSON data format.

Protobuf type google.cloud.dataplex.v1.Zone.DiscoverySpec.JsonOptions

Zone.DiscoverySpec.JsonOptions.Builder

Describe JSON data format.

Protobuf type google.cloud.dataplex.v1.Zone.DiscoverySpec.JsonOptions

Zone.ResourceSpec

Settings for resources attached as assets within a zone.

Protobuf type google.cloud.dataplex.v1.Zone.ResourceSpec

Zone.ResourceSpec.Builder

Settings for resources attached as assets within a zone.

Protobuf type google.cloud.dataplex.v1.Zone.ResourceSpec

ZoneName

ZoneName.Builder

Builder for projects/{project}/locations/{location}/lakes/{lake}/zones/{zone}.

Interfaces

Action.FailedSecurityPolicyApplyOrBuilder

Action.IncompatibleDataSchemaOrBuilder

Action.InvalidDataFormatOrBuilder

Action.InvalidDataOrganizationOrBuilder

Action.InvalidDataPartitionOrBuilder

Action.MissingDataOrBuilder

Action.MissingResourceOrBuilder

Action.UnauthorizedResourceOrBuilder

ActionOrBuilder

Asset.DiscoverySpec.CsvOptionsOrBuilder

Asset.DiscoverySpec.JsonOptionsOrBuilder

Asset.DiscoverySpecOrBuilder

Asset.DiscoveryStatus.StatsOrBuilder

Asset.DiscoveryStatusOrBuilder

Asset.ResourceSpecOrBuilder

Asset.ResourceStatusOrBuilder

Asset.SecurityStatusOrBuilder

AssetOrBuilder

AssetStatusOrBuilder

CancelJobRequestOrBuilder

Content.NotebookOrBuilder

Content.SqlScriptOrBuilder

ContentOrBuilder

CreateAssetRequestOrBuilder

CreateContentRequestOrBuilder

CreateEntityRequestOrBuilder

CreateEnvironmentRequestOrBuilder

CreateLakeRequestOrBuilder

CreatePartitionRequestOrBuilder

CreateTaskRequestOrBuilder

CreateZoneRequestOrBuilder

DeleteAssetRequestOrBuilder

DeleteContentRequestOrBuilder

DeleteEntityRequestOrBuilder

DeleteEnvironmentRequestOrBuilder

DeleteLakeRequestOrBuilder

DeletePartitionRequestOrBuilder

DeleteTaskRequestOrBuilder

DeleteZoneRequestOrBuilder

DiscoveryEvent.ActionDetailsOrBuilder

DiscoveryEvent.ConfigDetailsOrBuilder

DiscoveryEvent.EntityDetailsOrBuilder

DiscoveryEvent.PartitionDetailsOrBuilder

DiscoveryEventOrBuilder

Entity.CompatibilityStatus.CompatibilityOrBuilder

Entity.CompatibilityStatusOrBuilder

EntityOrBuilder

Environment.EndpointsOrBuilder

Environment.InfrastructureSpec.ComputeResourcesOrBuilder

Environment.InfrastructureSpec.OsImageRuntimeOrBuilder

Environment.InfrastructureSpecOrBuilder

Environment.SessionSpecOrBuilder

Environment.SessionStatusOrBuilder

EnvironmentOrBuilder

GetAssetRequestOrBuilder

GetContentRequestOrBuilder

GetEntityRequestOrBuilder

GetEnvironmentRequestOrBuilder

GetJobRequestOrBuilder

GetLakeRequestOrBuilder

GetPartitionRequestOrBuilder

GetTaskRequestOrBuilder

GetZoneRequestOrBuilder

JobEventOrBuilder

JobOrBuilder

Lake.MetastoreOrBuilder

Lake.MetastoreStatusOrBuilder

LakeOrBuilder

ListActionsResponseOrBuilder

ListAssetActionsRequestOrBuilder

ListAssetsRequestOrBuilder

ListAssetsResponseOrBuilder

ListContentRequestOrBuilder

ListContentResponseOrBuilder

ListEntitiesRequestOrBuilder

ListEntitiesResponseOrBuilder

ListEnvironmentsRequestOrBuilder

ListEnvironmentsResponseOrBuilder

ListJobsRequestOrBuilder

ListJobsResponseOrBuilder

ListLakeActionsRequestOrBuilder

ListLakesRequestOrBuilder

ListLakesResponseOrBuilder

ListPartitionsRequestOrBuilder

ListPartitionsResponseOrBuilder

ListSessionsRequestOrBuilder

ListSessionsResponseOrBuilder

ListTasksRequestOrBuilder

ListTasksResponseOrBuilder

ListZoneActionsRequestOrBuilder

ListZonesRequestOrBuilder

ListZonesResponseOrBuilder

OperationMetadataOrBuilder

PartitionOrBuilder

Schema.PartitionFieldOrBuilder

Schema.SchemaFieldOrBuilder

SchemaOrBuilder

SessionEvent.QueryDetailOrBuilder

SessionEventOrBuilder

SessionOrBuilder

StorageFormat.CsvOptionsOrBuilder

StorageFormat.JsonOptionsOrBuilder

StorageFormatOrBuilder

Task.ExecutionSpecOrBuilder

Task.InfrastructureSpec.BatchComputeResourcesOrBuilder

Task.InfrastructureSpec.ContainerImageRuntimeOrBuilder

Task.InfrastructureSpec.VpcNetworkOrBuilder

Task.InfrastructureSpecOrBuilder

Task.SparkTaskConfigOrBuilder

Task.TriggerSpecOrBuilder

TaskOrBuilder

UpdateAssetRequestOrBuilder

UpdateContentRequestOrBuilder

UpdateEntityRequestOrBuilder

UpdateEnvironmentRequestOrBuilder

UpdateLakeRequestOrBuilder

UpdateTaskRequestOrBuilder

UpdateZoneRequestOrBuilder

Zone.DiscoverySpec.CsvOptionsOrBuilder

Zone.DiscoverySpec.JsonOptionsOrBuilder

Zone.DiscoverySpecOrBuilder

Zone.ResourceSpecOrBuilder

ZoneOrBuilder

Enums

Action.Category

The category of issues.

Protobuf enum google.cloud.dataplex.v1.Action.Category

Action.DetailsCase

Action.IncompatibleDataSchema.SchemaChange

Whether the action relates to a schema that is incompatible or modified.

Protobuf enum google.cloud.dataplex.v1.Action.IncompatibleDataSchema.SchemaChange

Action.InvalidDataPartition.PartitionStructure

The expected partition structure.

Protobuf enum google.cloud.dataplex.v1.Action.InvalidDataPartition.PartitionStructure

Asset.DiscoverySpec.TriggerCase

Asset.DiscoveryStatus.State

Current state of discovery.

Protobuf enum google.cloud.dataplex.v1.Asset.DiscoveryStatus.State

Asset.ResourceSpec.Type

Type of resource.

Protobuf enum google.cloud.dataplex.v1.Asset.ResourceSpec.Type

Asset.ResourceStatus.State

The state of a resource.

Protobuf enum google.cloud.dataplex.v1.Asset.ResourceStatus.State

Asset.SecurityStatus.State

The state of the security policy.

Protobuf enum google.cloud.dataplex.v1.Asset.SecurityStatus.State

Content.ContentCase

Content.DataCase

Content.Notebook.KernelType

Kernel Type of the Jupyter notebook.

Protobuf enum google.cloud.dataplex.v1.Content.Notebook.KernelType

Content.SqlScript.QueryEngine

Query Engine Type of the SQL Script.

Protobuf enum google.cloud.dataplex.v1.Content.SqlScript.QueryEngine

DiscoveryEvent.DetailsCase

DiscoveryEvent.EntityType

The type of the entity.

Protobuf enum google.cloud.dataplex.v1.DiscoveryEvent.EntityType

DiscoveryEvent.EventType

The type of the event.

Protobuf enum google.cloud.dataplex.v1.DiscoveryEvent.EventType

Entity.Type

The type of entity.

Protobuf enum google.cloud.dataplex.v1.Entity.Type

Environment.InfrastructureSpec.ResourcesCase

Environment.InfrastructureSpec.RuntimeCase

GetContentRequest.ContentView

Specifies whether the request should return the full or the partial representation.

Protobuf enum google.cloud.dataplex.v1.GetContentRequest.ContentView

GetEntityRequest.EntityView

Entity views for get entity partial result.

Protobuf enum google.cloud.dataplex.v1.GetEntityRequest.EntityView

Job.Service

Protobuf enum google.cloud.dataplex.v1.Job.Service

Job.State

Protobuf enum google.cloud.dataplex.v1.Job.State

JobEvent.Service

The service used to execute the job.

Protobuf enum google.cloud.dataplex.v1.JobEvent.Service

JobEvent.State

The completion status of the job.

Protobuf enum google.cloud.dataplex.v1.JobEvent.State

JobEvent.Type

The type of the job.

Protobuf enum google.cloud.dataplex.v1.JobEvent.Type

Lake.MetastoreStatus.State

Current state of association.

Protobuf enum google.cloud.dataplex.v1.Lake.MetastoreStatus.State

ListEntitiesRequest.EntityView

Entity views.

Protobuf enum google.cloud.dataplex.v1.ListEntitiesRequest.EntityView

Schema.Mode

Additional qualifiers to define field semantics.

Protobuf enum google.cloud.dataplex.v1.Schema.Mode

Schema.PartitionStyle

The structure of paths within the entity, which represent partitions.

Protobuf enum google.cloud.dataplex.v1.Schema.PartitionStyle

Schema.Type

Type information for fields in schemas and partition schemas.

Protobuf enum google.cloud.dataplex.v1.Schema.Type

SessionEvent.DetailCase

SessionEvent.EventType

The type of the event.

Protobuf enum google.cloud.dataplex.v1.SessionEvent.EventType

SessionEvent.QueryDetail.Engine

Query Execution engine.

Protobuf enum google.cloud.dataplex.v1.SessionEvent.QueryDetail.Engine

State

State of a resource.

Protobuf enum google.cloud.dataplex.v1.State

StorageFormat.CompressionFormat

The specific compressed file format of the data.

Protobuf enum google.cloud.dataplex.v1.StorageFormat.CompressionFormat

StorageFormat.Format

The specific file format of the data.

Protobuf enum google.cloud.dataplex.v1.StorageFormat.Format

StorageFormat.OptionsCase

StorageSystem

Identifies the cloud system that manages the data storage.

Protobuf enum google.cloud.dataplex.v1.StorageSystem

Task.ConfigCase

Task.InfrastructureSpec.NetworkCase

Task.InfrastructureSpec.ResourcesCase

Task.InfrastructureSpec.RuntimeCase

Task.InfrastructureSpec.VpcNetwork.NetworkNameCase

Task.SparkTaskConfig.DriverCase

Task.TriggerSpec.TriggerCase

Task.TriggerSpec.Type

Determines how often and when the job will run.

Protobuf enum google.cloud.dataplex.v1.Task.TriggerSpec.Type

Zone.DiscoverySpec.TriggerCase

Zone.ResourceSpec.LocationType

Location type of the resources attached to a zone.

Protobuf enum google.cloud.dataplex.v1.Zone.ResourceSpec.LocationType

Zone.Type

Type of zone.

Protobuf enum google.cloud.dataplex.v1.Zone.Type