Monitor Dataplex metrics

Cloud Monitoring provides visibility into the performance, uptime, and overall health of cloud-powered applications. Google Cloud Observability collects and ingests metrics, events, and metadata from Dataplex services to generate insights through dashboards and charts.

To understand the costs, see Monitoring pricing.

For more information about metric data retention, see Monitoring quotas and limits.

Access service metrics in Monitoring

Dataplex service resource metrics are automatically enabled on Dataplex services. To view these metrics, use Monitoring.

You can access Monitoring from the Google Cloud console or by using the Monitoring API.

If you're unable to view the monitoring graphs or create alerts, you might need additional Monitoring permissions.

Console

  1. In the Google Cloud console, go to the Metrics explorer page.

    Go to Metrics explorer

  2. In the Select a metric menu, select a Cloud Dataplex resource.

  3. Select a metric category, and then select a metric from the list.

    To display information about a metric, hold the pointer over the metric name.

  4. Click Apply.

  5. Optional: Select filters, group by metric labels, perform aggregations, and select chart display options.

REST

To capture and list metrics defined by a filter expression, Use the Monitoring timeSeries.list method.

To send an API request and display the response, on the API page, use the Try this API template.

Dataplex service metrics in Monitoring

Dataplex service metrics facilitates monitoring of service health.

Scope Metric Name Monitored Resource Metric Description
Lake requires_action dataplex.googleapis.com/Lake Whether the lake has unresolved admin actions. 1 if the lake is actionable; 0 otherwise.
Zone requires_action dataplex.googleapis.com/Zone Whether the data zone has unresolved admin actions. 1 if the data zone is actionable; 0 otherwise.
Asset requires_action dataplex.googleapis.com/Asset Whether the asset has unresolved admin actions. 1 if the asset is actionable; 0 otherwise.
Asset active dataplex.googleapis.com/Asset Whether the asset is active. 1 if an asset exists in non-error state; 0 otherwise.
Asset data_items dataplex.googleapis.com/Asset Current number of data items discovered within an asset (objects in Cloud Storage bucket, and rows in BigQuery datasets).
Asset data_size dataplex.googleapis.com/Asset Total size of data in an asset (reported in bytes).
Asset filesets dataplex.googleapis.com/asset Current number of filesets discovered within an asset.
Asset tables dataplex.googleapis.com/Asset Current number of tables discovered within an asset.

Build a custom Monitoring dashboard

You can build a custom Monitoring dashboard that displays charts of selected Dataplex service metrics. For more information about how to create a dashboard, see Create and manage custom dashboards. When you select a metric for a widget on your dashboard, select a Cloud Dataplex resource and then choose a Dataplex metric.

Use Monitoring alerts

You can create a Monitoring alert that notifies you when a Dataplex service or job metric crosses a specified threshold.

Create an alert

To create an alert, follow the instructions in Create metric-threshold alerting policies. When you select a time series to be monitored, select a Cloud Dataplex resource and then choose a Dataplex metric.

View alerts

When an alert is triggered by a metric threshold condition, Monitoring creates an incident and a corresponding event.

To view an incident, follow this step:

  • In the Google Cloud console, go to the Alerting page.

    Go to Alerting

If you defined a notification mechanism in the alert policy, such as an email or SMS notification, Monitoring also sends a notification of the incident.

For more information about alerts, see Incidents for metric-based alerts.

What's next