Cloud Monitoring provides visibility into the performance, uptime, and overall health of cloud-powered applications. Google Cloud Observability collects and ingests metrics, events, and metadata from Dataplex services to generate insights via dashboards and charts.
See Monitoring pricing to understand your costs.
See Monitoring quotas and limits for information on metric data retention.
Access service metrics in Monitoring
Dataplex service resource metrics are automatically enabled on Dataplex services. Use Monitoring to view these metrics.
You can access Monitoring from the Google Cloud console or by using the Monitoring API.
Console
In the Google Cloud console, go to the Cloud Monitoring > Metrics explorer page:
From the "Find resource type and metric" drop-down list, select a
Cloud Dataplexresource.Click again in the input box, and then select a metric from the drop-down list. Hovering over the metric name displays information about the metric.
You can select filters, group by metric labels, perform aggregations, and select chart viewing options.
REST
You can use the Monitoring timeSeries.list
API to capture and list metrics defined by a filter expression.
Use the Try this API template on the API page to send
an API request and display the response.
Dataplex service metrics in Monitoring
Dataplex service metrics facilitates monitoring of service health.
| Scope | Metric Name | Monitored Resource | Metric Description |
|---|---|---|---|
| Lake | requires_action | dataplex.googleapis.com/Lake | Whether the lake has unresolved admin actions. 1 if the lake is actionable; 0 otherwise. |
| Zone | requires_action | dataplex.googleapis.com/Zone | Whether the data zone has unresolved admin actions. 1 if the data zone is actionable; 0 otherwise. |
| Asset | requires_action | dataplex.googleapis.com/Asset | Whether the asset has unresolved admin actions. 1 if the asset is actionable; 0 otherwise. |
| Asset | active | dataplex.googleapis.com/Asset | Whether the asset is active. 1 if an asset exists in non-error state; 0 otherwise. |
| Asset | data_items | dataplex.googleapis.com/Asset | Current number of data items discovered within an asset (objects in Cloud Storage bucket, and rows in BigQuery datasets). |
| Asset | data_size | dataplex.googleapis.com/Asset | Total size of data in an asset (reported in bytes). |
| Asset | filesets | dataplex.googleapis.com/asset | Current number of filesets discovered within an asset. |
| Asset | tables | dataplex.googleapis.com/Asset | Current number of tables discovered within an asset. |
Build a custom Monitoring dashboard
You can build a custom Monitoring dashboard that displays charts of selected Dataplex service metrics.
Select + CREATE DASHBOARD from the Monitoring Dashboards Overview page. Provide a name for the dashboard, then click Add Chart in the upper-right menu to open the Add Chart window. Select a
Cloud Dataplexresource as the resource type. Select one or more metrics and metric and chart properties. Then Save the chart.You can add additional charts to your dashboard. After you Save the dashboard, its title appears in the Monitoring Dashboards Overview page. Dashboard charts can be viewed, updated, and deleted from the dashboard display page.
Use Monitoring alerts
You can create a Monitoring alert that notifies you when a Dataplex service or job metric crosses a specified threshold.
Create an alert
In the Google Cloud console, open Monitoring Alerting. Click + CREATE POLICY to open the Create new alerting policy form. Define an alert by adding alert conditions, policy triggers, notification channels, and documentation.
Select ADD CONDITION to open the alert condition form with the Metric tab selected. Fill in the fields to define an alert condition, then click ADD.
After adding the alert condition, complete the alert policy by setting notification channels, policy triggers, documentation, and the alert policy name.
View alerts
When an alert is triggered by a metric threshold condition, Monitoring creates an incident and a corresponding event. You can view incidents from the Monitoring Alerting page in the Google Cloud console. If you defined a notification mechanism in the alert policy, such as an email or SMS notification, Monitoring also sends a notification of the incident.
What's next
- See the Cloud Monitoring documentation.