Review Hyperdisk Storage Pool metrics

You can view the usage metrics of your Hyperdisk Storage Pool on the Storage pools page of the Google Cloud console, or in Cloud Monitoring, Google Cloud's monitoring solution.

You can programmatically retrieve and calculate storage pool metrics using:

This document discusses the metrics Compute Engine automatically collects for each storage pool and how to view them in Cloud Monitoring.

Before you begin

  • If you haven't already, then set up authentication. Authentication is the process by which your identity is verified for access to Google Cloud services and APIs. To run code or samples from a local development environment, you can authenticate to Compute Engine by selecting one of the following options:

    Select the tab for how you plan to use the samples on this page:

    Console

    When you use the Google Cloud console to access Google Cloud services and APIs, you don't need to set up authentication.

    gcloud

    1. Install the Google Cloud CLI, then initialize it by running the following command: 

      gcloud init
    2. Set a default region and zone.

    REST

    To use the REST API samples on this page in a local development environment, you use the credentials you provide to the gcloud CLI.

      Install the Google Cloud CLI, then initialize it by running the following command: 

      gcloud init

    For more information, see Authenticate for using REST in the Google Cloud authentication documentation.

Required roles and permissions

To get the permissions that you need to view metrics for a storage pool, ask your administrator to grant you the following IAM roles on the project:

  • Monitoring Viewer (roles/monitoring.viewer)
  • To modify a metrics scope, you need the following role for the scoping project and each resource container that you want to add: Monitoring Admin (roles/monitoring.admin)

For more information about granting roles, see Manage access to projects, folders, and organizations.

You might also be able to get the required permissions through custom roles or other predefined roles.

Overview of Hyperdisk Storage Pool metrics

The Hyperdisk Storage Pool performance metrics can help you answer questions about your storage pool usage, such as the following:

Area Query or goal Available metrics
Storage pool characteristics
  • How much capacity is provisioned for the storage pool?
  • How much IOPS or throughput is provisioned for the storage pool?
  • How many disks are in the storage pool?
  • Provisioned Capacity
  • Provisioned IOPS
  • Provisioned Throughput
  • Disks
Storage pool usage
  • How much of the capacity of the storage pools has been used?
  • How much IOPS or throughput of the storage pools has been used?
  • Used Capacity
  • Used IOPS
  • Used Throughput
Storage pool aggregate disk characteristics
  • How much capacity and performance of the storage pool has been allocated to the disks created in the storage pool?
  • Total Disk Provisioned Capacity
  • Total Disk Provisioned IOPS
  • Total Disk Provisioned Throughput
Storage pool utilization
  • How much capacity has been used in the storage pool relative to the total capacity of the storage pool (the _utilization rate_)?
  • What is the utilization rate for IOPS or throughput in the storage pool?
  • Capacity Utilization (%)
  • IOPS Utilization (%)
  • Throughput Utilization (%)
Storage pool advanced provisioning
  • How much capacity has been provisioned to disks in the storage pool relative to the total capacity of the storage pool (the _overprovisioning rate_)?
  • What is the overprovisioning rate for IOPS or throughput in the storage pool?
  • Capacity Overprovisioning (%)
  • IOPS Overprovisioning (%)
  • Throughput Overprovisioning (%)

Available storage pool metrics

The following table lists the metrics available for Hyperdisk Storage Pools. For a full list of storage pool metrics, see Compute Engine metrics.

Each metric type in this table must be prefixed with compute.googleapis.com/, which has been omitted from the table for readability.

Display name
(Metric type)		 Description
Disks
(storage_pool/disks) 		Count of disks that are in the storage pool.
Provisioned Capacity
(storage_pool/provisioned_capacity) 		The size, in TiB, of the storage pool.
Provisioned IOPS
(storage_pool/provisioned_iops) 		Provisioned IOPS of the storage pool. This metric is only valid for Hyperdisk Balanced Storage Pools.
Provisioned Throughput
(storage_pool/provisioned_throughput) 		Provisioned throughput of the storage pool.
Total Disk Provisioned Capacity
(storage_pool/total_disk_provisioned_capacity) 		The sum of the capacity that is provisioned across all disks in the storage pool. A disk's provisioned capacity is the same as its total capacity. For example, a storage pool with 10 disks, each 5 TiB in size, would return 50 TiB for Total Disk Provisioned Capacity.
Used Capacity
(storage_pool/used_capacity)
  • For Standard capacity: This is the sum of the provisioned capacity for all disks in the storage pool. This is equivalent to Total Disk Provisioned Capacity.
  • For Advanced capacity: This is the number of bytes written to the disks in the storage pool. The value is aggregated for all disks in the storage pool, after data reduction.
Used IOPS
(storage_pool/used_iops)

The sum of IOPS provisioned for all disks in the storage pool. For Hyperdisk Balanced Storage Pools, the first 3,000 provisioned IOPS per disk are not counted towards this value.
Used Throughput
(storage_pool/used_throughput)

The sum of throughput provisioned for all disks in the storage pool, in MBps. For Hyperdisk Balanced Storage Pools, the first 140 MBps of provisioned throughput per disk are not counted towards this value.
Total Disk Provisioned IOPS
(storage_pool/total_disk_provisioned_iops)

Sum of the provisioned IOPS for all disks in the storage pool.
Total Disk Provisioned Throughput
(storage_pool/total_disk_provisioned_throughput)

Sum of the provisioned throughput for all disks in the storage pool, in MiBps.
Capacity Utilization (%)
(storage_pool/capacity_utilization)

The used capacity of the storage pool, represented as a percentage of the overall pool capacity. This value is calculated using the following formula:

Utilization = (used_capacity/provisioned_capacity) * 100
IOPS Utilization (%)
(storage_pool/iops_utilization)

The used IOPS of the storage pool, represented as a percentage of the overall pool IOPS. This value is calculated using the following formula:

Utilization = (used_iops/provisioned_iops) * 100
Throughput Utilization (%)
(storage_pool/throughput_utilization)

The used throughput of the storage pool, represented as a percentage of the overall pool throughput. This value is calculated using the following formula:

Utilization = (used_throughput/provisioned_throughput) * 100
Capacity Overprovisioning (%)
(storage_pool/capacity_overprovisioning)

Ratio of the total provisioned capacity of disks in the storage pool to the storage pool provisioned capacity, as a percentage.
IOPS Overprovisioning (%)
(storage_pool/iops_overprovisioning)

Ratio of the total provisioned IOPS of disks in the storage pool to the storage pool provisioned IOPS, as a percentage.
Throughput Overprovisioning (%)
(storage_pool/throughput_overprovisioning)

Ratio of the total provisioned throughput of disks in the storage pool to the storage pool provisioned throughput, as a percentage.

Review storage pool metrics

You can view the metrics for a storage pool on the Storage pools page in the console, and on the Manage storage pool page for a specific storage pool.

Go to the Storage pools page

On the Storage pools page, you can view the following for each storage pool:

  • Provisioned capacity and the remaining capacity
  • Provisioned IOPS and the remaining IOPS
  • The number of disks in the storage pool

If you click the name of a storage pool, the Manage storage pool page opens. There are two tabs on this page. On the Details tab you can view the following information:

  • At the top of the page are tiles that show the provisioned and used capacity, throughput, and IOPS.
  • In the Storage pool settings section, there is a table that shows the utilization percentages for capacity, IOPS, and throughput.

Visualize storage pool metrics on a chart

You can visualize the storage pool metrics by plotting any of the metrics listed previously with Metrics Explorer. Metrics Explorer is part of Cloud Monitoring.

Example: Visualize storage pool capacity utilization

To visualize the storage pool used capacity on a chart, follow these instructions. You can follow the same procedure for the other storage pool metrics.

  1. In the Google Cloud console, go to the  Metrics explorer page:

    Go to Metrics explorer

    If you use the search bar to find this page, then select the result whose subheading is Monitoring.

  2. In the Metric element, expand the Select a metric menu, enter Storage Pool in the filter bar, and then use the submenus to select a specific resource type and metric:
    1. In the Active resources menu, select Storage Pool.
    2. In the Active metric categories menu, select Storage_pool.
    3. In the Active metrics menu, select Used Capacity.
    4. Click Apply.
    The fully qualified name for this metric is compute.googleapis.com/storage_pool/used_capacity.
  3. Configure how the data is viewed. To display only the metrics for a specific storage pool, follow these steps:
    • In the Filter element, click Add filter, and then select storage_pool_id. For the value, enter a specific storage pool ID.
    • In the Aggregation entry, set the first menu to Unaggregated and the second menu to storage_pool_id.

    For more information about configuring a chart, see Select metrics when using Metrics Explorer.

Configure alerts based on storage pool metrics

You can optionally set alerts to trigger when the storage pool hits certain thresholds, when auto-grow activates, or when other events occur. For an example of how to configure an alerts based on metrics, see Configure alerts for snapshot schedules.

What's next