Quota adjuster

Google Cloud uses quotas to restrict how much of a particular shared resource you can use. As your needs grow, you may find that you need higher quota limits.

Quota adjuster observes your resource consumption, and when usage nears a quota limit, quota adjuster proactively submits a quota increase request on your behalf. Quota adjuster addresses the following issues:

  • Reduced risk of quota-induced outages. Quota adjuster responds proactively to growth in your resource consumption. This helps eliminate potential outages caused by quota limits that have become too restrictive.

  • Reduced need to monitor and file quota increase requests. Quota adjuster uses a simple approach that reduces the need to watch for unplanned increases and submit manual increase requests.

How quota adjuster works

Once you enable quota adjuster on a project, it begins monitoring all applicable quotas and applies the following logic:

  • Quota adjuster checks if the peak usage has approached the quota limit during a specified duration.
  • If so, quota adjuster attempts to increase the quota limit (typically around 10-20%).

If it's possible to increase the quota limit, the increase will be approved and the quota limit adjusted. You can still manually request increases to quota limits at any time whether or not quota adjuster is enabled. Note that Quota adjuster will not attempt to increase the limit on any quota that have a manual quota cap applied to it.

Quota adjuster will only attempt to increase the limit of a quota. It will not attempt to lower the limit. In order to lower a limit, you can apply a manual quota cap.

The history of all quota increase requests made by quota adjuster is available in the Quotas page of Cloud Console. You can also set alerts to monitor any changes initiated by quota qdjuster. See Monitoring increase requests section below for more details.

Availability

Quota adjuster requires a sufficient volume of historical usage data in order to accurately determine when to request additional quota. For this reason, the option to enable quota adjuster is only available on projects with enough historical activity to support accurate predictions.

During this preview, the following Compute Engine quotas are available for automated increases using quota adjuster:

  • CPUs
  • N2 CPUs
  • N2D CPUs
  • C2 CPUs
  • C2D CPUs
  • Persistent Disk Standard (GB)

In the future, quotas for more Google Cloud services will become eligible. For projects where quota adjuster is enabled, quotas will automatically be monitored by quota adjuster as they are added. No additional action is required on your part.

For a full list of all the quotas eligible for adjustment, please refer to the list in the Configurations tab of the Quotas page in Cloud Console.

Enable quota adjuster

To enable quota adjuster you must have the following IAM permissions:

  • cloudquotas.quotas.update
  • cloudquotas.quotas.get

image

To enable quota adjuster on your Google Cloud project:

  1. Navigate to the IAM & Admin > Quotas page.
  2. Click the Configurations tab.
  3. Click the Enable switch.

When the Status column shows Enabled, quota adjuster will automatically monitor your usage and issue quota increase requests.

View quota increase requests

To view quota increase requests you must have the following IAM permissions:

  • resourcemanager.projects.get
  • serviceusage.services.list
  • serviceusage.quotas.get

image

To view quota increase requests issued by quota adjuster:

  1. Navigate to the IAM & Admin > Quotas page.
  2. Click the Increase Requests tab.

The Increase Requests view allows you to see all increase requests for your project, including both manually requested increases and increases issued by quota adjuster. To view only the increases issued by quota adjuster, click the Filter field, select Type from the menu, and enter Auto.

Monitor increase requests with notifications

image

To monitor quota adjuster on your Google Cloud project:

  1. Navigate to the IAM & Admin > Quotas page.
  2. Click the Configurations tab.
  3. Click Create Alert.
  4. Choose one or both of the alert templates:
    1. All adjustments by Quota Adjuster will send an alert every time quota adjuster issues an increase request for this project.
    2. Quota Adjuster errors and failures will issue alerts only when quota adjuster attempts to increase a quota limit in the project and is unable to do so.
  5. You can optionally adjust the default values for the minimum amount of time between notifications and the incident autoclose duration by clicking Show Options.
  6. Select the Notification Channel you wish to use to receive notifications. If you wish to adjust your notification channel settings or create a new notification channel, click Manage Notification Channels.
  7. Click OK to finalize your settings and begin receiving alerts.

If you wish to cancel or adjust your alert settings, you can manage their configuration at any time by clicking Manage Alert Policies, or visiting the Policies page in Cloud Monitoring. The alert policies will have one of the following names, based on which option you selected:

  • Quota adjuster errors and failures
  • All adjustments by quota adjuster

Disable quota adjuster

To disable quota adjuster on your Google Cloud project:

  1. Navigate to the IAM & Admin > Quotas page.
  2. Click the Configurations tab.
  3. Click the Enable switch.

image

Once the switch turns gray and the status column reads Not Enabled for all quotas, quota adjuster will stop monitoring your usage or issuing quota increase requests.

Troubleshooting

Quota increase denials

In rare cases, it's possible that a quota increase initiated by quota adjuster will be denied. This sometimes occurs when Google Cloud is unable to increase the quota limit for a particular project, resource, or region beyond a certain limit. You may still request a manual quota increase in these scenarios.

Alerts can be configured to monitor cases where a quota request initiated by quota adjuster was denied. For more information see Monitoring increase requests.

Limitations

  • The preview launch is focused on commonly used compute resources, as the quotas for these resources are most often targeted for manual adjustment.
  • Currently the settings for enabling quota adjuster are only available on a per-project basis.
  • Currently the only way to enable this setting is via Cloud Console.