Managed instance groups offer autoscaling capabilities that allow you to automatically add or delete instances from a managed instance group based on increases or decreases in load. Autoscaling helps your applications gracefully handle increases in traffic and reduce costs when the need for resources is lower. You define the autoscaling policy and the autoscaler performs automatic scaling based on the measured load.
Autoscaling works by adding more instances to your instance group when there is more load (upscaling), and deleting instances when the need for instances is lowered (downscaling).
Autoscaling uses the following fundamental concepts and services.
Managed instance groups
Autoscaling is a feature of managed instance groups. A managed instance group is a pool of homogeneous instances, created from a common instance template. An autoscaler adds or deletes instances from a managed instance group. Although Compute Engine has both managed and unmanaged instance groups, only managed instance groups can be used with autoscaler.
To understand the difference between a managed instance group and unmanaged instance group, see the Instance Groups documentation.
Autoscaling policy and target utilization
To create an autoscaler, you must specify the autoscaling policy and a target utilization level that the autoscaler uses to determine when to scale the group. You can choose to scale using the following policies:
- Average CPU utilization
- HTTP load balancing serving capacity, which can be based on either utilization or requests per second.
- Stackdriver Monitoring metrics
The autoscaler continuously collects usage information based on the policy, compares actual utilization to your desired target utilization, and determines if the group needs to be scaled up or down.
The target utilization level is the level at which you want to maintain your virtual machine instances. For example, if you scale based on CPU utilization, you can set your target utilization level at 75% and the autoscaler will maintain the CPU utilization of the specified group of instances at or close to 75%. The utilization level for each metric is interpreted differently based on the autoscaling policy.
For a brief summary of each policy, see Autoscaling policies in Overviews. For a detailed discussion of each policy, see:
- Scaling Based on CPU or Load Balancing Serving Capacity
- Scaling Based on Stackdriver Monitoring Metrics
Cool down period
When setting up autoscaling, specify a cool down period to allow your instances to finish initializing before the autoscaler begins collecting information from them. Information during an instance's boot up period might not be reliable for autoscaler decisions, so you might want to omit this data. By default, the cool down period is 60 seconds.
For the purposes of scaling down, the autoscaler calculates the group's recommended target size based on peak load over the last 10 minutes. These last 10 minutes are referred to as the stabilization period.
This 10-minute stabilization period might appear as a delay in scaling down, but it is actually a built-in feature of autoscaling. The delay ensures that the smaller group size will be enough to support peak load from the last 10 minutes.
- Autoscaling only works with managed instance groups. Unmanaged instance groups are not supported.
- Autoscaling does not work with managed instance groups if proactive instance redistribution is disabled.
If you are not sure if your group is part of a Google Kubernetes Engine cluster, look for the
gkeprefix in the managed instance group name. For example,
An autoscaler can make scaling decisions based on multiple metrics, but it can handle only one policy per metric type except in the case of Stackdriver monitoring metrics; an autoscaler can handle up to five policies based on Stackdriver monitoring metrics. The autoscaler calculates the recommended number of virtual machines for each policy and then scales based on the policy that provides the largest number of virtual machines in the group.
Autoscaling works independently from autohealing. If you configured autohealing for your group, and an instance fails the health check, the autohealer will attempt to recreate the instance, which could cause the number of instances in the group to fall below the autoscaling threshold (
minNumReplicas) that you specify.
Before you begin
Learn about managed instance groups
Autoscaler is a feature of managed instance groups so you should understand how managed instance groups work before you use autoscaling.
Get a managed instance group name or URL
For all autoscaling requests, you must provide either a managed instance group name or managed instance group URL. In the
gcloud, command-line tool, you can use a managed instance group name, while the API requires a fully-qualified URL.
To get the URL to an existing managed instance group, you can use either the
instance-groups managed list --uricommand or the
instance-groups managed list [INSTANCE_GROUP] --uricommand. For example, the following command provides the URL of a managed instance group in the us-central1-f zone:
gcloud compute instance-groups managed list example-group --uri --filter="zone:(us-central1-f)"
gcloudtool returns the managed instance groups URL:
If you do not have an existing managed instance group, review how to create a managed instance group.