Starting April 29, 2025, Gemini 1.5 Pro and Gemini 1.5 Flash models are not available in projects that have no prior usage of these models, including new projects. For details, see Model versions and lifecycle.
Stay organized with collections
Save and categorize content based on your preferences.
This page explains what Provisioned Throughput is and when to use Provisioned Throughput.
Introduction to Provisioned Throughput
Provisioned Throughput is a fixed-cost, fixed-term subscription
available in several term-lengths that reserves throughput for
supported generative AI models on Vertex AI.
To reserve your throughput, you must specify the model and available
locations in which the model
runs.
When to use Provisioned Throughput
If any of the following considerations apply to your use case, consider using
Provisioned Throughput:
You are building real-time generative AI production applications, such as
chatbots and agents.
Your critical workloads consistently require high throughput. Throughput
measurement depends on the model.
You want to provide a consistent and predictable experience for users of your
applications.
You want deterministic generative AI costs by paying a fixed monthly or weekly
price with control of overages.
Provisioned Throughput is one of two ways to consume your
generative AI models. The second way is pay-as-you-go, which is also referred to
as on-demand.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-08-18 UTC."],[],[]]
