Class OutputTokenLimit (2.0.0)

OutputTokenLimit(value)

The output token limits for 1 LLM call. The limits are subject to change. For the limit of each model, see https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models for more information.

Enums

Name Description
OUTPUT_TOKEN_LIMIT_UNSPECIFIED Limit not specified.
OUTPUT_TOKEN_LIMIT_SHORT Input token limit up to 512 tokens.
OUTPUT_TOKEN_LIMIT_MEDIUM Input token limit up to 1k.
OUTPUT_TOKEN_LIMIT_LONG Input token limit up to 2k.