Class InputTokenLimit (2.0.0)

InputTokenLimit(value)

The input token limits for 1 LLM call. For the limit of each model, see https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models for more information.

Enums

Name Description
INPUT_TOKEN_LIMIT_UNSPECIFIED Limit not specified. Treated as 'INPUT_TOKEN_LIMIT_SHORT'.
INPUT_TOKEN_LIMIT_SHORT Input token limit up to 8k.
INPUT_TOKEN_LIMIT_MEDIUM Input token limit up to 32k.
INPUT_TOKEN_LIMIT_LONG Input token limit up to 100k.