Class TokenCount (2.0.0)

TokenCount(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Stores token counts of the LLM call.

Attributes

Name Description
total_input_token_count int
The total number of tokens used for the input to the LLM call.
conversation_context_token_count int
The number of tokens used for the conversation history in the prompt.
example_token_count int
The number of tokens used for the retrieved examples in the prompt.
total_output_token_count int
The total number of tokens used for the output of the LLM call.