Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::TokensInfo.
Tokens info with a list of tokens and the corresponding list of token ids.
Inherits
- Object
Extended By
- Google::Protobuf::MessageExts::ClassMethods
Includes
- Google::Protobuf::MessageExts
Methods
#token_ids
def token_ids() -> ::Array<::Integer>
Returns
- (::Array<::Integer>) — A list of token ids from the input.
#token_ids=
def token_ids=(value) -> ::Array<::Integer>
Parameter
- value (::Array<::Integer>) — A list of token ids from the input.
Returns
- (::Array<::Integer>) — A list of token ids from the input.
#tokens
def tokens() -> ::Array<::String>
Returns
- (::Array<::String>) — A list of tokens from the input.
#tokens=
def tokens=(value) -> ::Array<::String>
Parameter
- value (::Array<::String>) — A list of tokens from the input.
Returns
- (::Array<::String>) — A list of tokens from the input.