Vertex AI V1 API - Class Google::Cloud::AIPlatform::V1::TokensInfo (v0.39.0)

Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::TokensInfo.

Tokens info with a list of tokens and the corresponding list of token ids.

Inherits

  • Object

Extended By

  • Google::Protobuf::MessageExts::ClassMethods

Includes

  • Google::Protobuf::MessageExts

Methods

#token_ids

def token_ids() -> ::Array<::Integer>
Returns
  • (::Array<::Integer>) — A list of token ids from the input.

#token_ids=

def token_ids=(value) -> ::Array<::Integer>
Parameter
  • value (::Array<::Integer>) — A list of token ids from the input.
Returns
  • (::Array<::Integer>) — A list of token ids from the input.

#tokens

def tokens() -> ::Array<::String>
Returns
  • (::Array<::String>) — A list of tokens from the input.

#tokens=

def tokens=(value) -> ::Array<::String>
Parameter
  • value (::Array<::String>) — A list of tokens from the input.
Returns
  • (::Array<::String>) — A list of tokens from the input.