Class LlmUtilityServiceConnection (2.20.0)

The LlmUtilityServiceConnection object for LlmUtilityServiceClient.

This interface defines virtual methods for each of the user-facing overload sets in LlmUtilityServiceClient. This allows users to inject custom behavior (e.g., with a Google Mock object) when writing tests that use objects of type LlmUtilityServiceClient.

To create a concrete instance, see MakeLlmUtilityServiceConnection().

For mocking, see aiplatform_v1_mocks::MockLlmUtilityServiceConnection.

Functions

virtual options()

Returns
Type	Description
`Options`

virtual CountTokens(google::cloud::aiplatform::v1::CountTokensRequest const &)

Parameter
Name	Description
`request`	`google::cloud::aiplatform::v1::CountTokensRequest const &`

Returns
Type	Description
`StatusOr< google::cloud::aiplatform::v1::CountTokensResponse >`

virtual ComputeTokens(google::cloud::aiplatform::v1::ComputeTokensRequest const &)

Parameter
Name	Description
`request`	`google::cloud::aiplatform::v1::ComputeTokensRequest const &`

Returns
Type	Description
`StatusOr< google::cloud::aiplatform::v1::ComputeTokensResponse >`

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2024-06-04 UTC.