Cloud AI Platform v1 API - Class LlmUtilityService.LlmUtilityServiceBase (2.27.0)

Version latest

• 2.27.0 (latest)
• 2.26.0
• 2.25.0
• 2.24.0
• 2.23.0
• 2.22.0
• 2.21.0
• 2.20.0
• 2.19.0
• 2.18.0
• 2.17.0
• 2.16.0
• 2.15.0
• 2.14.0
• 2.13.0
• 2.12.0
• 2.11.0
• 2.10.0
• 2.9.0
• 2.8.0
• 2.7.0
• 2.6.0
• 2.5.0
• 2.4.0
• 2.3.0
• 2.2.0
• 2.1.0
• 2.0.0
• 1.8.0
• 1.7.0
• 1.6.0
• 1.5.0
• 1.4.0
• 1.3.0
• 1.2.0
• 1.1.0
• 1.0.0

[BindServiceMethod(typeof(LlmUtilityService), "BindService")]
public abstract class LlmUtilityService.LlmUtilityServiceBase

Reference documentation and code samples for the Cloud AI Platform v1 API class LlmUtilityService.LlmUtilityServiceBase.

Base class for server-side implementations of LlmUtilityService

Inheritance

object > LlmUtilityService.LlmUtilityServiceBase

Inherited Members

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ToString()

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Methods

ComputeTokens(ComputeTokensRequest, ServerCallContext)

public virtual Task<ComputeTokensResponse> ComputeTokens(ComputeTokensRequest request, ServerCallContext context)

Return a list of tokens based on the input text.

Parameters
Name	Description
request	ComputeTokensRequest The request received from the client.
context	ServerCallContext The context of the server-side call handler being invoked.

Returns
Type	Description
TaskComputeTokensResponse	The response to send back to the client (wrapped by a task).

CountTokens(CountTokensRequest, ServerCallContext)

public virtual Task<CountTokensResponse> CountTokens(CountTokensRequest request, ServerCallContext context)

Perform a token counting.

Parameters
Name	Description
request	CountTokensRequest The request received from the client.
context	ServerCallContext The context of the server-side call handler being invoked.

Returns
Type	Description
TaskCountTokensResponse	The response to send back to the client (wrapped by a task).