Cloud AI Platform v1 API - Class LlmUtilityService.LlmUtilityServiceBase (3.12.0) 

[BindServiceMethod(typeof(LlmUtilityService), "BindService")]
public abstract class LlmUtilityService.LlmUtilityServiceBase

Reference documentation and code samples for the Cloud AI Platform v1 API class LlmUtilityService.LlmUtilityServiceBase.

Base class for server-side implementations of LlmUtilityService

Inheritance

object > LlmUtilityService.LlmUtilityServiceBase

Namespace

Google.Cloud.AIPlatform.V1

Assembly

Google.Cloud.AIPlatform.V1.dll

Methods

ComputeTokens(ComputeTokensRequest, ServerCallContext)

public virtual Task<ComputeTokensResponse> ComputeTokens(ComputeTokensRequest request, ServerCallContext context)

Return a list of tokens based on the input text.

Parameters
Name Description
request ComputeTokensRequest

The request received from the client.
context ServerCallContext

The context of the server-side call handler being invoked.
Returns
Type Description
TaskComputeTokensResponse

The response to send back to the client (wrapped by a task).

CountTokens(CountTokensRequest, ServerCallContext)

public virtual Task<CountTokensResponse> CountTokens(CountTokensRequest request, ServerCallContext context)

Perform a token counting.

Parameters
Name Description
request CountTokensRequest

The request received from the client.
context ServerCallContext

The context of the server-side call handler being invoked.
Returns
Type Description
TaskCountTokensResponse

The response to send back to the client (wrapped by a task).