Class LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub (3.32.0)

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub extends AbstractFutureStub<LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub>

A stub to allow clients to do ListenableFuture-style rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractFutureStub > LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub build(Channel channel, CallOptions callOptions)
Parameters
NameDescription
channelio.grpc.Channel
callOptionsio.grpc.CallOptions
Returns
TypeDescription
LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request)

public ListenableFuture<ComputeTokensResponse> computeTokens(ComputeTokensRequest request)

Return a list of tokens based on the input text.

Parameter
NameDescription
requestComputeTokensRequest
Returns
TypeDescription
com.google.common.util.concurrent.ListenableFuture<ComputeTokensResponse>

countTokens(CountTokensRequest request)

public ListenableFuture<CountTokensResponse> countTokens(CountTokensRequest request)

Perform a token counting.

Parameter
NameDescription
requestCountTokensRequest
Returns
TypeDescription
com.google.common.util.concurrent.ListenableFuture<CountTokensResponse>