Class LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub (0.6.0)

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub extends AbstractFutureStub<LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub>

A stub to allow clients to do ListenableFuture-style rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractFutureStub > LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub build(Channel channel, CallOptions callOptions)
Parameters
Name Description
channel io.grpc.Channel
callOptions io.grpc.CallOptions
Returns
Type Description
LlmUtilityServiceGrpc.LlmUtilityServiceFutureStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request)

public ListenableFuture<ComputeTokensResponse> computeTokens(ComputeTokensRequest request)

Return a list of tokens based on the input text.

Parameter
Name Description
request ComputeTokensRequest
Returns
Type Description
com.google.common.util.concurrent.ListenableFuture<ComputeTokensResponse>

countTokens(CountTokensRequest request)

public ListenableFuture<CountTokensResponse> countTokens(CountTokensRequest request)

Perform a token counting.

Parameter
Name Description
request CountTokensRequest
Returns
Type Description
com.google.common.util.concurrent.ListenableFuture<CountTokensResponse>