Class LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub (3.36.0)

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub extends AbstractBlockingStub<LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub>

A stub to allow clients to do synchronous rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractBlockingStub > LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub build(Channel channel, CallOptions callOptions)
Parameters
NameDescription
channelio.grpc.Channel
callOptionsio.grpc.CallOptions
Returns
TypeDescription
LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request)

public ComputeTokensResponse computeTokens(ComputeTokensRequest request)

Return a list of tokens based on the input text.

Parameter
NameDescription
requestComputeTokensRequest
Returns
TypeDescription
ComputeTokensResponse

countTokens(CountTokensRequest request)

public CountTokensResponse countTokens(CountTokensRequest request)

Perform a token counting.

Parameter
NameDescription
requestCountTokensRequest
Returns
TypeDescription
CountTokensResponse