Class LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub (0.6.0)

public static final class LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub extends AbstractBlockingStub<LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub>

A stub to allow clients to do synchronous rpc calls to service LlmUtilityService.

Service for LLM related utility functions.

Inheritance

java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractBlockingStub > LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub

Methods

build(Channel channel, CallOptions callOptions)

protected LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub build(Channel channel, CallOptions callOptions)
Parameters
Name Description
channel io.grpc.Channel
callOptions io.grpc.CallOptions
Returns
Type Description
LlmUtilityServiceGrpc.LlmUtilityServiceBlockingStub
Overrides
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)

computeTokens(ComputeTokensRequest request)

public ComputeTokensResponse computeTokens(ComputeTokensRequest request)

Return a list of tokens based on the input text.

Parameter
Name Description
request ComputeTokensRequest
Returns
Type Description
ComputeTokensResponse

countTokens(CountTokensRequest request)

public CountTokensResponse countTokens(CountTokensRequest request)

Perform a token counting.

Parameter
Name Description
request CountTokensRequest
Returns
Type Description
CountTokensResponse