public static final class LlmUtilityServiceGrpc.LlmUtilityServiceStub extends AbstractAsyncStub<LlmUtilityServiceGrpc.LlmUtilityServiceStub>
A stub to allow clients to do asynchronous rpc calls to service LlmUtilityService.
Service for LLM related utility functions.
Inheritance
java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractAsyncStub > LlmUtilityServiceGrpc.LlmUtilityServiceStubMethods
build(Channel channel, CallOptions callOptions)
protected LlmUtilityServiceGrpc.LlmUtilityServiceStub build(Channel channel, CallOptions callOptions)
Parameters | |
---|---|
Name | Description |
channel |
io.grpc.Channel |
callOptions |
io.grpc.CallOptions |
Returns | |
---|---|
Type | Description |
LlmUtilityServiceGrpc.LlmUtilityServiceStub |
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)
computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
public void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
Return a list of tokens based on the input text.
Parameters | |
---|---|
Name | Description |
request |
ComputeTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<ComputeTokensResponse> |
countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
public void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
Perform a token counting.
Parameters | |
---|---|
Name | Description |
request |
CountTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<CountTokensResponse> |