public static final class LlmUtilityServiceGrpc.LlmUtilityServiceStub extends AbstractAsyncStub<LlmUtilityServiceGrpc.LlmUtilityServiceStub>
A stub to allow clients to do asynchronous rpc calls to service LlmUtilityService.
Service for LLM related utility functions.
Inheritance
java.lang.Object > io.grpc.stub.AbstractStub > io.grpc.stub.AbstractAsyncStub > LlmUtilityServiceGrpc.LlmUtilityServiceStubInherited Members
io.grpc.stub.AbstractAsyncStub.<T>newStub(io.grpc.stub.AbstractStub.StubFactory<T>,io.grpc.Channel)
io.grpc.stub.AbstractAsyncStub.<T>newStub(io.grpc.stub.AbstractStub.StubFactory<T>,io.grpc.Channel,io.grpc.CallOptions)
io.grpc.stub.AbstractStub.<T>withOption(io.grpc.CallOptions.Key<T>,T)
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)
io.grpc.stub.AbstractStub.getCallOptions()
io.grpc.stub.AbstractStub.getChannel()
io.grpc.stub.AbstractStub.withCallCredentials(io.grpc.CallCredentials)
io.grpc.stub.AbstractStub.withChannel(io.grpc.Channel)
io.grpc.stub.AbstractStub.withCompression(java.lang.String)
io.grpc.stub.AbstractStub.withDeadline(io.grpc.Deadline)
io.grpc.stub.AbstractStub.withDeadlineAfter(java.time.Duration)
io.grpc.stub.AbstractStub.withDeadlineAfter(long,java.util.concurrent.TimeUnit)
io.grpc.stub.AbstractStub.withExecutor(java.util.concurrent.Executor)
io.grpc.stub.AbstractStub.withInterceptors(io.grpc.ClientInterceptor...)
io.grpc.stub.AbstractStub.withMaxInboundMessageSize(int)
io.grpc.stub.AbstractStub.withMaxOutboundMessageSize(int)
io.grpc.stub.AbstractStub.withOnReadyThreshold(int)
io.grpc.stub.AbstractStub.withWaitForReady()
Methods
build(Channel channel, CallOptions callOptions)
protected LlmUtilityServiceGrpc.LlmUtilityServiceStub build(Channel channel, CallOptions callOptions)
Parameters | |
---|---|
Name | Description |
channel |
io.grpc.Channel |
callOptions |
io.grpc.CallOptions |
Returns | |
---|---|
Type | Description |
LlmUtilityServiceGrpc.LlmUtilityServiceStub |
io.grpc.stub.AbstractStub.build(io.grpc.Channel,io.grpc.CallOptions)
computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
public void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
Return a list of tokens based on the input text.
Parameters | |
---|---|
Name | Description |
request |
ComputeTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<ComputeTokensResponse> |
countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
public void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
Perform a token counting.
Parameters | |
---|---|
Name | Description |
request |
CountTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<CountTokensResponse> |