public static interface LlmUtilityServiceGrpc.AsyncServiceService for LLM related utility functions.
Methods
computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)
public default void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)Return a list of tokens based on the input text.
| Parameters | |
|---|---|
| Name | Description |
request |
ComputeTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<ComputeTokensResponse> |
countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)
public default void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)Perform a token counting.
| Parameters | |
|---|---|
| Name | Description |
request |
CountTokensRequest |
responseObserver |
io.grpc.stub.StreamObserver<CountTokensResponse> |