Interface LlmUtilityServiceGrpc.AsyncService (3.40.0)

public static interface LlmUtilityServiceGrpc.AsyncService

Service for LLM related utility functions.

Methods

computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

public default void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

Return a list of tokens based on the input text.

Parameters
NameDescription
requestComputeTokensRequest
responseObserverio.grpc.stub.StreamObserver<ComputeTokensResponse>