Interface LlmUtilityServiceGrpc.AsyncService (0.3.0)

public static interface LlmUtilityServiceGrpc.AsyncService

Service for LLM related utility functions.

Methods

public default void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

Return a list of tokens based on the input text.

Parameters
Name	Description
`request`	`ComputeTokensRequest`
`responseObserver`	`io.grpc.stub.StreamObserver<ComputeTokensResponse>`

public default void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

Perform a token counting.

Parameters
Name	Description
`request`	`CountTokensRequest`
`responseObserver`	`io.grpc.stub.StreamObserver<CountTokensResponse>`