Interface LlmUtilityServiceGrpc.AsyncService (3.42.0)

Version latest

• 3.42.0 (latest)
• 3.41.0
• 3.40.0
• 3.38.0
• 3.37.0
• 3.36.0
• 3.35.0
• 3.34.0
• 3.33.0
• 3.32.0
• 3.31.0
• 3.30.0
• 3.29.0
• 3.28.0
• 3.25.0
• 3.24.0
• 3.23.0
• 3.22.0
• 3.21.0
• 3.20.0
• 3.19.0
• 3.18.0
• 3.17.0
• 3.16.0
• 3.15.0
• 3.14.0
• 3.13.0
• 3.12.0
• 3.11.0
• 3.10.0
• 3.9.0
• 3.8.0
• 3.7.0
• 3.6.0
• 3.5.0
• 3.4.2
• 3.3.0
• 3.2.0
• 3.0.0
• 2.9.8
• 2.8.9
• 2.7.4
• 2.5.3
• 2.4.0

public static interface LlmUtilityServiceGrpc.AsyncService

Service for LLM related utility functions.

Methods

computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

public default void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

Return a list of tokens based on the input text.

Parameters
Name	Description
request	ComputeTokensRequest
responseObserver	io.grpc.stub.StreamObserver<ComputeTokensResponse>

countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

public default void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

Perform a token counting.

Parameters
Name	Description
request	CountTokensRequest
responseObserver	io.grpc.stub.StreamObserver<CountTokensResponse>