Interface LlmUtilityServiceGrpc.AsyncService (1.15.0)

public static interface LlmUtilityServiceGrpc.AsyncService

Service for LLM related utility functions.

Methods

public default void computeTokens(ComputeTokensRequest request, StreamObserver<ComputeTokensResponse> responseObserver)

Return a list of tokens based on the input text.

Parameters
Name	Description
`request`	`ComputeTokensRequest`
`responseObserver`	`io.grpc.stub.StreamObserver<ComputeTokensResponse>`

public default void countTokens(CountTokensRequest request, StreamObserver<CountTokensResponse> responseObserver)

Perform a token counting.

Parameters
Name	Description
`request`	`CountTokensRequest`
`responseObserver`	`io.grpc.stub.StreamObserver<CountTokensResponse>`

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2024-12-18 UTC.