Try Gemini 1.5 models, the latest multimodal models in Vertex AI, and see what you can build with up to a 2M token context window. Try Gemini 1.5 models, the latest multimodal models in Vertex AI, and see what you can build with up to a 2M token context window.

Method: projects.locations.endpoints.directRawPredict

Perform an unary online prediction request to a gRPC model server for custom containers.

Endpoint

post


                https://{service-endpoint}/v1beta1/{endpoint}:directRawPredict

Where {service-endpoint} is one of the supported service endpoints.

Path parameters

endpoint string

Required. The name of the Endpoint requested to serve the prediction. Format: projects/{project}/locations/{location}/endpoints/{endpoint}

Request body

The request body contains data with the following structure:

Fields

methodName string

Fully qualified name of the API method being invoked to perform predictions.

Format: /namespace.Service/method/ Example: /tensorflow.serving.PredictionService/endpoints.predict

input string (bytes format)

The prediction input.

A base64-encoded string.

Response body

Response message for PredictionService.DirectRawPredict.

If successful, the response body contains data with the following structure:

Fields

output string (bytes format)

The prediction output.

A base64-encoded string.

JSON representation
{ "output": string }