Method: projects.locations.publishers.models.directRawPredict

Perform an unary online prediction request to a gRPC model server for custom containers.

HTTP request

POST https://{service-endpoint}/v1/{endpoint}:directRawPredict

Where {service-endpoint} is one of the supported service endpoints.

Path parameters

Parameters
endpoint

string

Required. The name of the Endpoint requested to serve the prediction. Format: projects/{project}/locations/{location}/endpoints/{endpoint}

Request body

The request body contains data with the following structure:

JSON representation 
{
  "methodName": string,
  "input": string
}
Fields
methodName

string

Fully qualified name of the API method being invoked to perform predictions.

Format: /namespace.Service/method/ Example: /tensorflow.serving.PredictionService/models.predict
input

string (bytes format)

The prediction input.

A base64-encoded string.

Response body

If successful, the response body contains an instance of DirectRawPredictResponse.

Authorization scopes

Requires one of the following OAuth scopes:

  • https://www.googleapis.com/auth/cloud-platform
  • https://www.googleapis.com/auth/cloud-platform.read-only
  • https://www.googleapis.com/auth/cloud-vertex-ai.firstparty.predict

For more information, see the Authentication Overview.

IAM Permissions

Requires the following IAM permission on the endpoint resource:

  • aiplatform.endpoints.predict

For more information, see the IAM documentation.