Starting April 29, 2025, Gemini 1.5 Pro and Gemini 1.5 Flash models are not available in projects that have no prior usage of these models, including new projects. For details, see Model versions and lifecycle.
Optional. Autorater config used for evaluation. Currently only publisher Gemini models are supported. Format: projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}.
Response body
If successful, the response body contains an instance of Operation.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-09-05 UTC."],[],[],null,["# Method: locations.evaluateDataset\n\n**Full name**: projects.locations.evaluateDataset\n\nEvaluates a dataset based on a set of given metrics. \n\n### Endpoint\n\npost `https:``/``/aiplatform.googleapis.com``/v1beta1``/{location}:evaluateDataset` \n\n### Path parameters\n\n`location` `string` \nRequired. The resource name of the Location to evaluate the dataset. Format: `projects/{project}/locations/{location}`\n\n### Request body\n\nThe request body contains data with the following structure:\nFields `dataset` `object (`[EvaluationDataset](/vertex-ai/generative-ai/docs/reference/rest/v1beta1/projects.locations/evaluateDataset#EvaluationDataset)`)` \nRequired. The dataset used for evaluation.\n`metrics[]` `object (`[Metric](/vertex-ai/generative-ai/docs/reference/rest/v1beta1/projects.locations.tuningJobs#Metric)`)` \nRequired. The metrics used for evaluation.\n`outputConfig` `object (`[OutputConfig](/vertex-ai/generative-ai/docs/reference/rest/v1beta1/projects.locations.tuningJobs#OutputConfig)`)` \nRequired. Config for evaluation output.\n`autoraterConfig` `object (`[AutoraterConfig](/vertex-ai/generative-ai/docs/reference/rest/v1beta1/projects.locations.tuningJobs#AutoraterConfig)`)` \nOptional. Autorater config used for evaluation. Currently only publisher Gemini models are supported. Format: `projects/{PROJECT}/locations/{LOCATION}/publishers/google/models/{MODEL}.` \n\n### Response body\n\nIf successful, the response body contains an instance of [Operation](/vertex-ai/generative-ai/docs/reference/rest/Shared.Types/ListOperationsResponse#Operation).\n\nEvaluationDataset\n-----------------\n\nThe dataset used for evaluation.\nFields \n`source` `Union type` \nThe source of the dataset. `source` can be only one of the following:\n`gcsSource` `object (`[GcsSource](/vertex-ai/generative-ai/docs/reference/rest/v1beta1/projects.locations.ragCorpora.ragFiles#GcsSource)`)` \nCloud storage source holds the dataset. Currently only one Cloud Storage file path is supported.\n`bigquerySource` `object (`[BigQuerySource](/vertex-ai/generative-ai/docs/reference/rest/v1beta1/projects.locations/evaluateDataset#BigQuerySource)`)` \nBigQuery source holds the dataset. \n\nBigQuerySource\n--------------\n\nThe BigQuery location for the input content.\nFields `inputUri` `string` \nRequired. BigQuery URI to a table, up to 2000 characters long. Accepted forms:\n\n- BigQuery path. For example: `bq://projectId.bqDatasetId.bqTableId`."]]
