Resource: ModelEvaluation
A collection of metrics calculated by comparing Model's predictions on all of the test data against annotations from the test data.
JSON representation |
---|
{ "name": string, "displayName": string, "metricsSchemaUri": string, "metrics": value, "createTime": string, "sliceDimensions": [ string ], "dataItemSchemaUri": string, "annotationSchemaUri": string, "modelExplanation": { object ( |
Fields | |
---|---|
name |
Output only. The resource name of the ModelEvaluation. |
displayName |
The display name of the ModelEvaluation. |
metricsSchemaUri |
Points to a YAML file stored on Google Cloud Storage describing the |
metrics |
Evaluation metrics of the Model. The schema of the metrics is stored in |
createTime |
Output only. timestamp when this ModelEvaluation was created. A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: |
sliceDimensions[] |
All possible |
dataItemSchemaUri |
Points to a YAML file stored on Google Cloud Storage describing [EvaluatedDataItemView.data_item_payload][] and This field is not populated if there are neither EvaluatedDataItemViews nor EvaluatedAnnotations under this ModelEvaluation. |
annotationSchemaUri |
Points to a YAML file stored on Google Cloud Storage describing [EvaluatedDataItemView.predictions][], [EvaluatedDataItemView.ground_truths][], This field is not populated if there are neither EvaluatedDataItemViews nor EvaluatedAnnotations under this ModelEvaluation. |
modelExplanation |
Aggregated explanation metrics for the Model's prediction output over the data this ModelEvaluation uses. This field is populated only if the Model is evaluated with explanations, and only for AutoML tabular Models. |
explanationSpecs[] |
Describes the values of |
metadata |
The metadata of the ModelEvaluation. For the ModelEvaluation uploaded from Managed Pipeline, metadata contains a structured value with keys of "pipelineJobId", "evaluation_dataset_type", "evaluation_dataset_path", "row_based_metrics_path". |
ModelEvaluationExplanationSpec
JSON representation |
---|
{
"explanationType": string,
"explanationSpec": {
object ( |
Fields | |
---|---|
explanationType |
Explanation type. For AutoML Image Classification models, possible values are:
|
explanationSpec |
Explanation spec details. |
Methods |
|
---|---|
|
Gets a ModelEvaluation. |
|
Imports an externally generated ModelEvaluation. |
|
Lists ModelEvaluations in a Model. |