Class EvaluatedAnnotation (1.24.1)

Version 1.24.1

• 1.48.0 (latest)
• 1.47.0
• 1.46.0
• 1.45.0
• 1.44.0
• 1.43.0
• 1.39.0
• 1.38.1
• 1.37.0
• 1.36.4
• 1.35.0
• 1.34.0
• 1.33.1
• 1.32.0
• 1.31.1
• 1.30.1
• 1.29.0
• 1.28.1
• 1.27.1
• 1.26.1
• 1.25.0
• 1.24.1
• 1.23.0
• 1.22.1
• 1.21.0
• 1.20.0
• 1.19.1
• 1.18.3
• 1.17.1
• 1.16.1
• 1.15.1
• 1.14.0
• 1.13.1
• 1.12.1
• 1.11.0
• 1.10.0
• 1.9.0
• 1.8.1
• 1.7.1
• 1.6.2
• 1.5.0
• 1.4.3
• 1.3.0
• 1.2.0
• 1.1.1
• 1.0.1
• 0.9.0
• 0.8.0
• 0.7.1
• 0.6.0
• 0.5.1
• 0.4.0
• 0.3.1

EvaluatedAnnotation(mapping=None, *, ignore_unknown_fields=False, **kwargs)

True positive, false positive, or false negative.

EvaluatedAnnotation is only available under ModelEvaluationSlice with slice of annotationSpec dimension.

Attributes
Name	Description
type_	google.cloud.aiplatform_v1.types.EvaluatedAnnotation.EvaluatedAnnotationType Output only. Type of the EvaluatedAnnotation.
predictions	MutableSequence[google.protobuf.struct_pb2.Value] Output only. The model predicted annotations. For true positive, there is one and only one prediction, which matches the only one ground truth annotation in ground_truths. For false positive, there is one and only one prediction, which doesn't match any ground truth annotation of the corresponding data_item_view_id][EvaluatedAnnotation.data_item_view_id]. For false negative, there are zero or more predictions which are similar to the only ground truth annotation in ground_truths but not enough for a match. The schema of the prediction is stored in ModelEvaluation.annotation_schema_uri
ground_truths	MutableSequence[google.protobuf.struct_pb2.Value] Output only. The ground truth Annotations, i.e. the Annotations that exist in the test data the Model is evaluated on. For true positive, there is one and only one ground truth annotation, which matches the only prediction in predictions. For false positive, there are zero or more ground truth annotations that are similar to the only prediction in predictions, but not enough for a match. For false negative, there is one and only one ground truth annotation, which doesn't match any predictions created by the model. The schema of the ground truth is stored in ModelEvaluation.annotation_schema_uri
data_item_payload	google.protobuf.struct_pb2.Value Output only. The data item payload that the Model predicted this EvaluatedAnnotation on.
evaluated_data_item_view_id	str Output only. ID of the EvaluatedDataItemView under the same ancestor ModelEvaluation. The EvaluatedDataItemView consists of all ground truths and predictions on data_item_payload. Can be passed in [GetEvaluatedDataItemView's][ModelService.GetEvaluatedDataItemView][] id][GetEvaluatedDataItemViewRequest.id].
explanations	MutableSequence[google.cloud.aiplatform_v1.types.EvaluatedAnnotationExplanation] Explanations of predictions. Each element of the explanations indicates the explanation for one explanation Method. The attributions list in the EvaluatedAnnotationExplanation.explanation object corresponds to the predictions list. For example, the second element in the attributions list explains the second element in the predictions list.
error_analysis_annotations	MutableSequence[google.cloud.aiplatform_v1.types.ErrorAnalysisAnnotation] Annotations of model error analysis results.

Inheritance

builtins.object > proto.message.Message > EvaluatedAnnotation

Classes

EvaluatedAnnotationType

EvaluatedAnnotationType(value)

Describes the type of the EvaluatedAnnotation. The type is determined

Values: EVALUATED_ANNOTATION_TYPE_UNSPECIFIED (0): Invalid value. TRUE_POSITIVE (1): The EvaluatedAnnotation is a true positive. It has a prediction created by the Model and a ground truth Annotation which the prediction matches. FALSE_POSITIVE (2): The EvaluatedAnnotation is false positive. It has a prediction created by the Model which does not match any ground truth annotation. FALSE_NEGATIVE (3): The EvaluatedAnnotation is false negative. It has a ground truth annotation which is not matched by any of the model created predictions.