Class EvaluateInstancesResponse (1.49.0)

Version latest

• 1.49.0 (latest)
• 1.48.0
• 1.47.0
• 1.46.0
• 1.45.0
• 1.44.0
• 1.43.0
• 1.39.0
• 1.38.1
• 1.37.0
• 1.36.4
• 1.35.0
• 1.34.0
• 1.33.1
• 1.32.0
• 1.31.1
• 1.30.1
• 1.29.0
• 1.28.1
• 1.27.1
• 1.26.1
• 1.25.0
• 1.24.1
• 1.23.0
• 1.22.1
• 1.21.0
• 1.20.0
• 1.19.1
• 1.18.3
• 1.17.1
• 1.16.1
• 1.15.1
• 1.14.0
• 1.13.1
• 1.12.1
• 1.11.0
• 1.10.0
• 1.9.0
• 1.8.1
• 1.7.1
• 1.6.2
• 1.5.0
• 1.4.3
• 1.3.0
• 1.2.0
• 1.1.1
• 1.0.1
• 0.9.0
• 0.8.0
• 0.7.1
• 0.6.0
• 0.5.1
• 0.4.0
• 0.3.1

EvaluateInstancesResponse(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Response message for EvaluationService.EvaluateInstances.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes
Name	Description
exact_match_results	google.cloud.aiplatform_v1beta1.types.ExactMatchResults Auto metric evaluation results. Results for exact match metric. This field is a member of oneof_ evaluation_results.
bleu_results	google.cloud.aiplatform_v1beta1.types.BleuResults Results for bleu metric. This field is a member of oneof_ evaluation_results.
rouge_results	google.cloud.aiplatform_v1beta1.types.RougeResults Results for rouge metric. This field is a member of oneof_ evaluation_results.
fluency_result	google.cloud.aiplatform_v1beta1.types.FluencyResult LLM-based metric evaluation result. General text generation metrics, applicable to other categories. Result for fluency metric. This field is a member of oneof_ evaluation_results.
coherence_result	google.cloud.aiplatform_v1beta1.types.CoherenceResult Result for coherence metric. This field is a member of oneof_ evaluation_results.
safety_result	google.cloud.aiplatform_v1beta1.types.SafetyResult Result for safety metric. This field is a member of oneof_ evaluation_results.
groundedness_result	google.cloud.aiplatform_v1beta1.types.GroundednessResult Result for groundedness metric. This field is a member of oneof_ evaluation_results.
fulfillment_result	google.cloud.aiplatform_v1beta1.types.FulfillmentResult Result for fulfillment metric. This field is a member of oneof_ evaluation_results.
summarization_quality_result	google.cloud.aiplatform_v1beta1.types.SummarizationQualityResult Summarization only metrics. Result for summarization quality metric. This field is a member of oneof_ evaluation_results.
pairwise_summarization_quality_result	google.cloud.aiplatform_v1beta1.types.PairwiseSummarizationQualityResult Result for pairwise summarization quality metric. This field is a member of oneof_ evaluation_results.
summarization_helpfulness_result	google.cloud.aiplatform_v1beta1.types.SummarizationHelpfulnessResult Result for summarization helpfulness metric. This field is a member of oneof_ evaluation_results.
summarization_verbosity_result	google.cloud.aiplatform_v1beta1.types.SummarizationVerbosityResult Result for summarization verbosity metric. This field is a member of oneof_ evaluation_results.
question_answering_quality_result	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringQualityResult Question answering only metrics. Result for question answering quality metric. This field is a member of oneof_ evaluation_results.
pairwise_question_answering_quality_result	google.cloud.aiplatform_v1beta1.types.PairwiseQuestionAnsweringQualityResult Result for pairwise question answering quality metric. This field is a member of oneof_ evaluation_results.
question_answering_relevance_result	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringRelevanceResult Result for question answering relevance metric. This field is a member of oneof_ evaluation_results.
question_answering_helpfulness_result	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringHelpfulnessResult Result for question answering helpfulness metric. This field is a member of oneof_ evaluation_results.
question_answering_correctness_result	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringCorrectnessResult Result for question answering correctness metric. This field is a member of oneof_ evaluation_results.
tool_call_valid_results	google.cloud.aiplatform_v1beta1.types.ToolCallValidResults Tool call metrics. Results for tool call valid metric. This field is a member of oneof_ evaluation_results.
tool_name_match_results	google.cloud.aiplatform_v1beta1.types.ToolNameMatchResults Results for tool name match metric. This field is a member of oneof_ evaluation_results.
tool_parameter_key_match_results	google.cloud.aiplatform_v1beta1.types.ToolParameterKeyMatchResults Results for tool parameter key match metric. This field is a member of oneof_ evaluation_results.
tool_parameter_kv_match_results	google.cloud.aiplatform_v1beta1.types.ToolParameterKVMatchResults Results for tool parameter key value match metric. This field is a member of oneof_ evaluation_results.

Methods

EvaluateInstancesResponse

EvaluateInstancesResponse(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Response message for EvaluationService.EvaluateInstances.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields