Class EvaluateInstancesRequest (1.49.0)

Version latest

• 1.49.0 (latest)
• 1.48.0
• 1.47.0
• 1.46.0
• 1.45.0
• 1.44.0
• 1.43.0
• 1.39.0
• 1.38.1
• 1.37.0
• 1.36.4
• 1.35.0
• 1.34.0
• 1.33.1
• 1.32.0
• 1.31.1
• 1.30.1
• 1.29.0
• 1.28.1
• 1.27.1
• 1.26.1
• 1.25.0
• 1.24.1
• 1.23.0
• 1.22.1
• 1.21.0
• 1.20.0
• 1.19.1
• 1.18.3
• 1.17.1
• 1.16.1
• 1.15.1
• 1.14.0
• 1.13.1
• 1.12.1
• 1.11.0
• 1.10.0
• 1.9.0
• 1.8.1
• 1.7.1
• 1.6.2
• 1.5.0
• 1.4.3
• 1.3.0
• 1.2.0
• 1.1.1
• 1.0.1
• 0.9.0
• 0.8.0
• 0.7.1
• 0.6.0
• 0.5.1
• 0.4.0
• 0.3.1

EvaluateInstancesRequest(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Request message for EvaluationService.EvaluateInstances.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

Attributes
Name	Description
exact_match_input	google.cloud.aiplatform_v1beta1.types.ExactMatchInput Auto metric instances. Instances and metric spec for exact match metric. This field is a member of oneof_ metric_inputs.
bleu_input	google.cloud.aiplatform_v1beta1.types.BleuInput Instances and metric spec for bleu metric. This field is a member of oneof_ metric_inputs.
rouge_input	google.cloud.aiplatform_v1beta1.types.RougeInput Instances and metric spec for rouge metric. This field is a member of oneof_ metric_inputs.
fluency_input	google.cloud.aiplatform_v1beta1.types.FluencyInput LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric. This field is a member of oneof_ metric_inputs.
coherence_input	google.cloud.aiplatform_v1beta1.types.CoherenceInput Input for coherence metric. This field is a member of oneof_ metric_inputs.
safety_input	google.cloud.aiplatform_v1beta1.types.SafetyInput Input for safety metric. This field is a member of oneof_ metric_inputs.
groundedness_input	google.cloud.aiplatform_v1beta1.types.GroundednessInput Input for groundedness metric. This field is a member of oneof_ metric_inputs.
fulfillment_input	google.cloud.aiplatform_v1beta1.types.FulfillmentInput Input for fulfillment metric. This field is a member of oneof_ metric_inputs.
summarization_quality_input	google.cloud.aiplatform_v1beta1.types.SummarizationQualityInput Input for summarization quality metric. This field is a member of oneof_ metric_inputs.
pairwise_summarization_quality_input	google.cloud.aiplatform_v1beta1.types.PairwiseSummarizationQualityInput Input for pairwise summarization quality metric. This field is a member of oneof_ metric_inputs.
summarization_helpfulness_input	google.cloud.aiplatform_v1beta1.types.SummarizationHelpfulnessInput Input for summarization helpfulness metric. This field is a member of oneof_ metric_inputs.
summarization_verbosity_input	google.cloud.aiplatform_v1beta1.types.SummarizationVerbosityInput Input for summarization verbosity metric. This field is a member of oneof_ metric_inputs.
question_answering_quality_input	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringQualityInput Input for question answering quality metric. This field is a member of oneof_ metric_inputs.
pairwise_question_answering_quality_input	google.cloud.aiplatform_v1beta1.types.PairwiseQuestionAnsweringQualityInput Input for pairwise question answering quality metric. This field is a member of oneof_ metric_inputs.
question_answering_relevance_input	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringRelevanceInput Input for question answering relevance metric. This field is a member of oneof_ metric_inputs.
question_answering_helpfulness_input	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringHelpfulnessInput Input for question answering helpfulness metric. This field is a member of oneof_ metric_inputs.
question_answering_correctness_input	google.cloud.aiplatform_v1beta1.types.QuestionAnsweringCorrectnessInput Input for question answering correctness metric. This field is a member of oneof_ metric_inputs.
tool_call_valid_input	google.cloud.aiplatform_v1beta1.types.ToolCallValidInput Tool call metric instances. Input for tool call valid metric. This field is a member of oneof_ metric_inputs.
tool_name_match_input	google.cloud.aiplatform_v1beta1.types.ToolNameMatchInput Input for tool name match metric. This field is a member of oneof_ metric_inputs.
tool_parameter_key_match_input	google.cloud.aiplatform_v1beta1.types.ToolParameterKeyMatchInput Input for tool parameter key match metric. This field is a member of oneof_ metric_inputs.
tool_parameter_kv_match_input	google.cloud.aiplatform_v1beta1.types.ToolParameterKVMatchInput Input for tool parameter key value match metric. This field is a member of oneof_ metric_inputs.
location	str Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}

Methods

EvaluateInstancesRequest

EvaluateInstancesRequest(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Request message for EvaluationService.EvaluateInstances.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields