- 1.63.0 (latest)
- 1.62.0
- 1.60.0
- 1.59.0
- 1.58.0
- 1.57.0
- 1.56.0
- 1.55.0
- 1.54.1
- 1.53.0
- 1.52.0
- 1.51.0
- 1.50.0
- 1.49.0
- 1.48.0
- 1.47.0
- 1.46.0
- 1.45.0
- 1.44.0
- 1.43.0
- 1.39.0
- 1.38.1
- 1.37.0
- 1.36.4
- 1.35.0
- 1.34.0
- 1.33.1
- 1.32.0
- 1.31.1
- 1.30.1
- 1.29.0
- 1.28.1
- 1.27.1
- 1.26.1
- 1.25.0
- 1.24.1
- 1.23.0
- 1.22.1
- 1.21.0
- 1.20.0
- 1.19.1
- 1.18.3
- 1.17.1
- 1.16.1
- 1.15.1
- 1.14.0
- 1.13.1
- 1.12.1
- 1.11.0
- 1.10.0
- 1.9.0
- 1.8.1
- 1.7.1
- 1.6.2
- 1.5.0
- 1.4.3
- 1.3.0
- 1.2.0
- 1.1.1
- 1.0.1
- 0.9.0
- 0.8.0
- 0.7.1
- 0.6.0
- 0.5.1
- 0.4.0
- 0.3.1
EvaluateInstancesRequest(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Request message for EvaluationService.EvaluateInstances.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields
Attributes |
|
---|---|
Name | Description |
exact_match_input |
google.cloud.aiplatform_v1beta1.types.ExactMatchInput
Auto metric instances. Instances and metric spec for exact match metric. This field is a member of oneof _ metric_inputs .
|
bleu_input |
google.cloud.aiplatform_v1beta1.types.BleuInput
Instances and metric spec for bleu metric. This field is a member of oneof _ metric_inputs .
|
rouge_input |
google.cloud.aiplatform_v1beta1.types.RougeInput
Instances and metric spec for rouge metric. This field is a member of oneof _ metric_inputs .
|
fluency_input |
google.cloud.aiplatform_v1beta1.types.FluencyInput
LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric. This field is a member of oneof _ metric_inputs .
|
coherence_input |
google.cloud.aiplatform_v1beta1.types.CoherenceInput
Input for coherence metric. This field is a member of oneof _ metric_inputs .
|
safety_input |
google.cloud.aiplatform_v1beta1.types.SafetyInput
Input for safety metric. This field is a member of oneof _ metric_inputs .
|
groundedness_input |
google.cloud.aiplatform_v1beta1.types.GroundednessInput
Input for groundedness metric. This field is a member of oneof _ metric_inputs .
|
fulfillment_input |
google.cloud.aiplatform_v1beta1.types.FulfillmentInput
Input for fulfillment metric. This field is a member of oneof _ metric_inputs .
|
summarization_quality_input |
google.cloud.aiplatform_v1beta1.types.SummarizationQualityInput
Input for summarization quality metric. This field is a member of oneof _ metric_inputs .
|
pairwise_summarization_quality_input |
google.cloud.aiplatform_v1beta1.types.PairwiseSummarizationQualityInput
Input for pairwise summarization quality metric. This field is a member of oneof _ metric_inputs .
|
summarization_helpfulness_input |
google.cloud.aiplatform_v1beta1.types.SummarizationHelpfulnessInput
Input for summarization helpfulness metric. This field is a member of oneof _ metric_inputs .
|
summarization_verbosity_input |
google.cloud.aiplatform_v1beta1.types.SummarizationVerbosityInput
Input for summarization verbosity metric. This field is a member of oneof _ metric_inputs .
|
question_answering_quality_input |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringQualityInput
Input for question answering quality metric. This field is a member of oneof _ metric_inputs .
|
pairwise_question_answering_quality_input |
google.cloud.aiplatform_v1beta1.types.PairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric. This field is a member of oneof _ metric_inputs .
|
question_answering_relevance_input |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringRelevanceInput
Input for question answering relevance metric. This field is a member of oneof _ metric_inputs .
|
question_answering_helpfulness_input |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric. This field is a member of oneof _ metric_inputs .
|
question_answering_correctness_input |
google.cloud.aiplatform_v1beta1.types.QuestionAnsweringCorrectnessInput
Input for question answering correctness metric. This field is a member of oneof _ metric_inputs .
|
tool_call_valid_input |
google.cloud.aiplatform_v1beta1.types.ToolCallValidInput
Tool call metric instances. Input for tool call valid metric. This field is a member of oneof _ metric_inputs .
|
tool_name_match_input |
google.cloud.aiplatform_v1beta1.types.ToolNameMatchInput
Input for tool name match metric. This field is a member of oneof _ metric_inputs .
|
tool_parameter_key_match_input |
google.cloud.aiplatform_v1beta1.types.ToolParameterKeyMatchInput
Input for tool parameter key match metric. This field is a member of oneof _ metric_inputs .
|
tool_parameter_kv_match_input |
google.cloud.aiplatform_v1beta1.types.ToolParameterKVMatchInput
Input for tool parameter key value match metric. This field is a member of oneof _ metric_inputs .
|
location |
str
Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}
|
Methods
EvaluateInstancesRequest
EvaluateInstancesRequest(mapping=None, *, ignore_unknown_fields=False, **kwargs)
Request message for EvaluationService.EvaluateInstances.
This message has oneof
_ fields (mutually exclusive fields).
For each oneof, at most one member field can be set at the same time.
Setting any member of the oneof automatically clears all other
members.
.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields