- 0.63.0 (latest)
- 0.62.0
- 0.61.0
- 0.60.0
- 0.59.0
- 0.58.0
- 0.57.0
- 0.56.0
- 0.55.0
- 0.54.0
- 0.53.0
- 0.52.0
- 0.51.0
- 0.50.0
- 0.49.0
- 0.48.0
- 0.47.0
- 0.46.0
- 0.45.0
- 0.44.0
- 0.43.0
- 0.42.0
- 0.41.0
- 0.40.0
- 0.39.0
- 0.38.0
- 0.37.0
- 0.36.0
- 0.35.0
- 0.34.0
- 0.33.0
- 0.32.0
- 0.31.0
- 0.30.0
- 0.29.0
- 0.28.0
- 0.27.0
- 0.26.0
- 0.25.0
- 0.24.0
- 0.23.0
- 0.22.0
- 0.21.0
- 0.20.0
- 0.19.0
- 0.18.0
- 0.17.0
- 0.16.0
- 0.15.0
- 0.14.0
- 0.13.0
- 0.12.0
- 0.11.0
- 0.10.0
- 0.9.1
- 0.8.0
- 0.7.0
- 0.6.0
- 0.5.0
- 0.4.0
- 0.3.0
- 0.2.0
- 0.1.0
Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest.
Request message for EvaluationService.EvaluateInstances.
Inherits
- Object
Extended By
- Google::Protobuf::MessageExts::ClassMethods
Includes
- Google::Protobuf::MessageExts
Methods
#bleu_input
def bleu_input() -> ::Google::Cloud::AIPlatform::V1::BleuInput
-
(::Google::Cloud::AIPlatform::V1::BleuInput) — Instances and metric spec for bleu metric.
Note: The following fields are mutually exclusive:
bleu_input
,exact_match_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#bleu_input=
def bleu_input=(value) -> ::Google::Cloud::AIPlatform::V1::BleuInput
-
value (::Google::Cloud::AIPlatform::V1::BleuInput) — Instances and metric spec for bleu metric.
Note: The following fields are mutually exclusive:
bleu_input
,exact_match_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::BleuInput) — Instances and metric spec for bleu metric.
Note: The following fields are mutually exclusive:
bleu_input
,exact_match_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#coherence_input
def coherence_input() -> ::Google::Cloud::AIPlatform::V1::CoherenceInput
-
(::Google::Cloud::AIPlatform::V1::CoherenceInput) — Input for coherence metric.
Note: The following fields are mutually exclusive:
coherence_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#coherence_input=
def coherence_input=(value) -> ::Google::Cloud::AIPlatform::V1::CoherenceInput
-
value (::Google::Cloud::AIPlatform::V1::CoherenceInput) — Input for coherence metric.
Note: The following fields are mutually exclusive:
coherence_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::CoherenceInput) — Input for coherence metric.
Note: The following fields are mutually exclusive:
coherence_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#comet_input
def comet_input() -> ::Google::Cloud::AIPlatform::V1::CometInput
-
(::Google::Cloud::AIPlatform::V1::CometInput) — Translation metrics.
Input for Comet metric.
Note: The following fields are mutually exclusive:
comet_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#comet_input=
def comet_input=(value) -> ::Google::Cloud::AIPlatform::V1::CometInput
-
value (::Google::Cloud::AIPlatform::V1::CometInput) — Translation metrics.
Input for Comet metric.
Note: The following fields are mutually exclusive:
comet_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::CometInput) — Translation metrics.
Input for Comet metric.
Note: The following fields are mutually exclusive:
comet_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#exact_match_input
def exact_match_input() -> ::Google::Cloud::AIPlatform::V1::ExactMatchInput
-
(::Google::Cloud::AIPlatform::V1::ExactMatchInput) — Auto metric instances.
Instances and metric spec for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#exact_match_input=
def exact_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ExactMatchInput
-
value (::Google::Cloud::AIPlatform::V1::ExactMatchInput) — Auto metric instances.
Instances and metric spec for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ExactMatchInput) — Auto metric instances.
Instances and metric spec for exact match metric.
Note: The following fields are mutually exclusive:
exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fluency_input
def fluency_input() -> ::Google::Cloud::AIPlatform::V1::FluencyInput
-
(::Google::Cloud::AIPlatform::V1::FluencyInput) — LLM-based metric instance.
General text generation metrics, applicable to other categories.
Input for fluency metric.
Note: The following fields are mutually exclusive:
fluency_input
,exact_match_input
,bleu_input
,rouge_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fluency_input=
def fluency_input=(value) -> ::Google::Cloud::AIPlatform::V1::FluencyInput
-
value (::Google::Cloud::AIPlatform::V1::FluencyInput) — LLM-based metric instance.
General text generation metrics, applicable to other categories.
Input for fluency metric.
Note: The following fields are mutually exclusive:
fluency_input
,exact_match_input
,bleu_input
,rouge_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::FluencyInput) — LLM-based metric instance.
General text generation metrics, applicable to other categories.
Input for fluency metric.
Note: The following fields are mutually exclusive:
fluency_input
,exact_match_input
,bleu_input
,rouge_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fulfillment_input
def fulfillment_input() -> ::Google::Cloud::AIPlatform::V1::FulfillmentInput
-
(::Google::Cloud::AIPlatform::V1::FulfillmentInput) — Input for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#fulfillment_input=
def fulfillment_input=(value) -> ::Google::Cloud::AIPlatform::V1::FulfillmentInput
-
value (::Google::Cloud::AIPlatform::V1::FulfillmentInput) — Input for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::FulfillmentInput) — Input for fulfillment metric.
Note: The following fields are mutually exclusive:
fulfillment_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#groundedness_input
def groundedness_input() -> ::Google::Cloud::AIPlatform::V1::GroundednessInput
-
(::Google::Cloud::AIPlatform::V1::GroundednessInput) — Input for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#groundedness_input=
def groundedness_input=(value) -> ::Google::Cloud::AIPlatform::V1::GroundednessInput
-
value (::Google::Cloud::AIPlatform::V1::GroundednessInput) — Input for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::GroundednessInput) — Input for groundedness metric.
Note: The following fields are mutually exclusive:
groundedness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#location
def location() -> ::String
-
(::String) — Required. The resource name of the Location to evaluate the instances.
Format:
projects/{project}/locations/{location}
#location=
def location=(value) -> ::String
-
value (::String) — Required. The resource name of the Location to evaluate the instances.
Format:
projects/{project}/locations/{location}
-
(::String) — Required. The resource name of the Location to evaluate the instances.
Format:
projects/{project}/locations/{location}
#metricx_input
def metricx_input() -> ::Google::Cloud::AIPlatform::V1::MetricxInput
-
(::Google::Cloud::AIPlatform::V1::MetricxInput) — Input for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#metricx_input=
def metricx_input=(value) -> ::Google::Cloud::AIPlatform::V1::MetricxInput
-
value (::Google::Cloud::AIPlatform::V1::MetricxInput) — Input for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::MetricxInput) — Input for Metricx metric.
Note: The following fields are mutually exclusive:
metricx_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_metric_input
def pairwise_metric_input() -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricInput
-
(::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) — Input for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_metric_input=
def pairwise_metric_input=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricInput
-
value (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) — Input for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) — Input for pairwise metric.
Note: The following fields are mutually exclusive:
pairwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_question_answering_quality_input
def pairwise_question_answering_quality_input() -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput
-
(::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) — Input for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_question_answering_quality_input=
def pairwise_question_answering_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput
-
value (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) — Input for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) — Input for pairwise question answering quality metric.
Note: The following fields are mutually exclusive:
pairwise_question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_summarization_quality_input
def pairwise_summarization_quality_input() -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput
-
(::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) — Input for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pairwise_summarization_quality_input=
def pairwise_summarization_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput
-
value (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) — Input for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) — Input for pairwise summarization quality metric.
Note: The following fields are mutually exclusive:
pairwise_summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pointwise_metric_input
def pointwise_metric_input() -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricInput
-
(::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) — Input for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#pointwise_metric_input=
def pointwise_metric_input=(value) -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricInput
-
value (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) — Input for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) — Input for pointwise metric.
Note: The following fields are mutually exclusive:
pointwise_metric_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_correctness_input
def question_answering_correctness_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) — Input for question answering correctness
metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_correctness_input=
def question_answering_correctness_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput
-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) — Input for question answering correctness
metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) — Input for question answering correctness
metric.
Note: The following fields are mutually exclusive:
question_answering_correctness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_helpfulness_input
def question_answering_helpfulness_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) — Input for question answering helpfulness
metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_helpfulness_input=
def question_answering_helpfulness_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput
-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) — Input for question answering helpfulness
metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) — Input for question answering helpfulness
metric.
Note: The following fields are mutually exclusive:
question_answering_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_quality_input
def question_answering_quality_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) — Input for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_quality_input=
def question_answering_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput
-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) — Input for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) — Input for question answering quality metric.
Note: The following fields are mutually exclusive:
question_answering_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_relevance_input
def question_answering_relevance_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) — Input for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#question_answering_relevance_input=
def question_answering_relevance_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput
-
value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) — Input for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) — Input for question answering relevance metric.
Note: The following fields are mutually exclusive:
question_answering_relevance_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#rouge_input
def rouge_input() -> ::Google::Cloud::AIPlatform::V1::RougeInput
-
(::Google::Cloud::AIPlatform::V1::RougeInput) — Instances and metric spec for rouge metric.
Note: The following fields are mutually exclusive:
rouge_input
,exact_match_input
,bleu_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#rouge_input=
def rouge_input=(value) -> ::Google::Cloud::AIPlatform::V1::RougeInput
-
value (::Google::Cloud::AIPlatform::V1::RougeInput) — Instances and metric spec for rouge metric.
Note: The following fields are mutually exclusive:
rouge_input
,exact_match_input
,bleu_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::RougeInput) — Instances and metric spec for rouge metric.
Note: The following fields are mutually exclusive:
rouge_input
,exact_match_input
,bleu_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#safety_input
def safety_input() -> ::Google::Cloud::AIPlatform::V1::SafetyInput
-
(::Google::Cloud::AIPlatform::V1::SafetyInput) — Input for safety metric.
Note: The following fields are mutually exclusive:
safety_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#safety_input=
def safety_input=(value) -> ::Google::Cloud::AIPlatform::V1::SafetyInput
-
value (::Google::Cloud::AIPlatform::V1::SafetyInput) — Input for safety metric.
Note: The following fields are mutually exclusive:
safety_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SafetyInput) — Input for safety metric.
Note: The following fields are mutually exclusive:
safety_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_helpfulness_input
def summarization_helpfulness_input() -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput
-
(::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) — Input for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_helpfulness_input=
def summarization_helpfulness_input=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput
-
value (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) — Input for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) — Input for summarization helpfulness metric.
Note: The following fields are mutually exclusive:
summarization_helpfulness_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_quality_input
def summarization_quality_input() -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityInput
-
(::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) — Input for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_quality_input=
def summarization_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityInput
-
value (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) — Input for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) — Input for summarization quality metric.
Note: The following fields are mutually exclusive:
summarization_quality_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_verbosity_input
def summarization_verbosity_input() -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput
-
(::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) — Input for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#summarization_verbosity_input=
def summarization_verbosity_input=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput
-
value (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) — Input for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) — Input for summarization verbosity metric.
Note: The following fields are mutually exclusive:
summarization_verbosity_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_call_valid_input
def tool_call_valid_input() -> ::Google::Cloud::AIPlatform::V1::ToolCallValidInput
-
(::Google::Cloud::AIPlatform::V1::ToolCallValidInput) — Tool call metric instances.
Input for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_call_valid_input=
def tool_call_valid_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolCallValidInput
-
value (::Google::Cloud::AIPlatform::V1::ToolCallValidInput) — Tool call metric instances.
Input for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolCallValidInput) — Tool call metric instances.
Input for tool call valid metric.
Note: The following fields are mutually exclusive:
tool_call_valid_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_name_match_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_name_match_input
def tool_name_match_input() -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchInput
-
(::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) — Input for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_name_match_input=
def tool_name_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchInput
-
value (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) — Input for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) — Input for tool name match metric.
Note: The following fields are mutually exclusive:
tool_name_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_parameter_key_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_key_match_input
def tool_parameter_key_match_input() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput
-
(::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) — Input for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_key_match_input=
def tool_parameter_key_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput
-
value (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) — Input for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) — Input for tool parameter key match metric.
Note: The following fields are mutually exclusive:
tool_parameter_key_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_kv_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_kv_match_input
def tool_parameter_kv_match_input() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput
-
(::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) — Input for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
#tool_parameter_kv_match_input=
def tool_parameter_kv_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput
-
value (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) — Input for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.
-
(::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) — Input for tool parameter key value match metric.
Note: The following fields are mutually exclusive:
tool_parameter_kv_match_input
,exact_match_input
,bleu_input
,rouge_input
,fluency_input
,coherence_input
,safety_input
,groundedness_input
,fulfillment_input
,summarization_quality_input
,pairwise_summarization_quality_input
,summarization_helpfulness_input
,summarization_verbosity_input
,question_answering_quality_input
,pairwise_question_answering_quality_input
,question_answering_relevance_input
,question_answering_helpfulness_input
,question_answering_correctness_input
,pointwise_metric_input
,pairwise_metric_input
,tool_call_valid_input
,tool_name_match_input
,tool_parameter_key_match_input
,comet_input
,metricx_input
. If a field in that set is populated, all other fields in the set will automatically be cleared.