Vertex AI V1 API - Class Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest (v0.63.0)

Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluateInstancesRequest.

Request message for EvaluationService.EvaluateInstances.

Inherits

  • Object

Extended By

  • Google::Protobuf::MessageExts::ClassMethods

Includes

  • Google::Protobuf::MessageExts

Methods

#bleu_input

def bleu_input() -> ::Google::Cloud::AIPlatform::V1::BleuInput
Returns
  • (::Google::Cloud::AIPlatform::V1::BleuInput) — Instances and metric spec for bleu metric.

    Note: The following fields are mutually exclusive: bleu_input, exact_match_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#bleu_input=

def bleu_input=(value) -> ::Google::Cloud::AIPlatform::V1::BleuInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::BleuInput) — Instances and metric spec for bleu metric.

    Note: The following fields are mutually exclusive: bleu_input, exact_match_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::BleuInput) — Instances and metric spec for bleu metric.

    Note: The following fields are mutually exclusive: bleu_input, exact_match_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#coherence_input

def coherence_input() -> ::Google::Cloud::AIPlatform::V1::CoherenceInput
Returns
  • (::Google::Cloud::AIPlatform::V1::CoherenceInput) — Input for coherence metric.

    Note: The following fields are mutually exclusive: coherence_input, exact_match_input, bleu_input, rouge_input, fluency_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#coherence_input=

def coherence_input=(value) -> ::Google::Cloud::AIPlatform::V1::CoherenceInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::CoherenceInput) — Input for coherence metric.

    Note: The following fields are mutually exclusive: coherence_input, exact_match_input, bleu_input, rouge_input, fluency_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::CoherenceInput) — Input for coherence metric.

    Note: The following fields are mutually exclusive: coherence_input, exact_match_input, bleu_input, rouge_input, fluency_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#comet_input

def comet_input() -> ::Google::Cloud::AIPlatform::V1::CometInput
Returns
  • (::Google::Cloud::AIPlatform::V1::CometInput) — Translation metrics. Input for Comet metric.

    Note: The following fields are mutually exclusive: comet_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#comet_input=

def comet_input=(value) -> ::Google::Cloud::AIPlatform::V1::CometInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::CometInput) — Translation metrics. Input for Comet metric.

    Note: The following fields are mutually exclusive: comet_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::CometInput) — Translation metrics. Input for Comet metric.

    Note: The following fields are mutually exclusive: comet_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#exact_match_input

def exact_match_input() -> ::Google::Cloud::AIPlatform::V1::ExactMatchInput
Returns
  • (::Google::Cloud::AIPlatform::V1::ExactMatchInput) — Auto metric instances. Instances and metric spec for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#exact_match_input=

def exact_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ExactMatchInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ExactMatchInput) — Auto metric instances. Instances and metric spec for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ExactMatchInput) — Auto metric instances. Instances and metric spec for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fluency_input

def fluency_input() -> ::Google::Cloud::AIPlatform::V1::FluencyInput
Returns
  • (::Google::Cloud::AIPlatform::V1::FluencyInput) — LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

    Note: The following fields are mutually exclusive: fluency_input, exact_match_input, bleu_input, rouge_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fluency_input=

def fluency_input=(value) -> ::Google::Cloud::AIPlatform::V1::FluencyInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::FluencyInput) — LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

    Note: The following fields are mutually exclusive: fluency_input, exact_match_input, bleu_input, rouge_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::FluencyInput) — LLM-based metric instance. General text generation metrics, applicable to other categories. Input for fluency metric.

    Note: The following fields are mutually exclusive: fluency_input, exact_match_input, bleu_input, rouge_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fulfillment_input

def fulfillment_input() -> ::Google::Cloud::AIPlatform::V1::FulfillmentInput
Returns
  • (::Google::Cloud::AIPlatform::V1::FulfillmentInput) — Input for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fulfillment_input=

def fulfillment_input=(value) -> ::Google::Cloud::AIPlatform::V1::FulfillmentInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::FulfillmentInput) — Input for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::FulfillmentInput) — Input for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#groundedness_input

def groundedness_input() -> ::Google::Cloud::AIPlatform::V1::GroundednessInput
Returns
  • (::Google::Cloud::AIPlatform::V1::GroundednessInput) — Input for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#groundedness_input=

def groundedness_input=(value) -> ::Google::Cloud::AIPlatform::V1::GroundednessInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::GroundednessInput) — Input for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::GroundednessInput) — Input for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#location

def location() -> ::String
Returns
  • (::String) — Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}

#location=

def location=(value) -> ::String
Parameter
  • value (::String) — Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}
Returns
  • (::String) — Required. The resource name of the Location to evaluate the instances. Format: projects/{project}/locations/{location}

#metricx_input

def metricx_input() -> ::Google::Cloud::AIPlatform::V1::MetricxInput
Returns
  • (::Google::Cloud::AIPlatform::V1::MetricxInput) — Input for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#metricx_input=

def metricx_input=(value) -> ::Google::Cloud::AIPlatform::V1::MetricxInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::MetricxInput) — Input for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::MetricxInput) — Input for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_metric_input

def pairwise_metric_input() -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricInput
Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) — Input for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_metric_input=

def pairwise_metric_input=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) — Input for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseMetricInput) — Input for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_question_answering_quality_input

def pairwise_question_answering_quality_input() -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput
Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) — Input for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_question_answering_quality_input=

def pairwise_question_answering_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) — Input for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityInput) — Input for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_summarization_quality_input

def pairwise_summarization_quality_input() -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput
Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) — Input for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_summarization_quality_input=

def pairwise_summarization_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) — Input for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityInput) — Input for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pointwise_metric_input

def pointwise_metric_input() -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricInput
Returns
  • (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) — Input for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pointwise_metric_input=

def pointwise_metric_input=(value) -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) — Input for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PointwiseMetricInput) — Input for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_correctness_input

def question_answering_correctness_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) — Input for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_correctness_input=

def question_answering_correctness_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) — Input for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessInput) — Input for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_helpfulness_input

def question_answering_helpfulness_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) — Input for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_helpfulness_input=

def question_answering_helpfulness_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) — Input for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessInput) — Input for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_quality_input

def question_answering_quality_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) — Input for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_quality_input=

def question_answering_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) — Input for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityInput) — Input for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_relevance_input

def question_answering_relevance_input() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) — Input for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_relevance_input=

def question_answering_relevance_input=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) — Input for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceInput) — Input for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#rouge_input

def rouge_input() -> ::Google::Cloud::AIPlatform::V1::RougeInput
Returns
  • (::Google::Cloud::AIPlatform::V1::RougeInput) — Instances and metric spec for rouge metric.

    Note: The following fields are mutually exclusive: rouge_input, exact_match_input, bleu_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#rouge_input=

def rouge_input=(value) -> ::Google::Cloud::AIPlatform::V1::RougeInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::RougeInput) — Instances and metric spec for rouge metric.

    Note: The following fields are mutually exclusive: rouge_input, exact_match_input, bleu_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::RougeInput) — Instances and metric spec for rouge metric.

    Note: The following fields are mutually exclusive: rouge_input, exact_match_input, bleu_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#safety_input

def safety_input() -> ::Google::Cloud::AIPlatform::V1::SafetyInput
Returns
  • (::Google::Cloud::AIPlatform::V1::SafetyInput) — Input for safety metric.

    Note: The following fields are mutually exclusive: safety_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#safety_input=

def safety_input=(value) -> ::Google::Cloud::AIPlatform::V1::SafetyInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SafetyInput) — Input for safety metric.

    Note: The following fields are mutually exclusive: safety_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SafetyInput) — Input for safety metric.

    Note: The following fields are mutually exclusive: safety_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_helpfulness_input

def summarization_helpfulness_input() -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput
Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) — Input for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_helpfulness_input=

def summarization_helpfulness_input=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) — Input for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessInput) — Input for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_quality_input

def summarization_quality_input() -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityInput
Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) — Input for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_quality_input=

def summarization_quality_input=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) — Input for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationQualityInput) — Input for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_verbosity_input

def summarization_verbosity_input() -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput
Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) — Input for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_verbosity_input=

def summarization_verbosity_input=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) — Input for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityInput) — Input for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_call_valid_input

def tool_call_valid_input() -> ::Google::Cloud::AIPlatform::V1::ToolCallValidInput
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolCallValidInput) — Tool call metric instances. Input for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_call_valid_input=

def tool_call_valid_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolCallValidInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolCallValidInput) — Tool call metric instances. Input for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolCallValidInput) — Tool call metric instances. Input for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_name_match_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_name_match_input

def tool_name_match_input() -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchInput
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) — Input for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_name_match_input=

def tool_name_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) — Input for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolNameMatchInput) — Input for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_parameter_key_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_key_match_input

def tool_parameter_key_match_input() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) — Input for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_key_match_input=

def tool_parameter_key_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) — Input for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchInput) — Input for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_kv_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_kv_match_input

def tool_parameter_kv_match_input() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) — Input for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_kv_match_input=

def tool_parameter_kv_match_input=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) — Input for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchInput) — Input for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_input, exact_match_input, bleu_input, rouge_input, fluency_input, coherence_input, safety_input, groundedness_input, fulfillment_input, summarization_quality_input, pairwise_summarization_quality_input, summarization_helpfulness_input, summarization_verbosity_input, question_answering_quality_input, pairwise_question_answering_quality_input, question_answering_relevance_input, question_answering_helpfulness_input, question_answering_correctness_input, pointwise_metric_input, pairwise_metric_input, tool_call_valid_input, tool_name_match_input, tool_parameter_key_match_input, comet_input, metricx_input. If a field in that set is populated, all other fields in the set will automatically be cleared.