Vertex AI V1 API - Class Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse (v0.63.0)

Reference documentation and code samples for the Vertex AI V1 API class Google::Cloud::AIPlatform::V1::EvaluateInstancesResponse.

Response message for EvaluationService.EvaluateInstances.

Inherits

  • Object

Extended By

  • Google::Protobuf::MessageExts::ClassMethods

Includes

  • Google::Protobuf::MessageExts

Methods

#bleu_results

def bleu_results() -> ::Google::Cloud::AIPlatform::V1::BleuResults
Returns
  • (::Google::Cloud::AIPlatform::V1::BleuResults) — Results for bleu metric.

    Note: The following fields are mutually exclusive: bleu_results, exact_match_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#bleu_results=

def bleu_results=(value) -> ::Google::Cloud::AIPlatform::V1::BleuResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::BleuResults) — Results for bleu metric.

    Note: The following fields are mutually exclusive: bleu_results, exact_match_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::BleuResults) — Results for bleu metric.

    Note: The following fields are mutually exclusive: bleu_results, exact_match_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#coherence_result

def coherence_result() -> ::Google::Cloud::AIPlatform::V1::CoherenceResult
Returns
  • (::Google::Cloud::AIPlatform::V1::CoherenceResult) — Result for coherence metric.

    Note: The following fields are mutually exclusive: coherence_result, exact_match_results, bleu_results, rouge_results, fluency_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#coherence_result=

def coherence_result=(value) -> ::Google::Cloud::AIPlatform::V1::CoherenceResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::CoherenceResult) — Result for coherence metric.

    Note: The following fields are mutually exclusive: coherence_result, exact_match_results, bleu_results, rouge_results, fluency_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::CoherenceResult) — Result for coherence metric.

    Note: The following fields are mutually exclusive: coherence_result, exact_match_results, bleu_results, rouge_results, fluency_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#comet_result

def comet_result() -> ::Google::Cloud::AIPlatform::V1::CometResult
Returns
  • (::Google::Cloud::AIPlatform::V1::CometResult) — Translation metrics. Result for Comet metric.

    Note: The following fields are mutually exclusive: comet_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#comet_result=

def comet_result=(value) -> ::Google::Cloud::AIPlatform::V1::CometResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::CometResult) — Translation metrics. Result for Comet metric.

    Note: The following fields are mutually exclusive: comet_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::CometResult) — Translation metrics. Result for Comet metric.

    Note: The following fields are mutually exclusive: comet_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#exact_match_results

def exact_match_results() -> ::Google::Cloud::AIPlatform::V1::ExactMatchResults
Returns
  • (::Google::Cloud::AIPlatform::V1::ExactMatchResults) — Auto metric evaluation results. Results for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#exact_match_results=

def exact_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ExactMatchResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ExactMatchResults) — Auto metric evaluation results. Results for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ExactMatchResults) — Auto metric evaluation results. Results for exact match metric.

    Note: The following fields are mutually exclusive: exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fluency_result

def fluency_result() -> ::Google::Cloud::AIPlatform::V1::FluencyResult
Returns
  • (::Google::Cloud::AIPlatform::V1::FluencyResult) — LLM-based metric evaluation result. General text generation metrics, applicable to other categories. Result for fluency metric.

    Note: The following fields are mutually exclusive: fluency_result, exact_match_results, bleu_results, rouge_results, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fluency_result=

def fluency_result=(value) -> ::Google::Cloud::AIPlatform::V1::FluencyResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::FluencyResult) — LLM-based metric evaluation result. General text generation metrics, applicable to other categories. Result for fluency metric.

    Note: The following fields are mutually exclusive: fluency_result, exact_match_results, bleu_results, rouge_results, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::FluencyResult) — LLM-based metric evaluation result. General text generation metrics, applicable to other categories. Result for fluency metric.

    Note: The following fields are mutually exclusive: fluency_result, exact_match_results, bleu_results, rouge_results, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fulfillment_result

def fulfillment_result() -> ::Google::Cloud::AIPlatform::V1::FulfillmentResult
Returns
  • (::Google::Cloud::AIPlatform::V1::FulfillmentResult) — Result for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#fulfillment_result=

def fulfillment_result=(value) -> ::Google::Cloud::AIPlatform::V1::FulfillmentResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::FulfillmentResult) — Result for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::FulfillmentResult) — Result for fulfillment metric.

    Note: The following fields are mutually exclusive: fulfillment_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#groundedness_result

def groundedness_result() -> ::Google::Cloud::AIPlatform::V1::GroundednessResult
Returns
  • (::Google::Cloud::AIPlatform::V1::GroundednessResult) — Result for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#groundedness_result=

def groundedness_result=(value) -> ::Google::Cloud::AIPlatform::V1::GroundednessResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::GroundednessResult) — Result for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::GroundednessResult) — Result for groundedness metric.

    Note: The following fields are mutually exclusive: groundedness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#metricx_result

def metricx_result() -> ::Google::Cloud::AIPlatform::V1::MetricxResult
Returns
  • (::Google::Cloud::AIPlatform::V1::MetricxResult) — Result for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#metricx_result=

def metricx_result=(value) -> ::Google::Cloud::AIPlatform::V1::MetricxResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::MetricxResult) — Result for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::MetricxResult) — Result for Metricx metric.

    Note: The following fields are mutually exclusive: metricx_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_metric_result

def pairwise_metric_result() -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricResult
Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseMetricResult) — Result for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_metric_result=

def pairwise_metric_result=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseMetricResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PairwiseMetricResult) — Result for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseMetricResult) — Result for pairwise metric.

    Note: The following fields are mutually exclusive: pairwise_metric_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_question_answering_quality_result

def pairwise_question_answering_quality_result() -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult
Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult) — Result for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_question_answering_quality_result=

def pairwise_question_answering_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult) — Result for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseQuestionAnsweringQualityResult) — Result for pairwise question answering quality metric.

    Note: The following fields are mutually exclusive: pairwise_question_answering_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_summarization_quality_result

def pairwise_summarization_quality_result() -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult
Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult) — Result for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pairwise_summarization_quality_result=

def pairwise_summarization_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult) — Result for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PairwiseSummarizationQualityResult) — Result for pairwise summarization quality metric.

    Note: The following fields are mutually exclusive: pairwise_summarization_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pointwise_metric_result

def pointwise_metric_result() -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricResult
Returns
  • (::Google::Cloud::AIPlatform::V1::PointwiseMetricResult) — Generic metrics. Result for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#pointwise_metric_result=

def pointwise_metric_result=(value) -> ::Google::Cloud::AIPlatform::V1::PointwiseMetricResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::PointwiseMetricResult) — Generic metrics. Result for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::PointwiseMetricResult) — Generic metrics. Result for pointwise metric.

    Note: The following fields are mutually exclusive: pointwise_metric_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_correctness_result

def question_answering_correctness_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult) — Result for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_correctness_result=

def question_answering_correctness_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult) — Result for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringCorrectnessResult) — Result for question answering correctness metric.

    Note: The following fields are mutually exclusive: question_answering_correctness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_helpfulness_result

def question_answering_helpfulness_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult) — Result for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_helpfulness_result=

def question_answering_helpfulness_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult) — Result for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringHelpfulnessResult) — Result for question answering helpfulness metric.

    Note: The following fields are mutually exclusive: question_answering_helpfulness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_quality_result

def question_answering_quality_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult) — Question answering only metrics. Result for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_quality_result=

def question_answering_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult) — Question answering only metrics. Result for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringQualityResult) — Question answering only metrics. Result for question answering quality metric.

    Note: The following fields are mutually exclusive: question_answering_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_relevance_result

def question_answering_relevance_result() -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult
Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult) — Result for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#question_answering_relevance_result=

def question_answering_relevance_result=(value) -> ::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult) — Result for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::QuestionAnsweringRelevanceResult) — Result for question answering relevance metric.

    Note: The following fields are mutually exclusive: question_answering_relevance_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#rouge_results

def rouge_results() -> ::Google::Cloud::AIPlatform::V1::RougeResults
Returns
  • (::Google::Cloud::AIPlatform::V1::RougeResults) — Results for rouge metric.

    Note: The following fields are mutually exclusive: rouge_results, exact_match_results, bleu_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#rouge_results=

def rouge_results=(value) -> ::Google::Cloud::AIPlatform::V1::RougeResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::RougeResults) — Results for rouge metric.

    Note: The following fields are mutually exclusive: rouge_results, exact_match_results, bleu_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::RougeResults) — Results for rouge metric.

    Note: The following fields are mutually exclusive: rouge_results, exact_match_results, bleu_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#safety_result

def safety_result() -> ::Google::Cloud::AIPlatform::V1::SafetyResult
Returns
  • (::Google::Cloud::AIPlatform::V1::SafetyResult) — Result for safety metric.

    Note: The following fields are mutually exclusive: safety_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#safety_result=

def safety_result=(value) -> ::Google::Cloud::AIPlatform::V1::SafetyResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SafetyResult) — Result for safety metric.

    Note: The following fields are mutually exclusive: safety_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SafetyResult) — Result for safety metric.

    Note: The following fields are mutually exclusive: safety_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_helpfulness_result

def summarization_helpfulness_result() -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult
Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult) — Result for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_helpfulness_result=

def summarization_helpfulness_result=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult) — Result for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationHelpfulnessResult) — Result for summarization helpfulness metric.

    Note: The following fields are mutually exclusive: summarization_helpfulness_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_quality_result

def summarization_quality_result() -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityResult
Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationQualityResult) — Summarization only metrics. Result for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_quality_result=

def summarization_quality_result=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationQualityResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SummarizationQualityResult) — Summarization only metrics. Result for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationQualityResult) — Summarization only metrics. Result for summarization quality metric.

    Note: The following fields are mutually exclusive: summarization_quality_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_verbosity_result

def summarization_verbosity_result() -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult
Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult) — Result for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#summarization_verbosity_result=

def summarization_verbosity_result=(value) -> ::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult
Parameter
  • value (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult) — Result for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::SummarizationVerbosityResult) — Result for summarization verbosity metric.

    Note: The following fields are mutually exclusive: summarization_verbosity_result, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_call_valid_results

def tool_call_valid_results() -> ::Google::Cloud::AIPlatform::V1::ToolCallValidResults
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolCallValidResults) — Tool call metrics. Results for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_call_valid_results=

def tool_call_valid_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolCallValidResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolCallValidResults) — Tool call metrics. Results for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolCallValidResults) — Tool call metrics. Results for tool call valid metric.

    Note: The following fields are mutually exclusive: tool_call_valid_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_name_match_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_name_match_results

def tool_name_match_results() -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchResults
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolNameMatchResults) — Results for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_name_match_results=

def tool_name_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolNameMatchResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolNameMatchResults) — Results for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolNameMatchResults) — Results for tool name match metric.

    Note: The following fields are mutually exclusive: tool_name_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_parameter_key_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_key_match_results

def tool_parameter_key_match_results() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults) — Results for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_key_match_results=

def tool_parameter_key_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults) — Results for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKeyMatchResults) — Results for tool parameter key match metric.

    Note: The following fields are mutually exclusive: tool_parameter_key_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_kv_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_kv_match_results

def tool_parameter_kv_match_results() -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults
Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults) — Results for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

#tool_parameter_kv_match_results=

def tool_parameter_kv_match_results=(value) -> ::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults
Parameter
  • value (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults) — Results for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.

Returns
  • (::Google::Cloud::AIPlatform::V1::ToolParameterKVMatchResults) — Results for tool parameter key value match metric.

    Note: The following fields are mutually exclusive: tool_parameter_kv_match_results, exact_match_results, bleu_results, rouge_results, fluency_result, coherence_result, safety_result, groundedness_result, fulfillment_result, summarization_quality_result, pairwise_summarization_quality_result, summarization_helpfulness_result, summarization_verbosity_result, question_answering_quality_result, pairwise_question_answering_quality_result, question_answering_relevance_result, question_answering_helpfulness_result, question_answering_correctness_result, pointwise_metric_result, pairwise_metric_result, tool_call_valid_results, tool_name_match_results, tool_parameter_key_match_results, comet_result, metricx_result. If a field in that set is populated, all other fields in the set will automatically be cleared.