Class SummarizationEvaluationMetrics (2.43.0) 

SummarizationEvaluationMetrics(
    mapping=None, *, ignore_unknown_fields=False, **kwargs
)

Evaluation metrics for summarization generator.

Attributes
Name Description
summarization_evaluation_results MutableSequence[google.cloud.dialogflow_v2beta1.types.SummarizationEvaluationMetrics.SummarizationEvaluationResult]
Output only. A list of evaluation results per conversation(&summary), metric and section.
summarization_evaluation_merged_results_uri str
Output only. User bucket uri for merged evaluation score and aggregation score csv.
overall_metrics MutableSequence[google.cloud.dialogflow_v2beta1.types.SummarizationEvaluationMetrics.OverallScoresByMetric]
Output only. A list of aggregated(average) scores per metric section.
overall_section_tokens MutableSequence[google.cloud.dialogflow_v2beta1.types.SummarizationEvaluationMetrics.SectionToken]
Output only. Overall token per section. This is an aggregated(sum) result of input token of summary acorss all conversations that are selected for summarization evaluation.
conversation_details MutableSequence[google.cloud.dialogflow_v2beta1.types.SummarizationEvaluationMetrics.ConversationDetail]
Output only. List of conversation details.

Classes

AccuracyDecomposition

AccuracyDecomposition(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Decomposition details for accuracy.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

AdherenceDecomposition

AdherenceDecomposition(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Decomposition details for adherence.

AdherenceRubric

AdherenceRubric(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Rubric result of the adherence evaluation. A rubric is ued to determine if the summary adheres to all aspects of the given instructions.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

CompletenessRubric

CompletenessRubric(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Rubric details of the completeness evaluation result.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

ConversationDetail

ConversationDetail(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Aggregated evaluation result on conversation level. This contains evaluation results of all the metrics and sections.

Decomposition

Decomposition(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Decomposition details

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

EvaluationResult

EvaluationResult(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Evaluation result that contains one of accuracy, adherence or completeness evaluation result.

This message has oneof_ fields (mutually exclusive fields). For each oneof, at most one member field can be set at the same time. Setting any member of the oneof automatically clears all other members.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

OverallScoresByMetric

OverallScoresByMetric(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Overall performance per metric. This is the aggregated score for each metric across all conversations that are selected for summarization evaluation.

SectionToken

SectionToken(mapping=None, *, ignore_unknown_fields=False, **kwargs)

A pair of section name and input token count of the input summary section.

.. _oneof: https://proto-plus-python.readthedocs.io/en/stable/fields.html#oneofs-mutually-exclusive-fields

SummarizationEvaluationResult

SummarizationEvaluationResult(
    mapping=None, *, ignore_unknown_fields=False, **kwargs
)

Evaluation result per conversation(&summary), metric and section.