Class EvaluationMetric (1.36.3)

EvaluationMetric(
    bleu: typing.Optional[float] = None, rougeLSum: typing.Optional[float] = None
)

The evaluation metric response.

Parameters

NameDescription
bleu float

Optional. BLEU (Bilingual evauation understudy). Scores based on sacrebleu implementation.

rougeLSum float

Optional. ROUGE-L (Longest Common Subsequence) scoring at summary level.

Properties

input_dataset_paths

The Google Cloud Storage paths to the dataset used for this evaluation.

task_name

The type of evaluation task for the evaluation..