REST Resource: projects.locations.conversationModels.evaluations

Resource: ConversationModelEvaluation

Represents evaluation result of a conversation model.

JSON representation 
{
  "name": string,
  "displayName": string,
  "evaluationConfig": {
    object (EvaluationConfig)
  },
  "createTime": string,
  "rawHumanEvalTemplateCsv": string,

  // Union field metrics can be only one of the following:
  "smartReplyMetrics": {
    object (SmartReplyMetrics)
  }
  // End of list of possible types for union field metrics.
}
Fields
name

string

The resource name of the evaluation. Format: projects/<Project ID>/conversationModels/<Conversation Model ID>/evaluations/<Evaluation ID>
displayName

string

Optional. The display name of the model evaluation. At most 64 bytes long.
evaluationConfig

object (EvaluationConfig)

Optional. The configuration of the evaluation task.
createTime

string (Timestamp format)

Output only. Creation time of this model.

A timestamp in RFC3339 UTC "Zulu" format, with nanosecond resolution and up to nine fractional digits. Examples: "2014-10-02T15:01:23Z" and "2014-10-02T15:01:23.045123456Z".
rawHumanEvalTemplateCsv

string

Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.
Union field metrics. Metrics details. metrics can be only one of the following:
smartReplyMetrics

object (SmartReplyMetrics)

Output only. Only available when model is for smart reply.

Methods

create

 Creates evaluation of a conversation model.

get

 Gets an evaluation of conversation model.

list

 Lists evaluations of a conversation model.