The Agent Assist Console includes a simulator that allows you to preview your model performance before you implement it. The simulator can be used with any Agent Assist feature. This tutorial walks you through the steps required to run the Agent Assist simulator.
Before you begin
- You must create a conversation profile before you can use the simulator.
Test a conversation profile's performance
1.Navigate to the Agent Assist Console and click on the Conversation profiles menu option on the left side of the page:
The conversation profiles page displays a list of your conversation profiles. To use the simulator, click on the three vertical dots to the far right of the conversation profile that you want to test and click Use simulator.
The window that appears provides you with input boxes for both customer and agent responses. You can test conversation profiles by inputting text and evaluating the resulting suggestions. If your conversation profile is configured to suggest both replies and articles, you can choose to enable either feature or all simultaneously by clicking the Options button at the top right of the simulator page and making a selection.
Test your model by inputting text. The following example is testing a conversation profile configured for Article Suggestion. As the conversation progresses, articles are suggested on the right side of the screen and timestamped to match the message that triggered the suggestion:
In the case of Smart Reply models, suggested human agent responses are surfaced in bubbles under the Agent text bar. Only responses that have been allowlisted will be suggested. You can select an agent response by clicking on one of the bubbles.
As the conversation progresses, the suggested replies are continuously updated:
Results are a function of both the conversation profile and model parameters. To change your results, make changes to the conversation profile and/or the model and its associated allowlist.