This guide provides recommendations for monitoring and improving the performance of data store handlers.
Track your agent's performance
You can monitor your agents conversation history and you can use the analytics tool for agent statistics.
Run self-service evaluation
You can run self-service evaluation which will assess the quality of your data store agent and recommend changes.
Improve agent responses
If you find some responses during testing that don't meet your expectations, try the following.
- You can overwrite an answer by adding an FAQ entry for a specific question.
- If you are experiencing low quality answers with a structured FAQ, try using unstructured FAQ.
- Use the parse and chunk configurations to optimize responses.
- To ban certain phrases, see agent settings: banned phrases.
- To customize Responsible AI (RAI) content filtering, see agent settings: safety filters.
- To fine-tune your agent's response based on information from earlier in the conversation, you can configure search conditions. This feature is only available for data store tools.
Optimization of data store tools used by Playbooks
This setting accelerates a data store's RAG response and improves latency by not rewriting the user query nor dynamically populating tool parameters. This means that the user query is passed to the data store as-is and no filters or user metadata-related parameters are populated.
You can enable this feature in the Dialogflow CX console by selecting the playbook, then clicking the Settings tab. You have the option of configuring the Playbook to continue processing any follow-up actions immediately or waiting for the next end-user input.
If enabled, the following Playbook instructions are still honored:
- When to answer the user query using the data store(s).
- When not to answer user query using the data store(s) and instead provide an alternate response.
- Any instructions that are defensive such as, for example, "don't answer questions about competitors".
If enabled, the following Playbook instructions are ignored. Don't activate this setting if you have any of the following query requirements:
- Specific data store filters to be populated using the instructions.
- Instructions to apply any user personalization metadata passed by filters.
- Any other instructions to rewrite the user query before querying the data store.
Handle conversation digressions
An end-user may ask clarifying questions during a conversation. For example, during credit card information collection, they may want to clarify what a CVV is. In this case, your agent should answer the question and return to collecting the necessary credit card information. To accomplish this, you can create a data store handler with data stores that answer the question, apply that handler to the flow start page of the flow that handles credit card information collection, and set a transition target for this handler to return to the "current page".
Handle undesired intent matches
If your agent is matching intents when it should be using a data store handler, you can try the following to correct this:
- Delete or modify training phrases that are vague, so that all of your training phrases precisely handle the desired intention and do not conflict with your data store content.
- Use negative examples to avoid intent matching.
Data store filtering
In some cases, you may only want certain data stores available for queries, depending on session parameter values. For example, you may have unique data stores for product categories. To accomplish data store filtering for product categories:
- Set session parameters to product categories.
- Create condition routes that check the values of the session parameters and transition to a specific page that has the desired data store handler.
- The data store handler should transition back to the calling page, so that the conversation can continue.
Data store search configuration
For more information about fine-tuning your data store search results, see the data store search configuration pa