Auto speech adaptation

Auto speech adaptation improves the speech recognition accuracy of your agent by:

  • Using agent information and conversation state as speech context hints.

Enable beta features

You may need to enable the beta API:

  1. Go to the Dialogflow Console
  2. Select an agent
  3. Click the settings settings button next to the agent's name
  4. Scroll down while on the General tab and ensure that Beta Features is enabled
  5. If you have made changes, click Save

Enable auto speech adaptation

To enable auto speech adaptation:

  1. Select the Speech tab
  2. Scroll to the Improve Speech Recognition Quality section
  3. Toggle Enable Auto Speech Adaptation on

Example speech recognition improvements

Once you have enabled auto speech adaptation, you can build your agent in ways to take advantage of it. The following examples show how speech recognition may be improved with certain changes to your agent:

  1. If you define a training phrase that uses the @sys.number system entity, and the end user says "two", it may be recognized as "to", "too", "2", or "two". With auto speech adaptation enabled, Dialogflow uses the @sys.number entity as a hint during speech recognition, and the parameter is recognized as "two" or "2".

  2. If you define training phrases with a phrase like "stuffy nose", a similar sounding user utterance is reliably recognized as "stuffy nose" and not "stuff he knows".

  3. If you define entities for product or service names offered by your company, and the end user mentions these terms in an utterance, they are more likely to be recognized.

  4. Currently, speech recognition doesn't have built-in support for recognizing alphanumeric sequences. With auto speech adaptation, you can work around this limitation. If you want an employee ID that is three letters followed by three digits to be accurately recognized, you could build your agent with the following entities and parameters:

    • Define a digit entity that contains 10 entity entries (with synonyms):
      0, 0
      1, 1
      ...
      9, 9
    • Define a letter entity that contains 26 entity entries (with synonyms):
      A, A
      B, B
      ...
      Z, Z
    • Define a employee-id entity that contains a single entity entry (without synonyms):
      @letter @letter @letter @digit @digit @digit
    • Use @employee-id as a parameter in a training phrase.

Limits

The following limitations apply:

  • Auto speech adaptation does not work for Actions on Google (Google Assistant), because speech recognition is performed by Actions on Google before sending data to Dialogflow.
Was this page helpful? Let us know how we did:

Send feedback about...

Dialogflow Documentation
Need help? Visit our support page.