Turn advanced LLM features on or off

This page describes how to turn advanced LLM features on or off for an app.

Before you begin

If you're turning on advanced LLM features, be aware of additional costs that this can incur. See Pricing.

Make sure that any app for which you turn off advanced LLM features doesn't require these features. For example, if you have deployed a search widget that uses search with follow-ups, Google recommends that you change the search type to "single-turn without summarization" before turning off advanced LLM features. After turning advanced LLM features off, all features that require advanced LLM stop working in your app within a few minutes.

Features that require advanced LLM include:

  • Search summaries using the search method

  • Search answers using the answer method

  • Search with follow-ups using the answer or the converse method

Turn advanced LLM features on or off

To turn advanced LLM features on or off, follow these steps:

  1. In the Google Cloud console, go to the Agent Builder page.

    Agent Builder

  2. Click the app for which you want to change advanced LLM features.

  3. In the navigation menu, click Configurations.

  4. Click the Advanced tab.

  5. In the Advanced LLM features pane, click the toggle on or off.

  6. Click Save. Your changes take place within a few minutes.