Create and optimize Gemini prompts in Vertex AI Studio

Use Vertex AI Studio to design, test, and customize your prompts sent to Google's Gemini and PaLM 2 large language models (LLM). You can view the Gemini API in Vertex AI and Vertex AI API code used to generate the responses.

From Vertex AI Studio, you can complete the following:

  • Test models using provided prompt samples
  • Design and manage your prompts
  • Compare prompt output by model
  • Evaluate your prompts against select quality metrics
  • Tune models to get tailored responses
  • Ground model output to Vertex AI Search or Google Search
  • Get the Vertex AI API code to implement your work

Before you begin prompting in Vertex AI Studio

When you use Vertex AI Studio with a Google Cloud free trial account or without signing in to Google Cloud, some features are not available as shown in the following table. To try Vertex AI Studio, accept the Vertex AI Studio Terms of Service window in the Google Cloud console.

Use without a Google Cloud account Use with a Google Cloud free trial account Use with an existing Google Cloud account
Sign in required No Yes Yes
Queries per minute (QPM) 2 QPM for all multimodal models See quota limits See quota limits
Credits offered $0 Up to $300 for 90 days $0
Prompt gallery No Yes Yes
Prompt designer Yes Yes Yes
Save prompts No Yes Yes
Prompt history No Yes Yes
Advanced parameters No No Yes
Tuning No No Yes
API usage No Yes Yes
Billing required No No Yes
How to get started Go to Vertex AI Studio Sign up for a free trial Try Vertex AI Studio in your console

Create a Google Cloud account to get started

In order to try this quickstart, you'll need to create a Google Cloud account. With this account, you'll get $300 in free credit, plus free usage of over 20 products— not charged against your $300 credit.

Get started for free

For more information on getting set up on Google Cloud after your account is created, see Set up a project and a development environment.

  1. Go to the Prompt Gallery page from the Vertex AI section in the Google Cloud console.
    Go to Prompt Gallery
  2. In the Tasks drop-down menu, select Summarization.

  3. Open the Transcript summary card.

    The model, parameters, examples, and test prompt are prefilled.

  4. To generate a summary of the prompt, in the Test section, click Submit.

    The response is displayed in the Output section.

  5. Optional: To see different results, select a different model from the Model list or change the parameters, and then click Submit.

  6. Optional: To view the Vertex AI API code that you need to generate a transcript summary, click Get code.

Master Vertex AI Studio prompt design and testing

You can create and test your prompts (inputs) for tasks that are relevant to your business use case, and generate responses. By adding inputs and outputs, the LLM is capable of learning in-context from the examples of responses.

You can create a prompt, which gives a precise instruction, and asks the LLM to complete a sentence for you or to answer one-time questions.

  1. Go to the Vertex AI Studio page from the Vertex AI section in the Google Cloud console.
    Go to Vertex AI Studio

  2. In the Generate with Gemini section, click Open Freeform.

    An untitled prompt opens.

  3. In the prompt box, add a clear and concise description of the task that you want the model to do, such as Suggest a name for a flower shop that sells bouquets of dried flowers.

  4. Click Submit.

    A response appears in response box.

  5. Optional: To view different results, adjust the prompt, model, or parameters, and click Submit.

  6. Optional: To view the Vertex AI API code that you need to generate a similar response, click Get code.

Understand Vertex AI Studio prompt categories

From the Vertex AI Studio you can test and customize prompts for different generative AI models.

Prompt samples are available in the Freeform and Chat sections of Vertex AI Studio, and contain a variety of sample prompts that are predesigned to help demonstrate model capabilities. The sample prompts are categorized by the task type, such as summarization, classification, and extraction. Each prompt is preconfigured with specified model and parameter values so you can open the sample prompt and click Submit to get the model to generate a response.

Customize and enhance Gemini prompts

Prompt design is the process of manually creating prompts that elicit the intended response from a language model. By carefully crafting prompts, you can nudge the model to generate a good result for your use case. Prompt design can be an efficient way to experiment with model output.

Vertex AI Studio enables your team to create, save, and collaboratively refine prompts. When designing a new prompt, you can input the prompt text, choose the ideal model, adjust parameters, and test it for immediate feedback. When a prompt is finalized, you can save it within your shared project in Vertex AI Studio.

To get started with prompt design, see Introduction to prompting.

Compare Gemini model output using different prompts

In Vertex AI Studio, you can compare prompt results to see what model and settings pairing works best for your use case.

From the Freeform tab, view your prompts, and select Compare next to the prompts that you want to compare. You can compare up to three prompts side-by-side.

Manage and organize Gemini prompts by using the Prompt management page

If you have many prompts, it's necessary to have a central place to manage them. You can view all of your prompts by type under the Prompt management page. You can version your prompts, restore previous versions, delete, export, and manage prompt naming. You can also add notes to prompts for record keeping and as a way to centrally collaborate with your prompting team.

Go to prompt management

Use AI-powered prompt writing tools

Vertex AI Studio includes an AI assistant to help you refine and generate prompts, which can speed up your prompt writing process. To learn more, see Use AI-powered prompt writing tools.

Ground your AI prompts with verifiable data in Vertex AI Studio

In generative AI, grounding is the ability to connect language model output to verifiable sources of information. From the Freeform and Chat pages in the Vertex AI Studio, you can choose to ground model output to Vertex AI Search or Google Search. To learn more about grounding, see the Grounding overview. To learn more about grounding model output to Google Search, see Grounding with Google Search.

Discover powerful generative AI models in Model Garden

Model Garden is a platform that helps you discover, test, customize, and deploy Google proprietary and select OSS models and assets. To explore the generative AI models and APIs that are available on Vertex AI, go to Model Garden in the Google Cloud console.

Go to Model Garden

To learn more about Model Garden, including available models and capabilities, see Explore AI models in Model Garden.

Tuning a Gemini model for improved performance

While prompt design is great for quick experimentation, if training data is available, higher quality can be achieved by tuning the model itself. Tuning a model lets you customize the model's response based on examples of the task that you want the model to perform.

To learn how to tune a foundation model, see Tune foundation models.

Use Vertex AI Studio to design, test, and customize your prompts sent to Google's Gemini and PaLM 2 large language models (LLM). After an LLM processes your prompt, it sends you its response. To learn more about the Vertex AI Studio, see Experiment with models in Vertex AI Studio.

Discover what's next with Vertex AI Studio