Experiment with prompts in Vertex AI Studio

Vertex AI Studio is a Google Cloud console tool for rapidly prototyping and testing generative AI models. You can test sample prompts, design your own prompts, and customize foundation models to handle tasks that meet your application's needs. From Vertex AI Studio, you can complete the following:

  • Test models using provided prompt samples
  • Design and manage your prompts
  • Compare prompt output by model
  • Evaluate your prompts against select quality metrics
  • Tune models to get tailored responses
  • Get the code to implement your work

To use the Vertex AI Studio, go to the Google Cloud console, and select the Vertex AI Studio page.

Go to Vertex AI Studio

Prompt samples are available in the Multimodal and Language sections of Vertex AI Studio, and contain a variety of sample prompts that are predesigned to help demonstrate model capabilities. The sample prompts are categorized by the task type, such as summarization, classification, and extraction. Each prompt is preconfigured with specified model and parameter values so you can open the sample prompt and click Submit to get the model to generate a response.

prompt-ui

Design and manage your prompts

Prompt design is the process of manually creating prompts that elicit the intended response from a language model. By carefully crafting prompts, you can nudge the model to generate a good result for your use case. Prompt design can be an efficient way to experiment with model output.

Vertex AI Studio enables your team to create, save, and collaboratively refine prompts. When designing a new prompt, you can input the prompt text, choose the ideal model, adjust parameters, and test it for immediate feedback. When a prompt is finalized, you can save it within your shared project in Vertex AI Studio.

Compare prompt output by model

In Vertex AI Studio, you can compare prompt results to see what model and settings pairing works best for your use case.

From the Language tab, view your prompts, and select Compare next to the prompts that you want to compare. You can compare up to three prompts side-by-side.

Prompt lifecycle management

If you have many prompts, it's necessary to have a central place to manage them. From the Multimodal and Language pages, you can view all of your prompts by type under the My prompts tab. From these pages, you can version your prompts, restore previous versions, delete, export, and manage prompt naming. You can also add notes to prompts for record keeping and as a way to centrally collaborate with your prompting team.

Get response citations

If you are using a model in Vertex AI Studio like Gemini, you can receive text responses based on your input. Our features are intended to produce original content and not replicate existing content at length. If Vertex AI Studio quotes at length from a web page, it cites that page in the output.

text-citation

You can change the quality of responses by tweaking the temperature (output randomness), and experimenting with other response parameters in Vertex AI Studio.

Citations are available in Vertex AI Studio and are available in the API. To learn more about Responsible AI and citations, see Citation metadata.

Explore generative AI models in Model Garden

Model Garden is a platform that helps you discover, test, customize, and deploy Google proprietary and select OSS models and assets. To explore the generative AI models and APIs that are available on Vertex AI, go to Model Garden in the Google Cloud console.

Go to Model Garden

To learn more about Model Garden, including available models and capabilities, see Explore AI models in Model Garden.

Tune a foundation model

While prompt design is great for quick experimentation, if training data is available, higher quality can be achieved by tuning the model itself. Tuning a model lets you customize the model's response based on examples of the task that you want the model to perform.

To learn how to tune a foundation model, see Tune foundation models.

What's next