For Vertex AI Agents release notes, see the Dialogflow release notes.
You can see the latest product updates for all of Google Cloud on the Google Cloud page, browse and filter all release notes in the Google Cloud console, or programmatically access release notes in BigQuery.
April 24, 2024
Vertex AI Agent Builder: Renamed in the console and documentation
The Google Cloud console and the documentation at cloud.google.com have been updated to show the current product name for Vertex AI Agent Builder. On the console, look for "Agent Builder".
You might see the old name (Vertex AI Search and Conversation) in some places—for example, in videos.
April 09, 2024
Vertex AI Search: Document chunking support for more search types (Public preview)
When document chunking is turned on for an unstructured data store, search summaries and search with follow-ups are supported in Public preview.
For information, see Chunk documents for RAG.
Vertex AI Search: Document ranking API (Public preview)
The ranking API takes a list of documents and reranks those documents based on how relevant the documents are to a query. This is a stateless API that does not require you to index documents in advance.
For more information, see Rank and rerank documents.
Vertex AI Search: Check grounding (Public preview)
The check grounding API is available as a Public preview feature.
The check grounding API determines how grounded a piece of text is in a given set of facts. Perfect grounding requires that every statement in the text can be attributed to one or more of the given facts. The API returns support scores and citations.
Additionally, as an experimental feature, the API also generates contradicting citations that show which facts contradict the text and how strongly.
For more information, see Check grounding and the check API.
Vertex AI Search: Answers with summaries and follow-ups (Public preview)
The answer API improves on the search with summary and search with follow-ups features. For example, it better handles complex queries, can do multi-step retrieval, and provides customization of answer styles.
The answer API is supported in Public preview.
For more information, see Get answers and follow-ups.
Vertex AI Search: FHIR data streaming ingestion (Private preview)
Select the import frequency for your healthcare FHIR data. You can either perform a one-time batch import or set up a streaming import. Streaming import is available as a Private preview feature.
For more information, see Create a healthcare search data store.
Vertex AI Search: Autocomplete support for healthcare search (Public preview)
Autocomplete is available as a Public preview feature for healthcare data search. The autocomplete configuration uses a canonical medical data source to generate autocomplete suggestions for healthcare data stores.
For more information, see Configure autocomplete.
Vertex AI Search: Connect Google Drive to Vertex AI Search (GA)
Syncing Google Drive data to Vertex AI Search is available in GA. For more information about creating a Google Drive data store, see Sync from Google Drive.
Vertex AI Search: Connect multiple search apps to the same data store (GA)
Connecting more than one generic search app to a single data store is supported in GA. With this capability, you can create multiple apps that search across the same data without having to ingest that data multiple times.
Vertex AI Search: Blended search (GA)
Blended search, where you can search across multiple data stores using a single search app, is available in GA. For more information about blended search, see About connecting multiple data stores.
Vertex AI Search: Connect Spanner, Cloud SQL, Firestore, and Bigtable to Vertex AI Search (Public preview)
Importing data from Spanner, Cloud SQL, Firestore, and Bigtable to Vertex AI Search is available in Public preview. For more information about creating a Google Drive data store, see Create a search data store.
Vertex AI Search: Media search (GA)
Vertex AI Search for media is Generally available (GA).
You can create media search apps on media data stores. You can connect the media search app to an existing media data store or create a new one. You can also use document metadata to filter search queries of your media content.
Vertex AI Search: Additional languages supported for media search
Vertex AI Search for media is supported in nine languages: Arabic, English, French, German, Hindi, Korean, Japanese, Portuguese, and Spanish.
For more information, see Languages.
Vertex AI Search: Search-as-you-type for media apps (GA)
The search-as-you-type feature is Generally available (GA) for media search apps.
Search results are returned after each character instead of after the full query is entered. Search-as-you-type is ideal for search apps with awkward input devices such as television remotes. You can enable search-as-you-type through the widget UI as well as through the API.
For more information, see Get search-as-you-type results for a media app.
March 28, 2024
Vertex AI Search: Autocomplete updates
Autocomplete is Generally available (GA) for the US and EU multi-regions as well for the global region.
Autocomplete supports access transparency. This means that, when access transparency is enabled, if Google personal access your autocomplete data, this is recorded in the Access Transparency logs.
For information about autocomplete, see Configure autocomplete, and for information about Access Transparency, see Enable Access Transparency in Vertex AI Search.
Vertex AI Search: Structured data stores (GA)
Use of data stores containing structured data is Generally available (GA). Additionally, two new field value types are allowed for structured data stores: geolocation and datetime.
For information about structured data stores, see Structured data in Prepare for ingesting and Schemas: auto-dectection versus providing you own.
Vertex AI Search: Boost search results (Public preview)
Boosting search results using custom numerical attributes and according to freshness is available in Public preview.
For more information, see Boost search results.
Vertex AI Search: Extractive segments and relevance scores (GA)
Extractive segments and relevance scores for extractive segments are GA.
For more information, see Extractive segments.
Vertex AI Search: Document chunking and parsing improvements (Public preview)
The following improvements have been introduced for document chunking and parsing:
- Adjacent chunks: When returning chunks in search responses, you can return chunks from immediately before and after the relevant chunk in the source document. Doing so can improve context and accuracy.
- Page span: Chunk metadata in search responses includes the span of pages where the chunk appeared in the source document.
- List chunks: List all chunks from a specific source document.
- Get chunks: Get a specific chunk.
- Get processed documents in JSON: Get a parsed document or a chunked document in JSON format.
- Bring your own chunks (Preview with allowlist): Upload data that you've already chunked. Contact your Google account team if you're interested in trying this feature.
For more information, see Parse and chunk documents.
Vertex AI Search: Media recommendations analytics (GA)
Analytics for media recommendations are GA. You can view analytics for your media recommendations apps in the Google Cloud console.
For more information, see View analytics.
March 15, 2024
Vertex AI Search: Sync from Google Drive (Preview with allowlist)
Connecting to Google Drive as a data source for Vertex AI Search is available as a Preview with allowlist feature. For more information, see Sync from Google Drive.
March 12, 2024
Vertex AI Search: Vertex AI Search for healthcare (GA)
Vertex AI Search for healthcare is Generally available (GA). Healthcare search lets you query healthcare records stored in FHIR data stores. For more information, see Vertex AI Search. With healthcare search, you can:
Vertex AI Search: Specify a parser for unstructured content (Public preview)
You can control how documents are parsed when they are uploaded to Vertex AI Search. Parser specification is available in Public preview.
Vertex AI Search provides a digital parser (GA), an OCR parser for PDFs (Public preview), and a layout parser (Public Preview). During data store creation for generic search apps with unstructured data, you can set a default parser for the data store and an override parser for specific file types.
For more information, see Parse documents.
Vertex AI Search: Turn on document chunking (Public preview)
To use Vertex AI Search for retrieval-augmented generation (RAG) for LLMs, you can turn on document chunking when creating a data store. Document chunking is available in Public preview.
When document chunking is turned on, your documents are split into chunks when you ingest documents into your data store, and your search app can return chunks of data in search results instead of full documents. Using chunked data for RAG increases relevance for LLM answers and reduces computational load for LLMs. Document chunking is in Public preview. For more information, see Chunk documents for RAG.
Vertex AI Search: Connect ServiceNow as a data source (Private preview)
You can connect ServiceNow as a third-party data source for Vertex AI Search. For more information, see Connect a third-party data source.
March 05, 2024
Vertex AI Search: Watch time duration objective for media recommendations apps
When you create a media recommendations app, you can select watch duration per session as a business objective. Optimizing for watch duration per session maximizes the duration of media consumption.
For more information, see Watch duration per session.
February 28, 2024
Vertex AI Search: Add metadata to your web index (Public preview)
If advanced website indexing is enabled in your data store, you can add metadata to the data store schema to enrich your indexing.
For more information, see Add metadata for advanced site indexing.
Vertex AI Search: Automatic web page refresh (Public preview)
With advanced website indexing, Vertex AI Search performs conditional, automatic refresh.
For more information, see Refresh web pages.
Vertex AI Search: Apply tuned search to some queries (Public preview)
You can specify whether you want a query to use the tuned search model or the non-tuned search model. This is particularly helpful for testing the difference between the two versions of the model.
Previously, the tuned search model was enabled (or disabled) for all queries against the data store.
For more information, see Test tuned search and use it for individual search queries.
Vertex AI Search: Access controlled data sources (Public preview)
Access control for BigQuery, Cloud Storage, and Confluence data is available in Public preview. This feature allows you to limit the data that users can view in your search app's results. Google uses your identity provider to identify the end user performing a search and determine if they have access to the documents that are returned as results. Google Identity and third-party identity provider federation are supported.
For more information, see Use data source access control.
Vertex AI Search: Blended search (Public preview)
Blended search, where multiple data stores can be connected to a single generic search app, is available in Public preview. This feature allows you to use one generic search app to search across multiple sources and types of data.
For more information, see About connecting multiple data stores.
Vertex AI Search: Search analytics (GA)
Search analytics are GA for global data stores. For data stores in US and EU multi-regions, viewing analytics is in Public Preview.
For more information, see View analytics.
February 26, 2024
Vertex AI Search: Use Terraform to create search apps
You can use Terraform to create search apps for your Vertex AI Search.
For information, see Create a search app.
February 15, 2024
Vertex AI Search: Stable Gemini Pro answer generation model
gemini-pro@001/answer_gen/v1 is available as a stable, generally available model for answer generation. For information about all available models for answer generation, see Specify the summarization model.
January 31, 2024
Vertex AI Search: CMEK for US and EU is GA
Customer-managed encryption keys (CMEK) are available in the US and the EU as GA with allowlist.
If you store your data in a US or EU multi-region data store, you can provide your own encryption key to protect your data at rest.
For information, see Customer-managed encryption keys.
Vertex AI Search: Check grounding in Preview with allowlist
The CheckGrounding API determines how grounded a piece of text is in a given set of facts. Perfect grounding requires that every statement in the text can be attributed to one or more of the given facts. The API returns an overall score of 0 to 1, indicating how grounded the text is, along with citations to the appropriate given facts for each statement.
See Check grounding.
Vertex AI Search and Conversation: Use Terraform to create data stores
You can use Terraform to create data stores for your Vertex AI Search and Conversation apps. The data stores are created empty; you then ingest the data through the console or an API call.
For information, see, for example, Create a search data store.
Vertex AI Search: Gemini Pro for search summaries
You can now choose Gemini Pro as a model for generating search summaries.
For more information, see Specify the summarization model.
Vertex AI Search: Updates to autocomplete
Autocomplete is available for your search apps in the US and EU multi-regions as Public preview.
Autocomplete removes unsafe and offensive terms in eight languages in addition to English (
en).For more information, see Autocomplete features.
December 21, 2023
Vertex AI Search: Access controlled data sources in Preview with allowlist
Access control for BigQuery, Cloud Storage, and Confluence data is available in Preview with allowlist. This feature allows you to limit the data that users can view in your search app's results. Google uses your identity provider to identify the end user performing a search and determine if they have access to the documents that are returned as results. Google Identity and third-party identity provider federation are supported.
Vertex AI Search: Bring your own parsed documents in Preview with allowlist
Importing pre-parsed unstructured documents into Vertex AI Search data stores is available in Preview with allowlist. For example, instead of importing a raw PDF document, you can parse the PDF yourself and import the parsing result instead. This lets you to import your documents in a structured way, ensuring that search and answer generation have full information about the document's layout and elements.
See Bring your own parsed document. For more information, contact your Google account team.
Vertex AI Search: User events joined with documents asynchronously for generic apps
For generic search and recommendation apps, user events are joined with their associated documents asynchronously. For media apps, user events continue to be joined synchronously.
For more about user event import, see Import historical user events.
December 13, 2023
Vertex AI Search: Media search (Preview with allowlist)
You can create media search apps on media data stores. You can connect the media search app to an existing media data store or create a new one. You can also use document metadata to filter search queries of your media content.
Media search is available as a Preview with allowlist capability. To use this capability, contact your Google account team.
See About media documents and data stores and Filter media search.
Vertex AI Search: Company name field for search apps
When you create a search app, you supply the name of your company or organization. This can improve the quality of the responses for summarization and search with follow-ups.
See Create a search app.
Vertex AI Search: Upgrade to advanced website indexing
You can update an existing data store to advanced website indexing.
Vertex AI Search: Support for Access Transparency is GA
Access Transparency supports Vertex AI Search in GA.
Vertex AI Search: Additional languages supported
The search, snippets, and extractive answers features are supported in 25 languages.
Summarization is supported in most languages.
See Languages.
Vertex AI Search: Estimate the size of your web data
You can call an API to get an estimate of the size of your web data prior to importing it into a data store. With this information, you can estimate your monthly storage costs using the Vertex AI Search and Conversation pricing page or the Google Cloud Pricing Calculator.
Vertex AI Search: Customized Summaries is GA
Customized summaries are available in GA. For search with answers and search with follow-ups, you can provide free-form natural-language instructions to customize the summaries that are returned with your results. Customize summaries through the console for search widget results and through the API for other search requests.
For more information, see Get customizable summaries.
Vertex AI Search: Filter search with follow-ups
You can filter your queries for search with follow-ups, both for website data and for structured data with metada.
Vertex AI Search: Search tuning (Public preview)
Search tuning is available as a Public preview feature. You can upload additional training data to tune the model for your search app.
For information, see Improve search results with search tuning.
Vertex AI Search: Use multiple serving configs for media recommendations apps
For media recommendations apps, you can create, edit, and delete serving configs. Serving configs contain recommendation demotion and diversity configurations that are used when generating results. When you make recommendations calls to a media app, you can specify different serving configs to get different levels of demotion and diversity in recommendations from the same app.
For more information, see Create and manage serving configs.
Vertex AI Search: Citations with metadata for summaries (Public preview)
When citations are turned on for summaries, the response includes citation metadata. This includes metadata about the sources that are being referenced and information about which sources apply to specific sentences in the summary.
See Get citations.
Vertex AI Search: OCR processing (Public preview)
OCR processing is available in Public preview. If you have non-searchable PDFs (scanned PDFs or PDFs with text inside images), you can turn on optical character recognition
(OCR) processing during data store creation. This allows Vertex AI Search to extract elements such as text blocks and tables. If you instead have searchable PDFs that contain many tables, you might also consider turning on OCR processing with useNativeText set to true and enhancedDocumentElements set to table.
Vertex AI Search: Blended search (Preview with allowlist)
Blended search, where multiple data stores can be connected to a single generic search app, is available in Preview with allowlist. This feature allows you to use one generic search app to search across multiple sources and types of data.
November 15, 2023
Vertex AI Search: Autocomplete denylist (Preview with allowlist)
Importing an autocomplete denylist is available as a preview with allowlist feature. To use this feature, contact your Google account team.
For information about autocomplete denylists, see Use an autocomplete denylist.
November 14, 2023
Vertex AI Search: Additional languages supported
Extractive answers are now supported in the following languages:
- Arabic
- Chinese (Simplified)
- Japanese
See Languages.
November 09, 2023
Vertex AI Search: New model for search summarization
A better model for generating search summaries has been launched. This underlying model improves the quality of search summaries and their grounding in the provided document corpus. You might see some differences in summary output after this update.
For more information about search summaries, see Get search summaries.
Vertex AI Search: Confidence scores are changed to relevance scores (Preview with allowlist)
Confidence scores are renamed to relevance scores. Scores are returned in the relevanceScore field. Previously, they were returned in the confidenceScore field.
This feature is in preview with allowlist. For more information about relevance scores, see Get snippets and extracted content.
November 06, 2023
Vertex AI Search: Multi-region support for US and EU locations is GA
The US multi-region and the EU multi-region APIs are generally available (GA).
For more information about multi-regions including limitations, see Vertex AI Search locations.
October 27, 2023
Vertex AI Search: Create media recommendations in Vertex AI Search
You can now create apps for media recommendations in Vertex AI Search. Media recommendations include content such as videos, news, and music. For more information, see Vertex AI Search.
Important: If you are using Discovery for Media for media recommendations, you need to switch to the media recommendations capability of Vertex AI Search. All of the existing data and models that you created with Discovery for Media will automatically appear in the Vertex AI Search and Conversation console, with the models appearing as apps. For more information, see Migrate from Discovery for Media to media recommendations.
October 13, 2023
Vertex AI Search: Customer-managed encryption key integration for the EU
Customer-managed encryption keys (CMEK) is available in the EU as an allowlisted preview feature.
If you store your data in an EU multi-region data store, you can provide your own encryption key to protect your data at rest.
For information, see Customer-managed encryption keys.
October 09, 2023
Vertex AI Search and Conversation: Renamed in the console and documentation
The Google Cloud console and the documentation at cloud.google.com have been updated to show the current product name for Vertex AI Search and Conversation. On the console, look for "Search and Conversation".
You might see the old name (Generative AI App Builder) in some places—for example, in the API reference.
September 29, 2023
Vertex AI Search (Enterprise Search): Customer-managed encryption key integration
Customer-managed encryption keys (CMEK) is available as an allowlisted preview feature.
If you store your data in a US multi-region data store, you can provide your own encryption key to protect your data at rest.
For information, see Customer-managed encryption keys.
Vertex AI Search (Enterprise Search): Search tuning
Search tuning is available as an allowlisted preview feature. You provide additional training data in the form of query and segment pairs. We use this data to tune the model for your app.
For information, see Improve search results with search tuning.
Vertex AI Search (Enterprise Search): VPC Service Controls are GA
Virtual Private Cloud Service Controls support for Enterprise Search is generally available (GA).
For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.
Vertex AI Search (Enterprise Search): Data location
Vertex AI Search may be configured for data location pursuant to the "Data Location" section of the Service Specific Terms.
For information about data residency in Vertex AI Search, see Enterprise Search locations.
Vertex AI Search (Enterprise Search): Support for Access Transparency
Access Transparency supports Vertex AI Search in preview.
For more information, see Enable Access Transparency in Enterprise Search.
Vertex AI Search (Enterprise Search): Citations for search with follow-ups
Citations indicate from which search results specific sentences in the summary are taken.
For more information, see Configure the summary.
Vertex AI Search (Enterprise Search): Ignore adversarial queries and non-summary seeking queries for search with follow-ups
Ignore adversarial queries can stop generation of summaries that are unsafe or violate policy.
Non-summary seeking queries stop generation of summaries that aren't helpful for some queries.
For more information, see Configure the summary.
Vertex AI Search (Enterprise Search): Additional languages supported
Search, snippets, and other features are now supported in the following languages:
- Arabic
- Chinese (Simplified)
- Greek
- Hebrew
- Japanese
- Korean
- Polish
- Russian
See Languages.
September 22, 2023
Vertex AI Search (Enterprise Search): Third-party data connectors
You can set up your Vertex AI Search data stores to sync with data from Jira, Confluence, or Salesforce.
This feature is in private preview. To try this feature, contact your Google account team to find out if you qualify.
For more about setting up a connection to third-party data, see Create an Enterprise Search data store.
September 20, 2023
Manually refresh your web pages
Call the recrawlUris method to manually refresh specific web pages in a data store with Advanced website indexing turned on. You can check the status of the recrawl operation by polling the operations.get method.
September 19, 2023
Vertex AI Search (Enterprise Search): Turn Enterprise edition on or off
You can turn Enterprise edition features on or off for existing apps.
For more about Enterprise edition, see About advanced features.
September 15, 2023
Vertex AI Search (Enterprise Search): Languages for summarization
Summarization is supported in the following languages in addition to English:
- German (
de-DE) - Spanish (
es-ES) - Italian (
it-IT) - French (
fr-FR) - Dutch (
nl-NL) - Portuguese (
pt-BR) - Swedish (
sv-SE)
See Languages.
Vertex AI Search (Enterprise Search): Adjacent segments for preview with allowlist
When getting extractive segments, you can also get up to 3 segments from immediately before and after the relevant segment. Adjacent segments can add context and accuracy to the relevant segment. Turning on adjacent segments can increase latency.
Adjacent segments is in preview with allowlist. Contact your Google account team to try out adjacent segments.
See Extractive segments.
Vertex AI Search (Enterprise Search): Customizable summaries for preview with allowlist
When you request summaries, you can customize them by providing natural-language instructions. You can request customizations such as such as the length and level of detail, style of output (such as "simple"), language of output, focus of answer, and format (such as tables, bullets, and XML).
Customizable summaries are in preview with allowlist. Contact your Google account team if you're interested in trying this feature.
Vertex AI Search (Enterprise Search): ISO compliance
Vertex AI Search meets ISO 27001, ISO 27017, ISO 27018, and ISO 27701 compliance standards.
September 08, 2023
Vertex AI Search (Enterprise Search): Image search is GA
Image search is now generally available (GA).
Vertex AI Search (Enterprise Search): Page numbers for extractive segments
Page numbers can be returned with extractive segments. Page numbers indicate where an answer was extracted from in a document.
For more about extractive segments, see Get snippets and extracted content.
August 29, 2023
Vertex AI Search and Conversation is the new product name for Generative AI App Builder.
Generative AI App Builder: GA
Gen AI App Builder is publicly and generally available (GA).
Separation of data stores and apps
Data stores and apps are separate entities. In the console, you can see your apps on the Apps page and your data stores on the Data Stores page. You can create a data store and attach it to an app during app creation, or create a new data store during app creation.
Apps and data stores have a one-to-one relationship. Each app is associated with one data store; they can't be disconnected after you attach them. This change does not affect the functionality of your existing apps.
Enterprise Search: Search with follow-ups is GA
Previously, the search with follow-ups feature was called multi-turn search.
Search with follow-ups is now generally available (GA).
Search with follow-ups can be applied to websites if advanced website indexing is enabled and to unstructured data.
In addition, to improve consistency between search with an answer and search with follow-ups, the response from the conversations.converse method v1 provides the summary object and no longer provides the reply and references objects. The response from the v1beta version of the method remains unchanged.
SafeSearch is available with the search with follow-ups feature.
For general information about search with follow-ups, see Search with follow-ups.
Enterprise Search: Improvements to snippets, extractive answers, and extractive segments
Snippet status is now returned along with the snippet.
Extractive answers include the document page number where the answer was found.
Up to 10 extractive segments can be returned for a search result.
Enterprise Search: Multi-region support for US and EU locations
When you create a data store, you can specify global, the US multi-region, or the EU multi-region.
For more information including limitations associated with multi-region use, see Enterprise Search locations.
Enterprise Search: Languages
More features in more languages are supported for Enterprise Search.
See Languages.
Enterprise Search: Verify website domains
New requirement to verify your domain ownership for any websites in your data stores with advanced website indexing turned on.
Enterprise Search: Confidence scores
Confidence scores for extractive segments are available in preview with allowlist. Scores are based on the similarity of the query to the extracted segment.
See Extractive segments.
Enterprise Search: Serving controls using the API are allowlisted GA
Boost, filter, synonym, and redirect serving controls affect search results returned through API method calls.
For more information, see Configure serving controls.
Enterprise Search: Related questions
Related questions are available as an allowlisted, preview feature for search with follow-ups.
For information, see Related questions.
August 18, 2023
Enterprise Search: Multi-turn, conversational search UI
Multi-turn, conversational search from within the Google Cloud console is available in preview.
For information, see Configure search results for unstructured data and Search with multi-turn.
Enterprise Search: Languages
Search results and snippets are supported in:
- Danish (
da-DK) - Dutch (
nl-NL) - Hindi (
hi-IN) - Portuguese (
pt-BR) - Swedish (
sv-SE)
Search results and snippets are also supported in English (en-US), French (fr-FR), Spanish (es-ES), German (de-DE), and Italian (it-IT).
For more information, see Languages.
August 09, 2023
Enterprise Search: Support for VPC Service Controls
VPC Service Controls supports Enterprise Search in preview.
For more information, see Supported products and limitations in the VPC Service Controls documentation. For general information about VPC Service Controls, see Overview of VPC Service Controls.
August 04, 2023
Enterprise Search: Summaries are GA
Summaries for searches are now generally available (GA). These are a short summarization of the top one or more search results returned in a search response.
For more information, see Get search summaries.
Enterprise Search: Citations are GA
Summary citations are now generally available (GA). Citations indicate from which search results specific sentences in the summary are taken.
For more information, see Get citations.
Enterprise Search: Ignore adversarial and non-summary seeking queries are GA
The Ignore adversarial and non-summary seeking queries features are now generally available (GA).
For more information, see Ignore adversarial queries and Ignore non-summary seeking queries.
Enterprise Search: Languages
Search and snippets results are supported in French (fr-FR), in addition to English (en-US), Spanish (es-ES), German (de-DE), and Italian (it-IT).
For more information, see Languages.
August 02, 2023
Enterprise Search: Use custom embeddings
Bringing your own custom vector embeddings to Enterprise Search is supported in preview. If you've created your own embeddings on your data, you can upload them to Enterprise Search and use them when querying.
For more information, see Use custom embeddings.
July 20, 2023
Enterprise Search: Citations
Summary citations are now available in preview. Citations indicate from which search results specific sentences in the summary are taken.
For more information, see Get citations.
Enterprise Search: Ignore adverserial and non-summary seeking queries
You can now configure search requests so that adversarial queries and non-summary seeking queries do not include a summary in the response. This feature is in preview.
For more information, see Ignore adversarial queries and Ignore non-summary seeking queries.
Enterprise Search: Personalize
We have renamed the "Personalize" feature of Generative AI App Builder to "Recommendations". This is a naming change only. There is no change to product functionality.
July 10, 2023
Enterprise Search: Snippets no longer provide page numbers
Snippets are returned as brief extracts of text of uniform length. They no longer provide page numbers. If you previously used snippets as inputs for large language models to generate responses and summaries, we recommend using extractive answers or extractive segments. If you need page numbers in your extracts, we recommend using extractive answers, which provide page numbers where available.
Enterprise Search: Snippets with hit highlighting
Snippets in search responses are available with hit highlighting for rendering in UIs.
For more information, see Use snippets and extracted content.
Enterprise Search: Languages
Search and snippets results are supported in English (en-US), Spanish (es-ES), German (de-DE), and Italian (it-IT).
For more information, see Languages.
June 30, 2023
Enterprise Search: Image search
Search for images on your website. Provide an image (Base64 encoded PNG, JPG, or BMP) as the query and use an API method to return similar images.
For more information, see Search for images using a website search engine.
Enterprise Search: Extractive answers
Extractive answers are available in preview. An extractive answer is verbatim text that is returned with each search result. This text is extracted directly from the search result document and is typically displayed near the top of web pages to provide an end user with a brief answer that is contextually relevant to their query.
For more information, see Use snippets and extracted content.
Enterprise Search: Extractive segments
Extractive segments are available in preview. An extractive segment is verbatim text that is returned with each search result and is usually more verbose than an extractive answer. Extractive segments can be displayed as an answer to a query and be used in post-processing tasks and as input for large language models to generate answers or new text.
For more information, see Use snippets and extracted content.
Enterprise Search: OCR processing
Optical character recognition (OCR) processing is available, improving parsing and segmentation of PDF files at data ingestion. This enables Gen App Builder to take into account structures such as paragraphs and tables when ingesting your documents, providing more accurate search results, snippets, and summarizations. To request this functionality, contact your Google Cloud account team.
For more information, see OCR processing.
June 05, 2023
Enterprise Search: Specify domains for the widget
To use the widget externally, you must provide a list of domains where the widget appears.
If, in an earlier version, you created a widget with API key authentication, that widget might not be supported.
To ensure that the widget continues working, you must reconfigure it: Follow the instructions on Add the widget to a webpage to specify one or more domains for your widget and to generate a fresh snippet for the widget.
Enterprise Search: No API keys
Generated API keys are no longer used by the widget. You can enable Public Access instead.
Enterprise Search: Multi-turn search
Multi-turn search is available in allowlisted preview. Multi-turn search enables follow up questions in context. For information, see Search with multi-turn.
Enterprise Search: PPTX, DOCX, and TXT formats
Enterprise Search supports search over PPTX, DOCX, and TXT documents as well as HTML and PDF documents. Support for the PPTX, DOCX, and TXT formats is available in preview.
For general information about unstructured data, see Unstructured data.
Personalize
Like Enterprise Search and Infobot, Personalize is a component of Gen App Builder. With Personalize, you build a state-of-the-art recommendation engines based on your own data. The recommendation engine uses AI to suggest documents that are similar to the document that the user is currently viewing.
Personalize is available in preview.
For information, see Get started with Personalize.
Enterprise Search: Purge data
The addition of the Purge Data button on the Documents page makes it easier to delete data from a data store. For information, see Delete data from a data store.
Enterprise Search: Collect feedback from users
You have the option to collect feedback (thumbs up or thumbs down) about the quality of the search results provided through the widget. Users who don't like the results can also select, from a list, the reason for their dislike. Feedback collection is available in preview.
For information about feedback collection, see Configure widget feedback.
Enterprise Search: Schema editing
Schemas for structured data stores can be viewed and updated from within the Google Cloud console. Schema editing is available in preview.
For information about schema viewing and editing, see View the schema definition for structured data, Update a schema for structured data, and Schemas: auto-detecting versus providing your own.
Enterprise Search: HIPAA compliance
Enterprise Search is ready to support HIPAA compliance.
Enterprise Search: Analytics
On the analytics dashboard, you can compare metrics for two time periods. The analytics dashboard is available in preview.
For information, see View analytics.
Enterprise Search: Re-import after changing the indexable setting on a field
It is no longer necessary to re-import data after changing an indexable field setting. See Configure search attributes.
April 28, 2023
Enterprise Search: Image search
Search for images on your website. Provide a text string as the query and use an API method to return images. For information, see Search for images using a website search engine.
Enterprise Search: Purge data
The addition of the documents.purge method makes it easier to delete data.
For information, see Delete data from a datastore.
Enterprise Search: Advanced autocomplete
Experimental feature: The advanced autocomplete document data model uses Google's large language models to generate high-quality autocomplete suggestions. For information, see Experimental: Advanced autocomplete document data model.
April 14, 2023
Enterprise Search
Search engines for unstructured data can be created through the Google Cloud console. For information, see Console instructions: Create a search engine and ingest unstructured data.
March 29, 2023
Generative AI App Builder is available for preview to those on the allowlist.