When you create a data store for website search and you turn on advanced website indexing, you need to verify that you are the domain owner for each of the websites that you are indexing. If you turn on advanced website indexing when you create a data store, you have the opportunity to verify your domain ownership for the websites you are indexing directly after creating the data store. If you don't verify your domain ownership, your website can't be indexed.
Domain verification behavior
Be aware of the following domain-verification behavior:
When you verify ownership of a domain, that domain is automatically verified for all data stores in that project. This persists even if in the future you are no longer the owner of the domain.
When you verify ownership of any part of a domain, you are verifying ownership of the entire domain. For example, if you verify ownership of www.mysite.com/abc and later add www.mysite.com/def to your data store, you won't need to verify ownership www.mysite.com/def. Because www.mysite.com/def is within the mysite.com domain, it is already verified.
If you encounter challenges verifying your domain ownership, contact your designated customer engineer or Google account team. After they have verified that your organization owns the specified domains, they will submit a domain-verification exemption request to unblock you.
Verify your domain ownership
If you created a data store, turned on advanced website indexing, but didn't verify your ownership of the websites in the data store, you can do so at any time.
To verify your domain ownership for websites in a data store with advanced website indexing, follow these steps:
In the Google Cloud console, go to the Agent Builder page.
In the navigation menu, click Data stores.
Click the name of the data store with websites for which you haven't yet verified your domain ownership.
In the navigation menu, make sure Data is selected.
Click Verify in Google Search console. The Welcome to the Google Search Console page appears.
Follow the on-screen instructions in the Google Search Console to verify a domain or a URL prefix, depending on whether you are verifying an entire domain or a URL prefix that is part of a domain. For more information, see Verify your site ownership in the Search Console Help Center.
When you have finished the domain verification workflow, the Data page for your data store appears. The Status column should indicate that indexing is in progress for the website.
Repeat for every website in your data store that requires domain verification.