Integrate data sources with Dataplex Catalog

This document describes how to integrate data sources with Dataplex Catalog. Dataplex can import and maintain up-to-date Dataplex Catalog metadata from Google Cloud data sources.

With metadata ingested, Dataplex does the following:

• Makes the existing metadata discoverable through search. For more information, see Search for data assets in Dataplex Catalog.
• Allows the members of your organization to enrich your data with additional business metadata by using aspects. For more information, see Manage aspects and enrich metadata.

Note: For information about how to integrate data sources with Data Catalog, see Integrate your data sources with Data Catalog and Dataplex Catalog versus Data Catalog.

Before you begin

1. Sign in to your Google Cloud account. If you're new to Google Cloud, create an account to evaluate how our products perform in real-world scenarios. New customers also get $300 in free credits to run, test, and deploy workloads.

2. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

3. Make sure that billing is enabled for your Google Cloud project.

4. Enable the Dataplex API.

   Enable the API

5. In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

   Note: If you don't plan to keep the resources that you create in this procedure, create a project instead of selecting an existing project. After you finish these steps, you can delete the project, removing all resources associated with the project.

   Go to project selector

6. Make sure that billing is enabled for your Google Cloud project.

7. Enable the Dataplex API.

   Enable the API

Integrate Cloud SQL

After you enable the Dataplex Catalog integration on your Cloud SQL instance, Dataplex Catalog automatically retrieves metadata from Cloud SQL resources, including instances, databases, tables, columns, and views.

Dataplex Catalog retrieves metadata only from Cloud SQL primary instances and not from read replicas.

For more information, see Manage your Cloud SQL resources using Dataplex Catalog.

What's next

• Learn how to search for resources in Dataplex Catalog.
• Learn more about Dataplex Catalog.
• Learn how to enrich entries with metadata by using aspects.
• Learn how to manage entries and ingest custom sources.