Guides

Get started

• Quickstart

  Learn the Dataplex basics.

• Build a data mesh

  Use Dataplex entities to build a data mesh.

• Enable Dataplex

  Enable the Dataplex API.

• Best practices

  Learn best practices, such as how to organize your data into lakes, zones, and assets.

Create

• Create a lake

  Create a lake using the Google Cloud console or the APIs Explorer.

• Add a zone

  Create a zone and add it to your lake.

Ingest

• Ingest using templates

  Run a Dataplex template that ingests data using a JDBC connection.

Govern

• Secure your lake

  Set and manage who has access to perform certain tasks within your lake.

• Access control with IAM

  Learn how to set access control for your Dataplex resources.

• Dataplex IAM permissions

  Understand Dataplex-defined IAM roles.

• Use VPC Service Controls with Dataplex

  Protect your Dataplex resources using VPC Service Controls.

• Check data quality

  Schedule and run data quality checks.

Administer

• Manage a lake

  Learn how to view, update, and delete a lake.

• Manage a zone

  Learn how to view, update, and delete a zone.

• Manage assets

  Learn how to add and remove Cloud Storage buckets or BigQuery datasets from existing data zones.

• Configure data discovery

  Learn how discovering data works and how to approve new schemas.

• Manage metadata

  Learn how to work with Dataplex metadata.

• Process data using templates

  Configure and run data processing templates to perform common data processing tasks.

• Schedule custom Spark and SparkSQL tasks

  Schedule custom code execution, either as a one-time run or on a regular schedule.

• Monitor logs

  View, search, and filter Dataplex logs archived in Cloud Logging.

• Monitor audit logs

  View the audit logs created by Dataplex as part of Cloud Audit Logs.

• Monitor metrics

  Use Cloud Monitoring to view the performance, uptime, and overall health of cloud-powered applications.

Explore

• Explore data

  Learn how to use Dataplex Explore, a fully-managed, serverless data exploration experience.