Watch the Data Cloud Summit on demand and learn about the latest innovations in analytics, AI, BI, and databases.

Jump to
Cloud Data Fusion

Cloud Data Fusion

Fully managed, cloud-native data integration at any scale.

New customers get $300 in free credits to spend on Data Fusion. All customers get the first 120 hours of pipeline development free per month, per account, not charged against your credits.

  • Visual point-and-click interface enabling code-free deployment of ETL/ELT data pipelines

  • Broad library of 150+ preconfigured connectors and transformations, at no additional cost

  • Natively integrated best-in-class Google Cloud services

  • End-to-end data lineage for root cause and impact analysis

  • Built with an open source core (CDAP) for pipeline portability

Benefits

Avoid technical bottlenecks and lift productivity

Data Fusion’s intuitive drag-and-drop interface, pre-built connectors, and self-service model of code-free data integration remove technical expertise-based bottlenecks and accelerate time to insight.

Lower total cost of pipeline ownership

A serverless approach leveraging the scalability and reliability of Google services like Dataproc means Data Fusion offers the best of data integration capabilities with a lower total cost of ownership.

Build with a data governance foundation

With built-in features like end-to-end data lineage, integration metadata, and cloud-native security and data protection services, Data Fusion assists teams with root cause or impact analysis and compliance.

Key features

Key features

Open core, delivering hybrid and multi-cloud integration

Data Fusion is built using open source project CDAP, and this open core ensures data pipeline portability for users. CDAP’s broad integration with on-premises and public cloud platforms gives Cloud Data Fusion users the ability to break down silos and deliver insights that were previously inaccessible.

Integrated with Google’s industry-leading big data tools

Data Fusion’s integration with Google Cloud simplifies data security and ensures data is immediately available for analysis. Whether you’re curating a data lake with Cloud Storage and Dataproc, moving data into BigQuery for data warehousing, or transforming data to land it in a relational store like Spanner, Cloud Data Fusion’s integration makes development and iteration fast and easy.

Data integration through collaboration and standardization

Cloud Data Fusion offers pre-built transformations for both batch and real-time processing. It provides the ability to create an internal library of custom connections and transformations that can be validated, shared, and reused across teams. It lays the foundation of collaborative data engineering and improves productivity. That means less waiting for ETL developers and data engineers and, importantly, less sweating about code quality.

View all features

Documentation

Documentation

Tutorial

Enabling Cloud Data Fusion

Learn how to enable the Cloud Data Fusion API for your Google Cloud project.

Tutorial

Cloud Data Fusion concepts overview

Learn about Cloud Data Fusion concepts and features.

Tutorial

Exploring data lineage

This tutorial shows how to use Cloud Data Fusion to explore data lineage: the data's origins and its movement over time.

Tutorial

Using JDBC drivers with Cloud Data Fusion

Discover how to use Java Database Connectivity (JDBC) drivers with Cloud Data Fusion pipelines.

Tutorial

Data engineering on Google Cloud

Learn firsthand how to design and build data processing systems on Google Cloud with this four-day instructor-led class.

Not seeing what you’re looking for?

Use cases

Use cases

Use case
Modern, more secure data lakes on Google Cloud

Cloud Data Fusion helps users build scalable, distributed data lakes on Google Cloud by integrating data from siloed on-premises platforms. Customers can leverage the scale of the cloud to centralize data and drive more value out of their data as a result. The self-service capabilities of Cloud Data Fusion increase process visibility and lower the overall cost of operational support.

Use case
Agile data warehouses with BigQuery

Cloud Data Fusion can help organizations better understand their customers by breaking down data silos and enabling development of agile, cloud-based data warehouse solutions in BigQuery. A trusted, unified view of customer engagement and behavior unlocks the ability to drive a better customer experience, which leads to higher retention and higher revenue per customer.

Use case
Unified analytics environment

Many users today want to establish a unified analytics environment across a myriad of expensive, on-premises data marts. Employing a wide range of disconnected tools and stop-gap measures creates data quality and security challenges. Cloud Data Fusion’s vast variety of connectors, visual interfaces, and abstractions centered around business logic helps in lowering TCO, promoting self-service and standardization, and reducing repetitive work.

All features

All features

Code-free self-service

Remove bottlenecks by enabling nontechnical users through a code-free graphical interface that delivers point-and-click data integration.

Collaborative data engineering

Cloud Data Fusion offers the ability to create an internal library of custom connections and transformations that can be validated, shared, and reused across an organization.

Google Cloud-native

Fully managed Google Cloud-native architecture unlocks the scalability, reliability, security, and privacy features of Google Cloud.

Real-time data integration

Replicate transactional and operational databases such as SQL Server, Oracle and MySQL directly into BigQuery with just a few clicks using Data Fusion’s replication feature. Integration with Datastream allows you to deliver change streams into BigQuery for continuous analytics. Use feasibility assessment for faster development iterations and performance/health monitoring for observability.

Batch integration

Design, run and operate high-volumes of data pipelines periodically with support for popular data sources including file systems and object stores, relational and NoSQL databases, SaaS systems, and mainframes.

Enterprise-grade security

Integration with Cloud Identity and Access Management (IAM), Private IP, VPC-SC and CMEK provides enterprise security and alleviates risks by ensuring compliance and data protection.

Integration metadata and lineage

Search integrated datasets by technical and business metadata. Track lineage for all integrated datasets at the dataset and field level.

Seamless operations

REST APIs, time-based schedules, pipeline state-based triggers, logs, metrics, and monitoring dashboards make it easy to operate in mission-critical environments.

Comprehensive integration toolkit

Built-in connectors to a variety of modern and legacy systems, code-free transformations, conditionals and pre/post processing, alerting and notifications, and error processing provide a comprehensive data integration experience.

Hybrid enablement

Open source provides the flexibility and portability required to build standardized data integration solutions across hybrid and multi-cloud environments.

Pricing

Pricing

Cloud Data Fusion pricing is broken down by:  

1. Design cost: based on the number of hours an instance is running and not the number of pipelines being developed and run. The Basic edition offers the first 120 hours per month per account at no cost.

2. Processing cost: The cost of Dataproc clusters used to run the pipelines.

Edition

Price per Cloud Data Fusion instance hour

Number of simultaneous pipelines supported

Number of users supported

Developer

US$0.35

2 (Recommended)

2 (Recommended)

Basic

US$1.80

Unlimited

Unlimited

Enterprise

US$4.20

Unlimited

Unlimited

Take the next step

Start building on Google Cloud with $300 in free credits and 20+ always free products.

Google Cloud
  • ‪English‬
  • ‪Deutsch‬
  • ‪Español‬
  • ‪Español (Latinoamérica)‬
  • ‪Français‬
  • ‪Indonesia‬
  • ‪Italiano‬
  • ‪Português (Brasil)‬
  • ‪简体中文‬
  • ‪繁體中文‬
  • ‪日本語‬
  • ‪한국어‬
Console
Google Cloud