Features

Bring real time data to your unified data and AI platform

Make business decisions based on real-time insights with a well integrated and scalable streaming platform based on familiar technologies—Apache Flink and Apache Kafka. Combined with Google’s differentiated AI/ML capabilities in BigQuery, you can unlock the full potential of your data. Iterate rapidly without being slowed down by infrastructure management while having the ability to scale effectively with security and governance built-in.

Save time and resources with a serverless Flink engine

Organizations want to get value from real-time data by building streaming applications on Google Cloud. However, they are often bogged down by the operational burden of running self-managed Flink, fine-tuning countless configurations, meeting demands of diverse workloads while managing costs, and keeping up with upgrades. BigQuery Engine for Apache Flink is serverless; it reduces this operational burden and allows customers to focus on what they do best—their business innovation.

BigQuery Engine for Apache Flink makes it easier to lift and shift existing streaming applications relying on open source Apache Flink to Google Cloud, without rewriting code or relying on third-party services. Combined with Google Managed Service for Apache Kafka (now GA), it is easy to migrate and modernize your streaming analytics on Google Cloud.

Common Uses

Streamling ETL

Streaming ETL for your AI-ready data platform

Apache Flink provides an open and flexible platform for real-time ETL, allowing you to ingest data streams from sources like Kafka, perform transformations (filtering, aggregations, and more), and instantly load them into BigQuery for analysis and storage. This enables rapid data analysis and faster decision-making with the benefits of open source extensibility and adaptability to diverse data sources.

Create and manage a deployment

    Streaming ETL for your AI-ready data platform

    Apache Flink provides an open and flexible platform for real-time ETL, allowing you to ingest data streams from sources like Kafka, perform transformations (filtering, aggregations, and more), and instantly load them into BigQuery for analysis and storage. This enables rapid data analysis and faster decision-making with the benefits of open source extensibility and adaptability to diverse data sources.

    Create and manage a deployment

      Build event-driven applications

      Build event-driven applications


      Event-driven apps help enterprises solve for fraud detection models, recommendation engines, marketing personalization, and more. You can use Google Cloud's managed Apache Kafka service to capture real-time event streams like user activity or payments from various sources. The Apache Flink engine then processes these streams with low latency, enabling complex operations like real-time.

      Create a job with a quickstart

        Build event-driven applications


        Event-driven apps help enterprises solve for fraud detection models, recommendation engines, marketing personalization, and more. You can use Google Cloud's managed Apache Kafka service to capture real-time event streams like user activity or payments from various sources. The Apache Flink engine then processes these streams with low latency, enabling complex operations like real-time.

        Create a job with a quickstart

          Streaming analytics

          Build a real-time data and AI platform


          BigQuery Engine for Apache Flink lets you run Flink for stream analytics without managing infrastructure. Analyze real-time data with Flink's SQL or DataStream API. Build dashboards by streaming your data to BigQuery and connecting it to visualization tools. Monitor job performance and leverage Flink's libraries for streaming ML.

          Explore monitoring interface

            Build a real-time data and AI platform


            BigQuery Engine for Apache Flink lets you run Flink for stream analytics without managing infrastructure. Analyze real-time data with Flink's SQL or DataStream API. Build dashboards by streaming your data to BigQuery and connecting it to visualization tools. Monitor job performance and leverage Flink's libraries for streaming ML.

            Explore monitoring interface

              Getting started

              Available in Preview today

              Try in console

              Learn more about how it works

              Visit documentation

              Works with Managed Service for Apache Kafka

              Learn more

              2023 Forrester Wave: Streaming Data Platforms

              Get the report

              Advantages of BigQuery Engine for Apache Flink

              Read more
              Google Cloud
              send_spark
                DocsSupport
                • ‪English‬
                • ‪Deutsch‬
                • ‪Español‬
                • ‪Español (Latinoamérica)‬
                • ‪Français‬
                • ‪Indonesia‬
                • ‪Italiano‬
                • ‪Português (Brasil)‬
                • ‪简体中文‬
                • ‪繁體中文‬
                • ‪日本語‬
                • ‪한국어‬
                Console
                Sign in
                Start free
                Contact Us
                • Accelerate your digital transformation
                • Whether your business is early in its journey or well on its way to digital transformation, Google Cloud can help solve your toughest challenges.
                • Google Cloud products
                • Browse over 100 products. New customers get $300 in free credits to run, test, and deploy workloads. All customers can use 25+ products for free, up to monthly usage limits.
                • Save money with our transparent approach to pricing
                • Google Cloud's pay-as-you-go pricing offers automatic savings based on monthly usage and discounted rates for prepaid resources. Contact us today to get a quote.
                Google Cloud