Apache Kafka® for BigQuery
Managed Apache Kafka built for your data analytics platform
Apache Kafka you know, now managed, without the need to worry about version upgrades, rebalancing, and other operational headaches.
Features
Compatible and portable
Apache Kafka for BigQuery works with your existing Kafka applications, for both Google Cloud and Google Distributed Cloud. You can easily integrate with existing Kafka clusters for hybrid deployments and migrations with a single service.
Easy to operate
Apache Kafka for BigQuery is easy to operate. It handles cluster creation with automatic broker sizing and rebalancing to save time and control costs. It offers automatic version upgrades so it is up to date on a recent version of Apache Kafka, comes with out-of-the-box Cloud Monitoring, Cloud Logging, and Identity and Access Management (IAM), and creates all deployments to be highly available by default.
Secure
Apache Kafka for BigQuery is secure out of the box. It is integrated with and supports Google Cloud IAM, customer-managed encryption keys (CMEK), and Virtual Private Cloud (VPC).
How It Works
Apache Kafka for BigQuery is a managed service that operates highly available Apache Kafka clusters. It is compatible with open source versions of Apache Kafka and includes first-party Google Cloud IAM, monitoring, logging, key management, organization policy, networking, and more.
Common Uses
Stream analytics
Collect analytics data for streaming into BigQuery
Collect analytics data for streaming into BigQuery
Apache Kafka is a technology that often underlies data and AI platforms. Data engineers often rely on Apache Kafka to build pipelines that stream data into BigQuery and other analytics systems. Apache Kafka for BigQuery can be used for real-time and batch use cases like operational monitoring, fraud detection, payment processing, and product recommendations.
Tutorials, quickstarts, & labs
Collect analytics data for streaming into BigQuery
Collect analytics data for streaming into BigQuery
Apache Kafka is a technology that often underlies data and AI platforms. Data engineers often rely on Apache Kafka to build pipelines that stream data into BigQuery and other analytics systems. Apache Kafka for BigQuery can be used for real-time and batch use cases like operational monitoring, fraud detection, payment processing, and product recommendations.
Build event-driven microservices
Build event-driven microservices
Build event-driven microservices
Build event-driven microservices like:
- ecommerce order processing: An "order placed" event triggers inventory checks, payment processing, and shipping notifications
- Real-time notifications: Events can trigger push notifications, social feed updates, and other immediate actions
- IoT systems: Handle a large volume of sensor data as events, reacting to specific conditions
Tutorials, quickstarts, & labs
Build event-driven microservices
Build event-driven microservices
Build event-driven microservices like:
- ecommerce order processing: An "order placed" event triggers inventory checks, payment processing, and shipping notifications
- Real-time notifications: Events can trigger push notifications, social feed updates, and other immediate actions
- IoT systems: Handle a large volume of sensor data as events, reacting to specific conditions
Pricing
| Apache Kafka for BigQuery pricing | Apache Kafka pricing is based on pay-as-you-go pricing for compute, storage, and networking. | |
|---|---|---|
| Services and usage | Description | Price (USD) |
Compute | Compute charges will cover VCPU and RAM. | Coming soon |
Storage | Local storage Broker SSD | Coming soon |
Persistent storage Tiered long term storage | Coming soon | |
Data transfer | Traffic between zones or regions. Same data transfer fees as Compute Engine apply. | Coming soon |
Apache Kafka for BigQuery pricing
Apache Kafka pricing is based on pay-as-you-go pricing for compute, storage, and networking.
Compute
Compute charges will cover VCPU and RAM.
Coming soon
Storage
Local storage
Broker SSD
Coming soon
Persistent storage
Tiered long term storage
Coming soon
Data transfer
Traffic between zones or regions. Same data transfer fees as Compute Engine apply.
Coming soon
PRICING CALCULATOR
Custom quote
Getting started
Sign up to access in Preview
Learn more about Apache Kafka
Explore streaming analytics solutions
2023 Forrester Wave: Streaming Data Platforms
