Learn about different architectures to implement streaming analytics in the Generating real time value with streaming analytics session at Next.

Jump to

Pub/Sub

Ingest events for streaming into BigQuery, data lakes or operational databases.

New customers get $300 in free credits to spend on Google Cloud during the first 90 days. All customers get up to 10 GB/month for ingestion or delivery of messages, free of charge.

  • action/check_circle_24px Created with Sketch.

    Ingest analytic events and stream them to BigQuery with Dataflow

  • action/check_circle_24px Created with Sketch.

    No-ops, secure, scalable messaging or queue system

  • action/check_circle_24px Created with Sketch.

    In-order and any-order at-least-once message delivery with pull and push modes

  • action/check_circle_24px Created with Sketch.

    Secure data with fine-grained access controls and always-on encryption 

Benefits

High availability made simple

Synchronous, cross-zone message replication and per-message receipt tracking ensures reliable delivery at any scale.

No-planning, auto-everything

Auto-scaling and auto-provisioning with no partitions eliminates planning and ensures workloads are production ready from day one.

Easy, open foundation for real-time data systems

A fast, reliable way to land small records at any volume, an entry point for real-time and batch pipelines feeding BigQuery, data lakes and operational databases. Use it with ETL/ELT pipelines in Dataflow.    

Key features

Key features

Stream analytics and connectors

Native Dataflow integration enables reliable, expressive, exactly-once processing and integration of event streams in Java, Python, and SQL.

In-order delivery at scale

Optional per-key ordering simplifies stateful application logic without sacrificing horizontal scale—no partitions required.

Cost-optimized ingestion with Pub/Sub Lite

Complementing Pub/Sub, Pub/Sub Lite aims to be the lowest cost option for high-volume  event ingestion. Pub/Sub Lite offers zonal storage and puts you in control of capacity management.

View all features

Customers

Learn from customers using Pub/Sub

What's new

What's new

Sign up for Google Cloud newsletters to receive product updates, event information, special offers, and more.

Documentation

Documentation

Google Cloud Basics
What is Pub/Sub?

Get a comprehensive overview of Pub/Sub, from core concepts and message flow to common use cases and integrations.

Tutorial
Introduction to Pub/Sub

Learn how to enable Pub/Sub in a Google Cloud project, create a Pub/Sub topic and subscription, and publish messages and pull them to the subscription.

Quickstart
Quickstart: Using client libraries

See how the Pub/Sub service allows applications to exchange messages reliably, quickly, and asynchronously.

Tutorial
In-order message delivery

Learn how scalable message ordering works and when to use it.

Tutorial
Choosing between Pub/Sub or Pub/Sub Lite

Understand how to make most of both options.

Quickstart
Quickstart: Stream processing with Dataflow

Learn how to use Dataflow to read messages published to a Pub/Sub topic, window the messages by timestamp, and write the messages to Cloud Storage.

Tutorial
Guide: Publishing messages to topics

Learn how to create a message containing your data and send a request to the Pub/Sub Server to publish the message to the desired topic.

Use cases

Use cases

Use case
Stream analytics

Google’s stream analytics makes data more organized, useful, and accessible from the instant it’s generated. Built on Pub/Sub along with Dataflow and BigQuery, our streaming solution provisions the resources you need to ingest, process, and analyze fluctuating volumes of real-time data for real-time business insights. This abstracted provisioning reduces complexity and makes stream analytics accessible to both data analysts and data engineers.

Flow across 5 columns, from Trigger, to Ingest, Enrich, Analyze, & Activate. Each column has top and bottom section. In top of Trigger column are edge devices (mobile, web, Data Store, and IoT) which flow to Pub/Sub in Ingest column, and on to Enrich column and Apache Beam / Dataflow Streaming, then down to Analyze and then Activate boxes where it flows back to edge devices in Col 1. From Apache Beam in col 3, flows back and forth to Analyze column, into BigQuery, AI Platform, and Bigtable: all 3 are flowed into by Backfill/ Reprocess - Dataflow Batch. Flow moves from BigQuery to Activate column, into Data Studio, Third-party BI, and Cloud Functions, which flows back to edge devices in column 1. In bottom section of columns, it says Creation Flow: Trigger says “Configure source to push event message to Pub/Sub topic.” Flows to Ingest “Create Pub/Sub Topic and subscription.” To Enrich “Deploy streaming or batch Dataflow job using templates, CLI, or notebooks.” To Analyze “Create dataset, tables, and models to receive stream.” To Activate “Build real-time dashboards and call external APIs.”
Use case
Asynchronous microservices integration

Pub/Sub works as a messaging middleware for traditional service integration or a simple communication medium for modern microservices. Push subscriptions deliver events to serverless webhooks on Cloud Functions, App Engine, Cloud Run, or custom environments on Google Kubernetes Engine or Compute Engine. Low-latency pull delivery is available when exposing webhooks is not an option or for efficient handling of higher throughput streams.

All features

All features

At-least-once delivery Synchronous, cross-zone message replication and per-message receipt tracking ensures at-least-once delivery at any scale.
Open Open APIs and client libraries in seven languages support cross-cloud and hybrid deployments.
Exactly-once processing Dataflow supports reliable, expressive, exactly-once processing of Pub/Sub streams.
No provisioning, auto-everything Pub/Sub does not have shards or partitions. Just set your quota, publish, and consume.
Compliance and security Pub/Sub is a HIPAA-compliant service, offering fine-grained access controls and end-to-end encryption.
Google Cloud–native integrations Take advantage of integrations with multiple services, such as Cloud Storage and Gmail update events and Cloud Functions for serverless event-driven computing.
Third-party and OSS integrations Pub/Sub provides third-party integrations with  Splunk and Datadog for logs along with Striim and Informatica for data integration. Additionally, OSS integrations are available through Confluent Cloud for Apache Kafka and Knative Eventing for Kubernetes-based serverless workloads.
Seek and replay Rewind your backlog to any point in time or a snapshot, giving the ability to reprocess the messages. Fast forward to discard outdated data.
Dead letter topics Dead letter topics allow for messages unable to be processed by subscriber applications to be put aside for offline examination and debugging so that other messages can be processed without delay.
Filtering Pub/Sub can filter messages based upon attributes in order to reduce delivery volumes to subscribers.

Pricing

Pricing

Pub/Sub pricing is calculated based upon monthly data volumes. The first 10 GB of data per month is offered at no charge. 

Monthly data volume1 Price per TB2
First 10 GB $0.00
Beyond 10 GB $40.00

1 For detailed pricing information, please consult the pricing guide.

2 TB refers to a tebibyte, or 240 bytes.

If you pay in a currency other than USD, the prices listed in your currency on Cloud Platform SKUs apply.