This page describes practical production limits for Google Cloud Dataflow.

Limit Amount
Maximum number of workers per pipeline. 1,000
Maximum size for a job creation request. Pipeline descriptions with a lot of steps and very verbose names may hit this limit. 10 MB.
Maximum number of side input shards. 20,000

Send feedback about...

Cloud Dataflow Documentation