https://docs.cloud.google.com/dataflow/quotas <https://docs.cloud.google.com/dataflow/quotas#limits> has some system limits (which vary depending on batch vs streaming). This is also impacted by the project's total Compute Engine quota. I'm not sure how hard of a limit the worker limit is or why it is set where it is (others may know more than me).
As you can imagine, this problem doesn't come up often. The more common problem is that Dataflow can't scale up further without degrading the IO it communicates with. Thanks, Danny On Fri, Jan 30, 2026 at 9:47 AM Joey Tran <[email protected]> wrote: > Out of curiosity, is there a technical max number of workers that the > DataflowRunner can run? Or is there no theoretical limit, so long as you > horizontally scale the runner node? >
