This has been mentioned a few times and seems to me to be a fairly common requirement.
I think that a rate limit could be accomplished through stateful processing, using a combination of bagState and Timers. GroupIntoBatches.java would be a good example. I wonder if this would be a good built-in transform given the number of times it’s come up 🙂 Thanks, Evan On Fri, Sep 24, 2021 at 05:29 Sofia’s World <[email protected]> wrote: > Hello > i was wondering if it's somehow possible to limit the concurrency of a > beam Step? > i have a workflow which involves a Webclient that uses an API for which > my account has a max of 300/requests per minute... > Alternatively, will i have to go through a combine and custom ParDo ? > > Has anyone came across this Usecase>? > > kind regards > Marco >
