Thank you. +1 to adding this to wiki.
FYI - @Damon Douglas shared a related doc earlier
for alternative ideas for Beam to prevent overloading external services. (
https://docs.google.com/document/d/1VZ9YphDO7kewBSz5oMXVPHWaib3S03Z6aZ66BhciB3E/edit?usp=sharing=0-ItxMSG72EzfSwVedSz-Zeg
)
On Tue,
Great article!
Though it's depressing to see we have a pair of magic counter names to help
modulate scaling behavior.
On Tue, May 30, 2023, 11:42 AM Jack McCluskey via dev
wrote:
> Hey everyone,
>
> While working on some remote model handler code I hit a point where I
> needed to understand
Hey everyone,
While working on some remote model handler code I hit a point where I
needed to understand how Beam IOs interpret and action on being throttled
by an external service. This turned into a few discussions and then a small
write-up doc (
