GitHub user hanishi added a comment to the discussion: Rate Limiter Pattern on 
DData (PNCounterMap with Sharding + Rotation)

What about Bloom filter based rate limiter? The idea is to implement a 
distributed rate-limiter and replay-guard without keeping explicit counters, 
but instead by windowing with Bloom filters: each shard entity manages a 
current and previous time window, recording whether a given nonce has been 
seen; if it appears again in the same window it is denied, and anything older 
than the previous window is automatically rejected. This approach makes 
grants/denials a function of time-bucketed membership rather than precise 
counting, and it scales cleanly across a cluster. To survive shard passivation 
or rebalancing, each entity periodically publishes a compact Bloom snapshot 
into Pekko DData, so that a new incarnation can immediately warm-start with the 
recent windows instead of forgetting its history. The result is a fast, 
memory-efficient limiter that tolerates rebalances and skew while providing 
strong deduplication semantics.

GitHub link: 
https://github.com/apache/pekko/discussions/2053#discussioncomment-14345631

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: 
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to