GitHub user yehancha added a comment to the discussion: How to tweak a Pulsar cluster to have a large number of topics with a reasonable throughput
The issue seems to be with `DispatchRate` limit. In my case, I need 0.5 b/s throughput on a single topic. I have set the dispatch rate limit to 4 kb/s, well above my need. But even with that, the throughput slows down (which I will look into in the future). When I remove this limit, everything works fine. I will keep the discussion open until I hit my initial target of 100K msg/s on 200K topics to discuss any other issues on the way. GitHub link: https://github.com/apache/pulsar/discussions/19862#discussioncomment-5378399 ---- This is an automatically sent email for commits@pulsar.apache.org. To unsubscribe, please send an email to: commits-unsubscr...@pulsar.apache.org
