GitHub user lhotari added a comment to the discussion: Thousands of cluster geo-replication for fan-in aggregation ?
> > Any sweet spot for number of c1..cN grouping ? Online presentations talk > > about upto 100 clusters geo-replication > > you'd have to test the limits your self to get confidence. In scalable > designs, you usually want sharding. Another way to achieve sharding is to use different namespaces instead of sharing a single namespace for all clusters, spreading out the remote clusters across multiple namespaces. In Pulsar, there are limits for the number of topics in a single namespace. The limits are around the lack of pagination in the API and when using Zookeeper, the limit is from the jute.maxbuffer parameter. Usually it's not recommended to have more than 50k topics in a single namespace because of this. Many recommend a much lower limit such as 10k or 20k for a single namespace. GitHub link: https://github.com/apache/pulsar/discussions/22438#discussioncomment-9019100 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
