--
Ted Dunning, CTO
DeepDyve
Clearly Zookeeper can handle ensembles of a dozen or so servers. How large
an ensemble can one build with Zookeeper? 100 servers? 10,000 servers?
Are there limitations that make the system unusable at large numbers of
servers?
Thanks,
--
Chad Harrington
CEO
DataScaler, Inc.
HI Chad,
The maximum number of zookeeper servers we have tested with is 13. Even
with 13 the performance starts to degrade very quickly (compared to ensemble
of 5 and 7). I am not sure we have the current numbers (we have made 3x or
so performance improvements) but with the old number in
zookeeper is not really what you would call a scalable system because
all transactions that are updates go through the leader for
serialization. Zookeeper is, instead, a high throughput HA system.
That said, the throughput of a modest zookeeper cluster is fairly
prodigous so for the
