Noble Paul created SOLR-5381:
--------------------------------
Summary: Split Clusterstate and scale
Key: SOLR-5381
URL: https://issues.apache.org/jira/browse/SOLR-5381
Project: Solr
Issue Type: Improvement
Components: SolrCloud
Reporter: Noble Paul
Assignee: Noble Paul
clusterstate.json is a single point of contention for all components in
SolrCloud. It would be hard to scale SolrCloud beyond a few thousand nodes
because there are too many updates and too many nodes need to be notified of
the changes. As the no:of nodes go up the size of clusterstate.json keeps going
up and it will soon exceed the limit impossed by ZK.
The first step is to store the shards information in separate nodes and each
node can just listen to the shard node it belongs to. We may also need to split
each collection into its own node and the clusterstate.json just holding the
names of the collections .
This is an umbrella issue
--
This message was sent by Atlassian JIRA
(v6.1#6144)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
