I think you're conflating shards and cores. Shards are physical slices of a singe logical index. An incoming query is sent to each and every shard and the results tallied.
The case you're talking about seems to be more you have N separate indexes (cores), where each core is for a specific user. This is vastly different from SolrCloud, which puts all the data into one huge logical index! Furthermore, presently there's no way to direct specific documents to specific shards in SolrCloud (although a pluggable sharding mechanism is under development). You might be interested in SOLR-1293 (under development) for managing lots of cores. On Mon, Nov 5, 2012 at 4:26 PM, Jie Sun <jsun5...@yahoo.com> wrote: > we are using solr 3.5 in production and we deal with customers data of > terabytes. > > we are using shards for large customers and write our own replica > management > in our software. > > Now with the rapid growth of data, we are looking into solrcloud for its > robustness of sharding and replications. > > I understand by read some documents on line that there is no SPOF using > solrcloud, so any instance in the cluster can server the query/index. > However, is it true that we need to write our own load balancer in front of > solrCloud? > > For example if we want to implement a model similar to Loggly, i.e. each > customer start indexing into the small shard of its own, then if any of the > customers grow more than the small shard's limit, we switch to index into > another small shard (we call it front end shard), meanwhile merge the just > released small shard to next level larger shard. > > Since the merge can happen between two instances on different servers, we > probably end up with synch the index files for the merging shards and then > use solr merge. > > I am curious if there is anything solr provide to help on these kind of > strategy dealing with unevenly grow big customer data (a core)? or do we > have to write these in our software layer from scratch? > > thanks > Jie > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/load-balance-with-SolrCloud-tp4018367.html > Sent from the Solr - User mailing list archive at Nabble.com. >
