Well, if you're going to reindex on a newer version, just start out with the
number of shards you feel is appropriate, and reindex.

But yes, if you had 3 shards, wanted to split some of them, you'd really
have to split all of them (making 6), if you wanted the shards to be about
the same size.

As to hosts needed, if large enough, you could run 6 shards with 2 replicas
(12 cores total) on just 2 hosts.  Or up to 12 hosts.  Or something in
between.  Just depends on how many cores you can fit on a host.

-----Original Message-----
From: tuxedomoon [mailto:dancolem...@yahoo.com] 
Sent: Friday, February 27, 2015 8:16 AM
To: solr-user@lucene.apache.org
Subject: Does shard splitting double host count

I currently have a SolrCloud with 3 shards + replicas, it is holding 130M
documents and the r3.large hosts are running out of memory. As it's on 4.2
there is no shard splitting, I will have to reindex to a 4.3+ version.

If I had that feature would I need to split each shard into 2 subshards
resulting in a total of 6 subshards, in order to keep all shards relatively
equal?

And since host memory is the problem I'd be migrating subshards to new
hosts. So it seems I'd be going from 6 hosts to 12.  Are these assumptions
correct or is there a way to avoid doubling my host count?




--
View this message in context:
http://lucene.472066.n3.nabble.com/Does-shard-splitting-double-host-count-tp
4189595.html
Sent from the Solr - User mailing list archive at Nabble.com.

Reply via email to