Re: Staggered Replication In Solr?
Thanks Shawn, We do have repeaters setup to replicate index to the 8 Slaves. We update documents to Master every 2hrs in a batch process. When on hard commit is replicated to repeaters and then to slaves. The concern is that during heavy traffic when slaves are busy serving request, when a new index is available on repeater all slaves start replicating at the same time. And that's when we see the spike on entire cluster. In a single cluster we have 1 Master, 2 Repeaters, 8 slaves. We have currently implemented a cron job which performs staggered replication so not all slaves spike at same time and the cluster is in a state to serve traffic. -- View this message in context: http://lucene.472066.n3.nabble.com/Staggered-Replication-In-Solr-tp4076659p4076888.html Sent from the Solr - User mailing list archive at Nabble.com.
Staggered Replication In Solr?
Hi, Is staggered replication possible in Solr through configuration? We are concern with the CPU spike (80%) and GC pauses on all the slaves when they try to replicate updated index from repeaters. We havent observed this behavior in v3.5 (Max spike were 50% during replication) In our case we have 8 slaves serving the traffic, and all start replicating the new index at the same time. When the switch for Reader happens after warm-up we see a spike in CPU and at the same time GC pause which causes request on our application to queue and eventually fails. It would be good to have a throttle on master/repeater for max replication request to serve at a given time. Planning to write a script and schedule it which will trigger replication in a staggered fashion so not all slaves are busy replicating. thanks Aditya -- View this message in context: http://lucene.472066.n3.nabble.com/Staggered-Replication-In-Solr-tp4076659.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Staggered Replication In Solr?
On 7/9/2013 10:37 AM, adityab wrote: Is staggered replication possible in Solr through configuration? You wouldn't be able to do this directly without switching to completely manually triggered replication, but the concept of a repeater may interest you. http://wiki.apache.org/solr/SolrReplication#Setting_up_a_Repeater You set up a limited number of slaves replicating from your master. Those slaves get also set up as masters, and the rest of your slaves replicate from those, instead of the true master. When the index gets updated, the repeaters do their replication, then the other slaves replicate from the repeaters. Thanks, Shawn
