Related to the difference between rsync and native Solr replication - we are seeing issues with Solr 1.4 where search queries that come in during a replication request hang for excessive amount of time (up to 100's of seconds for a result normally that takes ~50 ms).
We are replicating pretty often (every 90 sec for multiple cores to one slave server), but still did not think that replication would make the master server unable to handle search requests. Is there some configuration option we are missing which would handle this situation better? Thanks, Peter On Sun, Jan 3, 2010 at 11:27 AM, Fuad Efendi <f...@efendi.ca> wrote: > Thank you Yonik, excellent WIKI! I'll try without APR, I believe it's > environmental issue; 100Mbps switched should do 10 times faster (current > replica speed is 1Mbytes/sec) > > >> -----Original Message----- >> From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik >> Seeley >> Sent: January-03-10 10:03 AM >> To: solr-user@lucene.apache.org >> Subject: Re: SOLR: Replication >> >> On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi <f...@efendi.ca> wrote: >> > I tried... I set APR to improve performance... server is slow while >> replica; >> > but "top" shows only 1% of I/O wait... it is probably environment >> specific; >> >> So you're saying that stock tomcat (non-native APR) was also 10 times >> slower? >> >> > but the same happened in my home-based network, rsync was 10 times >> faster... >> > I don't know details of HTTP-replica, it could be base64 or something >> like >> > that; RAM-buffer, flush to disk, etc. >> >> The HTTP replication is using binary. >> If you look here, it was benchmarked to be nearly as fast as rsync: >> http://wiki.apache.org/solr/SolrReplication >> >> It does do a fsync to make sure that the files are on disk after >> downloading, but that shouldn't make too much difference. >> >> -Yonik >> http://www.lucidimagination.com > > > -- Peter M. Wolanin, Ph.D. Momentum Specialist, Acquia. Inc. peter.wola...@acquia.com
