RE: Solr Replication

, January 07, 2019 11:10 AM > To: solr-user@lucene.apache.org > Subject: Re: Solr Replication > > In SolrCloud there are Data Centers. > Your Cluster 1 is DataCenter 1 and your Cluster 2 is Data Center 2. > You can then use CDCR (Cross Data Center Replication). > http://lucene.a

Re: Solr Replication

In SolrCloud there are Data Centers. Your Cluster 1 is DataCenter 1 and your Cluster 2 is Data Center 2. You can then use CDCR (Cross Data Center Replication). http://lucene.apache.org/solr/guide/7_0/cross-data-center-replication-cdcr.html Nevertheless I would spend your Cluster 2 another 2

Re: Solr Replication being flaky (6.2.0)

8 1:49 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr Replication being flaky (6.2.0) > > On 1/19/2018 11:27 AM, Shawn Heisey wrote: >> On 1/19/2018 8:54 AM, Pouliot, Scott wrote: >>> I do have a ticket in with our systems team to up the file handlers >>>

RE: Solr Replication being flaky (6.2.0)

Heisey [mailto:apa...@elyograg.org] Sent: Friday, January 19, 2018 1:49 PM To: solr-user@lucene.apache.org Subject: Re: Solr Replication being flaky (6.2.0) On 1/19/2018 11:27 AM, Shawn Heisey wrote: > On 1/19/2018 8:54 AM, Pouliot, Scott wrote: >> I do have a ticket in with our sys

Re: Solr Replication being flaky (6.2.0)

On 1/19/2018 11:27 AM, Shawn Heisey wrote: On 1/19/2018 8:54 AM, Pouliot, Scott wrote: I do have a ticket in with our systems team to up the file handlers since I am seeing the "Too many files open" error on occasion on our prod servers.  Is this the setting you're referring to?  Found we were

Re: Solr Replication being flaky (6.2.0)

On 1/19/2018 8:54 AM, Pouliot, Scott wrote: I do have a ticket in with our systems team to up the file handlers since I am seeing the "Too many files open" error on occasion on our prod servers. Is this the setting you're referring to? Found we were set to to 1024 using the "Ulimit" command.

RE: Solr Replication being flaky (6.2.0)

replication? Solr itself seems > to be working like a champ, except when things get out of sync. > > Scott > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: Friday, January 19, 2018 12:27 PM > To: solr-user <solr-user@lucene.a

Re: Solr Replication being flaky (6.2.0)

Solr itself seems > to be working like a champ, except when things get out of sync. > > Scott > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: Friday, January 19, 2018 12:27 PM > To: solr-user <solr-user@lucene.apache.

RE: Solr Replication being flaky (6.2.0)

<solr-user@lucene.apache.org> Subject: Re: Solr Replication being flaky (6.2.0) Scott: We usually recommend setting files and processes very, very high. Like 65K high. Or unlimited if you can. Plus max user processes should also be bumped very high as well, like 65K as well. Plus max

Re: Solr Replication being flaky (6.2.0)

on on our prod servers. > Is this the setting you're referring to? Found we were set to to 1024 using > the "Ulimit" command. > > -Original Message- > From: Shawn Heisey [mailto:apa...@elyograg.org] > Sent: Friday, January 19, 2018 10:48 AM > To: solr-user@lu

RE: Solr Replication being flaky (6.2.0)

age- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Friday, January 19, 2018 10:48 AM To: solr-user@lucene.apache.org Subject: Re: Solr Replication being flaky (6.2.0) On 1/19/2018 7:50 AM, Pouliot, Scott wrote: > So we're running Solr in a Master/Slave configuration (1 o

Re: Solr Replication being flaky (6.2.0)

On 1/19/2018 7:50 AM, Pouliot, Scott wrote: So we're running Solr in a Master/Slave configuration (1 of each) and it seems that the replication stalls or stops functioning every now and again. If we restart the Solr service or optimize the core it seems to kick back in again. Anyone have any

RE: Solr Replication being flaky (6.2.0)

Message- From: David Hastings [mailto:hastings.recurs...@gmail.com] Sent: Friday, January 19, 2018 10:35 AM To: solr-user@lucene.apache.org Subject: Re: Solr Replication being flaky (6.2.0) This happens to me quite often as well. Generally on the replication admin screen it will say its

Re: Solr Replication being flaky (6.2.0)

This happens to me quite often as well. Generally on the replication admin screen it will say its downloading a file, but be at 0 or a VERY small kb/sec. Then after a restart of the slave its back to downloading at 30 to 100 mg/sec. Would be curious if there actually is a solution to this aside

Re: Solr replication

Thanks Eric, fixed the issue. The IT team corrected the solrconfig.xml but forgot to execute the zkcli.sh script on solr node. After I executed the script its working now. On 9/20/17, 10:20 AM, "Erick Erickson" wrote: WARNING - External email; exercise caution.

Re: Solr replication

Your solrconfig.xml file is mal-formed. The smoking gun is: Exception during parsing file: solrconfig.xml Best, Erick On Tue, Sep 19, 2017 at 4:48 PM, Satyaprashant Bezwada wrote: > Need some inputs or help in resolving replication across solr nodes. We have

Re: Solr Replication sometimes coming in log files

I bet you have the admin UI open on your second slave. The _=144... is the give-away. Those requests are the admin UI asking the replication handler for the status of replication. Upayavira On Wed, Sep 9, 2015, at 06:32 AM, Kamal Kishore Aggarwal wrote: > Hi Team, > > I am currently working

Re: Solr Replication sometimes coming in log files

Hello, I'd say opposite: high load causes long time to respond. 'command=details' is rather cheap and fast _I believe_. On Mon, Sep 14, 2015 at 10:20 AM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Can anybody suggest me something.. > > On Wed, Sep 9, 2015 at 11:02 AM, Kamal

Re: Solr Replication sometimes coming in log files

Can anybody suggest me something.. On Wed, Sep 9, 2015 at 11:02 AM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi Team, > > I am currently working with Java-1.7, Solr-4.8.1 with tomcat 7. The solr > configuration has master & slave ( 2 Slaves) architecture. > > > Master & Slave 2

Re: solr replication vs. rsync

On 1/24/2015 10:56 PM, Dan Davis wrote: When I polled the various projects already using Solr at my organization, I was greatly surprised that none of them were using Solr replication, because they had talked about replicating the data. But we are not Pinterest, and do not expect to be

Re: solr replication vs. rsync

bq: I thought SolrCloud replicas were replication, and you imply parallel indexing Absolutely! You couldn't get near-real-time indexing if you relied on replication a-la 3x. And you also couldn't guarantee consistency. Say you have 1 shard, a leader and a follower (i.e. 2 replicas). Now you

Re: solr replication vs. rsync

@Shawn: Cool table, thanks! @Dan: Just to throw a different spin on it, if you migrate to SolrCloud, then this question becomes moot as the raw documents are sent to each of the replicas so you very rarely have to copy the full index. Kind of a tradeoff between constant load because you're

Re: solr replication vs. rsync

@Erick, Problem space is not constant indexing. I thought SolrCloud replicas were replication, and you imply parallel indexing. Good to know. On Sunday, January 25, 2015, Erick Erickson erickerick...@gmail.com wrote: @Shawn: Cool table, thanks! @Dan: Just to throw a different spin on it,

Re: solr replication vs. rsync

Thanks! On Sunday, January 25, 2015, Erick Erickson erickerick...@gmail.com wrote: @Shawn: Cool table, thanks! @Dan: Just to throw a different spin on it, if you migrate to SolrCloud, then this question becomes moot as the raw documents are sent to each of the replicas so you very rarely

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

I haven't seen any activity regarding this in Jira, just curious if it would be looked into anytime soon... On Thu, Oct 2, 2014 at 10:11 AM, Phil Black-Knight pblackkni...@globalgiving.org wrote: see the ticket here: https://issues.apache.org/jira/browse/SOLR-6579 including a patch to fix

RE: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

I was helping to look into this with Nick I think we may have figured out the core of the problem... The problem is easily reproducible by starting replication on the slave and then sending a shutdown command to tomcat (e.g. catalina.sh stop). With a debugger attached, it looks like the

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

On 10/2/2014 7:25 AM, Phil Black-Knight wrote: I was helping to look into this with Nick I think we may have figured out the core of the problem... The problem is easily reproducible by starting replication on the slave and then sending a shutdown command to tomcat (e.g. catalina.sh stop).

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

see the ticket here: https://issues.apache.org/jira/browse/SOLR-6579 including a patch to fix it. On Thu, Oct 2, 2014 at 9:44 AM, Shawn Heisey apa...@elyograg.org wrote: On 10/2/2014 7:25 AM, Phil Black-Knight wrote: I was helping to look into this with Nick I think we may have figured out

Re: SolR replication issue

On 9/1/2014 10:31 AM, Mauricio Ferreyra wrote: I'm using Solr 4.3.1 with a master/slave configuration. Configuration: Master: * lst name=master* * str name=replicateAftercommit/str* * str name=replicateAfterstartup/str* * str

Re: SolR replication issue

The entire stacktrace: ERROR SolrIndexWriter Coud not unlock directory after seemingly failed IndexWriter#close() org.apache.lucene.store.LockReleaseFailedException: Cannot forcefully unlock a NativeFSLock which is held by another indexer component:

Re: Solr Replication Issue : Incorrect Base_URL

Hi Pramod, You need to set hostContext in your solr.xml. See https://cwiki.apache.org/confluence/display/solr/Format+of+solr.xml Alan Woodward www.flax.co.uk On 13 Jun 2014, at 00:44, pramodEbay wrote: Hi, I am deploying Solr in a larger web application. The standalone solr instance

Re: SOLR replication question?

I am currently using SOLR 4.4. but not planning to use solrcloud in very near future. I have 3 master / 3 slave setup. Each master is linked to its corresponding slave.. I have disabled auto polling.. We do both push (using MQ) and pull indexing using SOLRJ indexing program. I have enabled

Re: Solr replication is extremely slow(less then 1MB/s)

I agree. It is even slower when the slave is being pounded. On Fri, Jun 21, 2013 at 3:35 AM, Ted zhanghailian...@qq.com wrote: Solr replication is extremely slow(less then 1MB/s) When the replication is runinng,network and disk occupancy rate remained at a very low level. I've tried

Re: Solr Replication

Why do you think that during a backup any write activity would corrupt your backup? Solr backs up live indexes all the time, that's what's happening, in effect, when you replicate from a master to a slave. There's no requirement that the master stop indexing. The replication backup command Ahmet

Re: Solr Replication

Hi Vicky, May be str name=replicateAfterstartup/str ? For backups http://master_host:port/solr/replication?command=backup would be more suitable. or str name=backupAfterstartup/str --- On Thu, 3/14/13, vicky desai vicky.de...@germinait.com wrote: From: vicky desai

Re: Solr Replication

Hi, I have a multi core setup and there is continuous updation going on in each core. Hence I dont prefer a bckup as it would either cause a downtime or if during a backup there is a write activity my backup will be corrupted. Can you please suggest if there is a cleaner way to handle this --

Re: Solr replication takes long time

After upgrading to 4.2, the problem is not yet solved, in this image you can see, how slow is the transfer speed. At least, after the update the master is not blocked during replication http://lucene.472066.n3.nabble.com/file/n4046951/solr_replication.jpg Any idea? -- View this message in

Re: Solr replication takes long time

While looking at Solr logs, I found a java.lang.OutOfMemoryError: Java heap space that was happening 2 times per hour So I tried to increase the max memory heap assigned to JVM (-Xmx) and since then the servers are not crashing, even though the replication takes still long time to complete. But

Re: Solr replication takes long time

Are you using Solr 4.1? - Mark On Mar 11, 2013, at 1:53 PM, Victor Ruiz bik1...@gmail.com wrote: Hi guys, I have a problem with Solr replication. I have 2 solr servers (Solr 4.0.0) 1 master and 1 slave (8 processors,16GB RAM ,Ubuntu 11, ext3, each). In every server, there are 2

Re: Solr replication takes long time

no, Solr 4.0.0, I wanted to update to Solr 4.1 but I read that there was an issue with the replication, so I decided not to try it for now Mark Miller-3 wrote Are you using Solr 4.1? - Mark On Mar 11, 2013, at 1:53 PM, Victor Ruiz lt; bik1979@ gt; wrote: Hi guys, I have a

Re: Solr replication takes long time

Okay - yes, 4.0 is a better choice for replication than 4.1. It almost sounds like you may be replicating the full index rather than just changes or something. 4.0 had a couple issues as well - a couple things that were discovered while writing stronger tests for 4.2. 4.2 is spreading onto

Re: Solr replication takes long time

Thanks for your answer Mark. I think I'll try to update to 4.2. I'll keep you updated. Anyway, I'd not say that the full index is replicated, I've been monitoring the replication process in the Solr admin console and there I see that usually not more than 50-100 files are transferrend, the total

Re: Solr replication

BTW, when I said I think to say anything intelligent I meant I think for _me_ to say anything intelligent. Didn't mean to be snarky Erick On Mon, Nov 26, 2012 at 8:19 AM, Erick Erickson erickerick...@gmail.comwrote: both servers are master and slave in the config file. So that means

Re: Solr replication

Thanks Antoine. In fact, both solr servers are master and slave in config file. They have the same config file and replicate from the same master url with the vip. So, the master is on the server with the vip mounted on. And if heartbeat toggle, the role is toggled too. The question is : what

Re: Solr replication

both servers are master and slave in the config file. So that means they're polling each other? I think to say anything intelligent you're going to have to provide more data. Please review: http://wiki.apache.org/solr/UsingMailingLists. The bottom line here is that it sounds like what you're

Re: Solr Replication is not Possible on RAMDirectory?

Erik Hatcher-4 wrote There's an open issue (with a patch!) that enables this, it seems: lt;https://issues.apache.org/jira/browse/SOLR-3911gt; Erik well patch seems not doing that... i have tried and still getting some error lines about the dir types - Zeki ama calismiyor...

Re: Solr Replication is not Possible on RAMDirectory?

There's an open issue (with a patch!) that enables this, it seems: https://issues.apache.org/jira/browse/SOLR-3911 Erik On Nov 5, 2012, at 07:41 , deniz wrote: Michael Della Bitta-2 wrote No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the

Re: Solr Replication is not Possible on RAMDirectory?

Erik Hatcher-4 wrote There's an open issue (with a patch!) that enables this, it seems: lt;https://issues.apache.org/jira/browse/SOLR-3911gt; i will check it for sure, thank you Erik :) Shawn Heisey-4 wrote ... transparently mapping the files on disk to a virtual memory space and using

Re: Solr Replication is not Possible on RAMDirectory?

Shawn Heisey-4 wrote ... transparently mapping the files on disk to a virtual memory space and using excess RAM to cache that data and make it fast. If you have enough extra memory (disk cache) to fit the entire index, the OS will never have to read any part of the index from disk more

Re: Solr Replication is not Possible on RAMDirectory?

Here's some reading: http://en.wikipedia.org/wiki/Page_cache Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Mon, Nov 5, 2012 at 8:02 PM, deniz

Re: Solr Replication is not Possible on RAMDirectory?

Michael Della Bitta-2 wrote No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of heap. for my tests, i dont think

Re: Solr Replication is not Possible on RAMDirectory?

On 11/4/2012 11:41 PM, deniz wrote: Michael Della Bitta-2 wrote No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of

Re: Solr Replication is not Possible on RAMDirectory?

so it is not possible to use RAMdirectory for replication? No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of heap.

Re: solr replication against active indexing on master

thanks ... could you please point me to some more detailed explanation on line or I will have to read the code to find out? I would like to understand a little more on how this is achieved. thanks! Jie -- View this message in context:

Re: solr replication against active indexing on master

Hi, I don't have sources handy but you could start from SnapPuller.Java. Otis -- Performance Monitoring - http://sematext.com/spm On Nov 1, 2012 6:18 PM, Jie Sun jsun5...@yahoo.com wrote: thanks ... could you please point me to some more detailed explanation on line or I will have to read

Re: solr replication against active indexing on master

thanks... I just read the related code ... now I understand it seems the master keeps replicable snapshots (version), so it should be static. thank you Otis! -- View this message in context:

Re: Solr replication hangs on multiple slave nodes

Hi, I haven't seen this error before. Some questions/suggestions... Have you tried with 3.6.1? Is the disk full? Have you tried watching the network with http://code.google.com/p/tcpmon/ or tcpdump? Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance

Re: Solr Replication and Autocommit

I'll echo Otis, nothing comes to mind... Unless you were indexing stuff to the _slaves_, which you should never do, now or in the past Erick On Thu, Sep 27, 2012 at 12:00 AM, Aleksey Vorona avor...@ea.com wrote: Hi, I remember having some issues with replication and autocommit

Re: Solr Replication and Autocommit

Thank both of you for the responses! -- Aleksey On 12-09-27 03:51 AM, Erick Erickson wrote: I'll echo Otis, nothing comes to mind... Unless you were indexing stuff to the _slaves_, which you should never do, now or in the past Erick On Thu, Sep 27, 2012 at 12:00 AM, Aleksey Vorona

Re: Solr Replication and Autocommit

No issues that I know of, never encountered such an issue with any if our clients using Solr. Otis -- Performance Monitoring - http://sematext.com/spm On Sep 27, 2012 12:00 AM, Aleksey Vorona avor...@ea.com wrote: Hi, I remember having some issues with replication and autocommit previously.

Re: solr replication lag

Hello, Boris, If I remember correctly, older versions of Solr report the version of the as-of-yet uncommitted core in the replication page. So if you did a commit on the master and then a replication, you'd see that version on the client. Michael Della Bitta

Re: solr replication failing with error: Master at: is not available. Index fetch failed

hello, sorry - i overlooked this message - thanks for checking back and thanks for the info. yes - replication seems to be working now: tailed from logs just now: 2012-04-26 09:21:33,284 INFO [org.apache.solr.handler.SnapPuller] (pool-12-thread-1) Slave in sync with master. 2012-04-26

Re: solr replication failing with error: Master at: is not available. Index fetch failed

On Apr 23, 2012, at 12:10 PM, geeky2 wrote: http://someip:someport/somepath/somecore/admin/replication/ is not available. Index fetch failed. Exception: Invalid version (expected 2, but 10) or the data in not in 'javabin' format This is kind of a bug. When Solr tries to talk in javabin and

Re: solr replication failing with error: Master at: is not available. Index fetch failed

Hi, Is the replication still failing or working fine with that change ? On Tue, Apr 24, 2012 at 2:16 PM, geeky2 gee...@hotmail.com wrote: that was it! thank you. i did notice something else in the logs now ... what is the meaning or implication of the message, Connection reset.?

Re: solr replication failing with error: Master at: is not available. Index fetch failed

hello, thank you for the reply, yes - master has been indexed. ok - makes sense - the polling interval needs to change i did check the solr war file on both boxes (master and slave). they are identical. actually - if they were not indentical - this would point to a different issue altogether

Re: solr replication failing with error: Master at: is not available. Index fetch failed

Hi, In Solr wiki, for replication, the master url is defined as follows str name=masterUrlhttp://master_host:port /solr/corename/replication/str This url does not contain admin in its path where as in the master url provided by you, you have an additional admin in the url. Not very sure if this

Re: solr replication failing with error: Master at: is not available. Index fetch failed

that was it! thank you. i did notice something else in the logs now ... what is the meaning or implication of the message, Connection reset.? 2012-04-24 12:59:19,996 INFO [org.apache.solr.handler.SnapPuller] (pool-12-thread-1) Slave in sync with master. 2012-04-24 12:59:39,998 INFO

Re: solr replication failing with error: Master at: is not available. Index fetch failed

Hmmm, does your master have an index? In other words have you added anything to it? I actually doubt that's an issue, but An aside, a polling interval of 20 seconds is rather short, beware of your autowarming time exceeding your index updates But my _first_ guess is that somehow you're

Re: solr replication

Here is the way I see it (and implemented it), while using SolrJ api you have to fire : - Indexation commands to your /indexation solr instance/ (master) example : http://myMaster:80/myCore/ - Query commands to your /search solr instance/ (slave). You may have several slaves, and also find

Re: solr replication

Then as you say , shouldn't i define three SolrServer() using SolrJ? For indexing call solrMasterServer, and for querying call solrSlaveServer1 or solrSlaveServer2? On Wed, Jan 25, 2012 at 11:09 AM, darul daru...@gmail.com wrote: Here is the way I see it (and implemented it), while using SolrJ

Re: solr replication

You may define your specific configuration as a Grid with all your solr instances and then using SolrJ and CommonsHttpSolrServer choose the right url depending on indexation or search task. -- View this message in context:

Re: solr replication

Thank you for your response. What you mean by Grid? Can you please send me any example or any link? On Wed, Jan 25, 2012 at 11:30 AM, darul daru...@gmail.com wrote: You may define your specific configuration as a Grid with all your solr instances and then using SolrJ and CommonsHttpSolrServer

Re: solr replication

I mean by grid the list of your instances : String masterUrl = http://masterUrl/core/...; String[] slaveUrls = {http://slaveUrl/core/...;, http://slaveUrl/core/...} Then use your business logic to use the correct one with Http solrJ facade. -- View this message in context:

Re: solr replication

Ok thank you for your response. On Wed, Jan 25, 2012 at 12:24 PM, darul daru...@gmail.com wrote: I mean by grid the list of your instances : String masterUrl = http://masterUrl/core/...; String[] slaveUrls = {http://slaveUrl/core/...;, http://slaveUrl/core/...} Then use your business

Re: solr replication

Hi Parvin I did something that may help you. I set up apache (with mod_proxy and mode balance) like a front-end and use this to distruted the request of my aplication. Request for /update or /optmize, i'm redirect to master (or masters) server and requests /search i redirect to slaves. Example:

Re: solr replication

Hi Anderson, Thank you for your effort.I will try this. Hope it will solve my problem. Regards On Wed, Jan 25, 2012 at 2:27 PM, Anderson vasconcelos anderson.v...@gmail.com wrote: Hi Parvin I did something that may help you. I set up apache (with mod_proxy and mode balance) like a

Re: Solr Replication: relative path in confFiles Element?

On 10/25/2011 11:24 AM, Mark Schoy wrote: Hi, is ist possible to define a relative path in confFile? For example: str name=confFiles../../x.xml/str If yes, to which location will the file be copied at the slave? I don;t think it's possible. Replication copies confFiles from master

Re: Solr replication / repeater

Hey Erik, Hey Chris, thank you for your answers. I think i now understand better the functioning. kind regards Rene

Re: Solr replication / repeater

Hi, no ideas? :( kind regards, Rene From: Rene Lehmann rlehm...@timocom.com To: solr-user@lucene.apache.org solr-user@lucene.apache.org Date: 01.09.2011 15:36 Subject:Solr replication / repeater Hi there, i´m really new in Solr and have a question about the Solr

Re: Solr Replication / Repeater

It looks good except for the repeaters used to each other for replication. Having the masters use each other for replication implies that you're indexing data to both of them, in which case you wouldn't need them to update from each other! So you really have two choices I think 1 designate one

Re: Solr replication / repeater

: i´m really new in Solr and have a question about the Solr replication. : We want to use Solr in two data centers (dedicated fibre channel lane, like : intranet) behind a load balancer. Is the following infrastructure possible? : : - one repeater and one slave per data center : - the repeaters

Re: Solr replication, HAproxy and data management

Paolo Castagna wrote: Hi, we are using Solr v1.4.x with multi-cores and a master/slaves configuration. We also use HAProxy [1] to load balance search requests amongst slaves. Finally, we use MapReduce to create new Solr indexes. I'd like to share with you what I am doing when I need to: 1.

Re: Solr Replication Questions

On Wed, Jan 6, 2010 at 2:51 AM, Giovanni Fernandez-Kincade gfernandez-kinc...@capitaliq.com wrote: http://wiki.apache.org/solr/SolrReplication I've been looking over this replication wiki and I'm still unclear on a two points about Solr Replication: 1.     If there have been small changes

Re: SOLR: Replication

On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi f...@efendi.ca wrote: I tried... I set APR to improve performance... server is slow while replica; but top shows only 1% of I/O wait... it is probably environment specific; So you're saying that stock tomcat (non-native APR) was also 10 times slower?

RE: SOLR: Replication

-03-10 10:03 AM To: solr-user@lucene.apache.org Subject: Re: SOLR: Replication On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi f...@efendi.ca wrote: I tried... I set APR to improve performance... server is slow while replica; but top shows only 1% of I/O wait... it is probably environment

Re: SOLR: Replication

] On Behalf Of Yonik Seeley Sent: January-03-10 10:03 AM To: solr-user@lucene.apache.org Subject: Re: SOLR: Replication On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi f...@efendi.ca wrote: I tried... I set APR to improve performance... server is slow while replica; but top shows only 1% of I/O

Re: SOLR: Replication

On Sun, Jan 3, 2010 at 2:55 PM, Peter Wolanin peter.wola...@acquia.com wrote: Related to the difference between rsync and native Solr replication - we are seeing issues with Solr 1.4 where search queries that come in during a replication request hang for excessive amount of time (up to 100's

Re: SOLR: Replication

On Sat, Jan 2, 2010 at 5:48 PM, Fuad Efendi f...@efendi.ca wrote: I used RSYNC before, and 20Gb replica took less than an hour (20-40 minutes); now, HTTP, and it takes 5-6 hours... Admin screen shows 952Kb/sec average speed; 100Mbps network, full-duplex; I am using Tomcat Native for APR. 10x

RE: SOLR: Replication

or something like that; RAM-buffer, flush to disk, etc. -Fuad -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik Seeley Sent: January-02-10 5:52 PM To: solr-user@lucene.apache.org Subject: Re: SOLR: Replication On Sat, Jan 2, 2010 at 5:48 PM

Re: Solr replication 1.3 issue

This is a Unix security question. rsyncd' is a system daemon and should be managed in the OS scripts. The rsyncd-* scripts include a security setting for the 'solr' account that limits the account to the solr data directory (and this code does not support multicore). For security reasons, I

RE: Solr replication 1.3 issue

. Madu -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: Wednesday, 23 December 2009 9:33 AM To: solr-user@lucene.apache.org Subject: Re: Solr replication 1.3 issue This is a Unix security question. rsyncd' is a system daemon and should be managed in the OS scripts

Re: Solr Replication: How to restore data from last snapshot

: Subject: Solr Replication: How to restore data from last snapshot : References: 8950e934db69a040a1783438e67293d813da3f6...@delmail.sapient.com : 26230840.p...@talk.nabble.com : f4d979d0911061116l14fa3a49sc5a71d855857c...@mail.gmail.com : In-Reply-To:

Re: Solr Replication: How to restore data from last snapshot

-user@lucene.apache.org Subject: Re: Solr Replication: How to restore data from last snapshot If your master index is corrupt and it hasn't been replicated out, you should be able to shut down the server and remove the corrupted index files. Then copy the replicated index back onto the master

Re: Solr Replication

On Fri, Aug 28, 2009 at 2:04 AM, J G skinny_joe...@hotmail.com wrote: We have multiple solr webapps all running from the same WAR file. Each webapp is running under the same Tomcat container and I consider each webapp the same thing as a slice (or instance). I've configured the Tomcat

Re: Solr Replication

? Thanks again. From: noble.p...@corp.aol.com Date: Wed, 26 Aug 2009 11:05:34 +0530 Subject: Re: Solr Replication To: solr-user@lucene.apache.org The ReplicationHandler is not enforced as a singleton , but for all practical purposes it is a singleton for one core. If an instance  (a slice as you

RE: Solr Replication

JMX as in using the replication admin page for each web app. Thanks. From: noble.p...@corp.aol.com Date: Thu, 27 Aug 2009 13:04:38 +0530 Subject: Re: Solr Replication To: solr-user@lucene.apache.org when you say a slice you mean one instance of solr? So your JMX console is connecting

Re: Solr Replication

. Thanks. From: noble.p...@corp.aol.com Date: Thu, 27 Aug 2009 13:04:38 +0530 Subject: Re: Solr Replication To: solr-user@lucene.apache.org when you say a slice you mean one instance of solr? So your JMX console is connecting to only one solr? On Thu, Aug 27, 2009 at 3:19 AM, J

RE: Solr Replication

/instance via JMX like how you can see attributes for each slice/instance via each replication admin jsp page? Thanks again. From: noble.p...@corp.aol.com Date: Wed, 26 Aug 2009 11:05:34 +0530 Subject: Re: Solr Replication To: solr-user@lucene.apache.org The ReplicationHandler

Re: Solr Replication

The ReplicationHandler is not enforced as a singleton , but for all practical purposes it is a singleton for one core. If an instance (a slice as you say) is setup as a repeater, It can act as both a master and slave in the repeater the configuration should be as follows MASTER

Re: Solr replication and spellcheck data

This is not supported by the Java Replication . but planned for later https://issues.apache.org/jira/browse/SOLR-866 On Wed, Jul 29, 2009 at 4:04 AM, Ian Sugariansu...@gmail.com wrote: Hi I would like to make use of the new replication mechanism [1] to set up a master-slaves configuration,

  1   2   >