Re: How to distribute lucene using rsync

2009-06-09 Thread Michael McCandless
Note that when using rsync, you must first close the IndexWriter, else the copy can be corrupt. If having to close IndexWriter (and stop indexing) is a hassle, then you should use SnapshotDeletionPolicy; it was created exactly for this reason (to take a backup of the index even while further index

Re: How to distribute lucene using rsync

2009-06-09 Thread Ian Lea
Unless you optimize it or are doing weird things with merge factors you won't get completely new files every time you update an index. Some files will change, or be created, or deleted, and some won't. Then you can just copy them wherever you want using rsync or whatever you like. We use rsync, ma

Re: How to distribute lucene using rsync

2009-06-08 Thread pof
Is their a way to address this without Solr? I was looking at Solr today and it looks like a lot of piss-farting around just to backup an index. I also found their explaination on http://wiki.apache.org/solr/CollectionDistribution poorly explained, so I am a bit confused with the whole process.

Re: Re: Re: How to distribute lucene using rsync

2007-08-26 Thread tom
Tom Roberts is out of the office until 3rd September 2007 and will get back to you on his return. http://www.luxonline.org.uk http://www.lux.org.uk - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail:

Re: Re: How to distribute lucene using rsync

2007-08-26 Thread tom
Tom Roberts is out of the office until 3rd September 2007 and will get back to you on his return. http://www.luxonline.org.uk http://www.lux.org.uk - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail:

Re: How to distribute lucene using rsync

2007-08-26 Thread Grant Ingersoll
Yes, see Solr. It takes care of all this, and then some, for you. -Grant On Aug 25, 2007, at 9:52 PM, varma d wrote: Hi Lucene gurus, I am newbie and i have a question on transfering index directories across multiple machines. Whenever i update/add any new documents to the existing ind

Re: Re: How to distribute lucene using rsync

2007-08-25 Thread tom
Tom Roberts is out of the office until 3rd September 2007 and will get back to you on his return. http://www.luxonline.org.uk http://www.lux.org.uk - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail:

Re: How to distribute lucene using rsync

2007-08-25 Thread tom
Tom Roberts is out of the office until 3rd September 2007 and will get back to you on his return. http://www.luxonline.org.uk http://www.lux.org.uk - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: