RE: Multi-thread indexing, should the commit be called from each thread?

I was certainly asking about lucene! From: j...@basetechnology.com To: java-user@lucene.apache.org Subject: Re: Multi-thread indexing, should the commit be called from each thread? Date: Wed, 21 May 2014 11:53:46 -0400 (Was this supposed to be a java-user/Lucene question or a Solr

Multi-thread indexing, should the commit be called from each thread?

Hi! I have a question about multi-thread indexing. When I perform a Multi-thread indexing, should I commit from each thread that I add documents or the commit should be done only when all the threads are done with their indexing task? Thank you!

Re: Multi-thread indexing, should the commit be called from each thread?

You don't need to commit from each thread, you can definitely commit when all threads are done. In general, you should commit only when you want to ensure the data is safe on disk. Shai On Wed, May 21, 2014 at 2:58 PM, andi rexha a_re...@hotmail.com wrote: Hi! I have a question about

Re: Multi-thread indexing, should the commit be called from each thread?

I'll be more emphatic than Shai; you should _definitely_ not commit from each thread, especially if you are doing a hard commit with openSearcher=true or a soft commit. In either case you open a new searcher which fires all your autowarming queries which.. IOW they're expensive operations. More

Re: Multi-thread indexing, should the commit be called from each thread?

(Was this supposed to be a java-user/Lucene question or a Solr question?!) -- Jack Krupansky -Original Message- From: Erick Erickson Sent: Wednesday, May 21, 2014 10:58 AM To: java-user Subject: Re: Multi-thread indexing, should the commit be called from each thread? I'll be more