Re: IndexWriter.applyDeletes performance

2010-03-08 Thread Bogdan Ghidireac
Mike, > > But... how long does step 2 take?  Is it an option to not commit on > every update?  How many docs do you typically update? I do not commit on every update, I call commit once every 10k documents. Indexing 10k docs takes around 10 secs. > > If you are committing only so that an outsid

Re: IndexWriter.applyDeletes performance

2010-03-05 Thread Michael McCandless
OK I opened: https://issues.apache.org/jira/browse/LUCENE-2297 Mike On Fri, Mar 5, 2010 at 10:25 AM, Michael McCandless wrote: > Currently you can't tell IW to use the pool (ie, pool is only enabled > if you use NRT readers).  We should probably make this an option at > ctor time, for situati

Re: IndexWriter.applyDeletes performance

2010-03-05 Thread Michael McCandless
Currently you can't tell IW to use the pool (ie, pool is only enabled if you use NRT readers). We should probably make this an option at ctor time, for situations like this. (In fact, in followon discussions about further improvements to NRT we've already discussed having such an option to IW's c