I feel like we are back to Basic ;) If you keep running line 40 over and over on the same memory index, do you see a slowdown?
Mike http://blog.mikemccandless.com On Mon, May 2, 2011 at 1:19 PM, Otis Gospodnetic <[email protected]> wrote: > Hi, > > I think this describes what's going on: > > 10 load N stored queries > 20 parse N stored queries, keep them in some List forever > 30 for each incoming document create a new MemoryIndex instance "mi" > 40 for query 1 to N do mi.search(query) > > Over time this step 40 takes longer and longer and longer -- if some of the > queries are MultiPhraseQueries. This is even with with mergeSort being used > in > MultiPhraseQuery. > > Otis > ---- > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > Lucene ecosystem search :: http://search-lucene.com/ > > > > ----- Original Message ---- >> From: Michael McCandless <[email protected]> >> To: [email protected] >> Sent: Mon, May 2, 2011 12:15:40 PM >> Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1 >> >> By "slowing down over time" do you mean you use the same index (no new >> docs added) yet running the same MPQ over and over you see it taking >> longer to execute over time? >> >> Mike >> >> http://blog.mikemccandless.com >> >> On Mon, May 2, 2011 at 12:00 PM, Tomislav Poljak <[email protected]> wrote: >> > Hi, >> > after running tests on both MemoryIndex and RAMDirectory based index >> > in Lucene 3.1, seems MultiPhraseQueries are slowing down over time >> > (each iteration of executing the same MultiPhraseQueries on the same >> > doc, seems to require more and more execution time). Are there any >> > existing/known issues related to the MultiPhraseQuery in Lucene 3.1 >> > which could lead to this performance drop? >> > >> > Tomislav >> > >> > --------------------------------------------------------------------- >> > To unsubscribe, e-mail: [email protected] >> > For additional commands, e-mail: [email protected] >> > >> > >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
