I feel like we are back to Basic ;) If you keep running line 40 over and over on the same memory index, do you see a slowdown?
Mike http://blog.mikemccandless.com On Mon, May 2, 2011 at 1:19 PM, Otis Gospodnetic <otis_gospodne...@yahoo.com> wrote: > Hi, > > I think this describes what's going on: > > 10 load N stored queries > 20 parse N stored queries, keep them in some List forever > 30 for each incoming document create a new MemoryIndex instance "mi" > 40 for query 1 to N do mi.search(query) > > Over time this step 40 takes longer and longer and longer -- if some of the > queries are MultiPhraseQueries. This is even with with mergeSort being used > in > MultiPhraseQuery. > > Otis > ---- > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > Lucene ecosystem search :: http://search-lucene.com/ > > > > ----- Original Message ---- >> From: Michael McCandless <luc...@mikemccandless.com> >> To: java-user@lucene.apache.org >> Sent: Mon, May 2, 2011 12:15:40 PM >> Subject: Re: MultiPhraseQuery slowing down over time in Lucene 3.1 >> >> By "slowing down over time" do you mean you use the same index (no new >> docs added) yet running the same MPQ over and over you see it taking >> longer to execute over time? >> >> Mike >> >> http://blog.mikemccandless.com >> >> On Mon, May 2, 2011 at 12:00 PM, Tomislav Poljak <tpol...@gmail.com> wrote: >> > Hi, >> > after running tests on both MemoryIndex and RAMDirectory based index >> > in Lucene 3.1, seems MultiPhraseQueries are slowing down over time >> > (each iteration of executing the same MultiPhraseQueries on the same >> > doc, seems to require more and more execution time). Are there any >> > existing/known issues related to the MultiPhraseQuery in Lucene 3.1 >> > which could lead to this performance drop? >> > >> > Tomislav >> > >> > --------------------------------------------------------------------- >> > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >> > For additional commands, e-mail: java-user-h...@lucene.apache.org >> > >> > >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org >> For additional commands, e-mail: java-user-h...@lucene.apache.org >> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org > For additional commands, e-mail: java-user-h...@lucene.apache.org > > --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org
