Re: Here a merge thread, there a merge thread ...

2012-02-24 Thread Michael McCandless
This is from ConcurrentMergeScheduler (the default MergeScheduler). But, are you sure the threads are sleeping, not exiting? (They should be exiting). This merge scheduler starts a new thread when a merge is needed, allows that thread to do another merge (if one is immediately available), else t

Re: Here a merge thread, there a merge thread ...

2012-02-24 Thread Benson Margulies
On Fri, Feb 24, 2012 at 10:59 AM, Michael McCandless wrote: > This is from ConcurrentMergeScheduler (the default MergeScheduler). > > But, are you sure the threads are sleeping, not exiting?  (They should > be exiting). > > This merge scheduler starts a new thread when a merge is needed, > allows

retrieved doc field values being cached?

2012-02-24 Thread Rose, Stuart J
Lucene (using 3.5) seems to be caching field values for documents (after they have been retrieved) and I am hoping someone can provide more information on how and where exactly the field values are stored. The table below lists the times (in milliseconds) associated with retrieving for a set o

Re: retrieved doc field values being cached?

2012-02-24 Thread Simon Willnauer
Hey Stuart, Lucene solely relies on the FS cache with some exceptions for the term-dictionary and FieldCache which is pulled entirely into memory. FieldCache is not used to retrieve stored fields though, its rather an univerted view (docID -> value) of an indexed (inverted) field. So basically wha

Lucene Revolution conference - May 7-10, Boston

2012-02-24 Thread Erik Hatcher
Lucene Revolution will be here May 9-10 in Boston (with training classes offered on May 7-8). Reserve your spot today with Early Bird pricing of $575. Committers and accepted speakers are entitled to free admission. The CFP is open and we’re actively seeking submissions from the Community. Subm

RE: retrieved doc field values being cached?

2012-02-24 Thread Rose, Stuart J
Thanks Simon, Warming up all the docs in the index took less time and space than I expected (28 million doc titles, ~60 seconds, ~4GB in RAM). Do you know if the speedup is solely due to the doc fields being loaded into RAM? Regards, Stuart -Original Message- From: Simon Willnauer [m

QueryParser strange behavior

2012-02-24 Thread Damerian
Hello! I have a small issue with the QueryParser in my program. It uses my custom filter to Parse its queries, but i get unexpexted results from when i am having an input from the keyboard To illustrate the code : Analyzer myAnalyzer = new ProperNameAnalyzer(); Query query = new QueryPars