Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-07-31 Thread roz dev
Hi All I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing that when we are indexing lots of data with 16 concurrent threads, Heap grows continuously. It remains high and ultimately most of the stuff ends up being moved to Old Gen. Eventually, Old Gen also fills up and we start

Re: Lucene 4.0 GA time frame

2012-07-31 Thread Jack Krupansky
Erick's estimate is right in line with the chatter I have heard. There is some talk of a Beta release in August, but there is some concern that too many people are on vacation in August to get much feedback. My guess is for a Beta no later than the middle of September and a release a month lat

Re: Lucene 4.0 GA time frame

2012-07-31 Thread Erick Erickson
My guess is in the September/October time frame. Things are actually moving along pretty quickly, and there's considerable sentiment to get it out the door... Best Erick On Mon, Jul 30, 2012 at 11:11 PM, Vitaly Funstein wrote: > Given that the Alpha is out, are there any more or less definitive

Re: Small Vocabulary

2012-07-31 Thread Ian Lea
Lucene 4.0 allows you to use custom codecs and there may be one that would be better for this sort of data, or you could write one. In your tests is it the searching that is slow or are you reading lots of data for lots of docs? The latter is always likely to be slow. General performance advice a