Re: Garbage Collection performance on 2.9.2

2010-03-26 Thread Siraj Haider
oops, forgot the attachments... its here now... On 3/26/2010 10:33 AM, Siraj Haider wrote: Hi Mike, I am attaching the dump that I created by putting -XX:+PrintClassHistogram in catalina options and by issuing a kill -3 command. The machine was not in a bad state (i.e. it was not doing frequen

Re: Garbage Collection performance on 2.9.2

2010-03-26 Thread Siraj Haider
Hi Mike, I am attaching the dump that I created by putting -XX:+PrintClassHistogram in catalina options and by issuing a kill -3 command. The machine was not in a bad state (i.e. it was not doing frequent Full GC cycles yet) but the kill -3 forced it to do a Full GC. If you want I will wait

Re: Garbage Collection performance on 2.9.2

2010-03-25 Thread Michael McCandless
Are you using IndexReader.reopen to open those new searchers? Can you capture a memory dump when GC kicks in? I'd be curious to see where all the "new" garbage is coming from... I don't think 2.3.2 -> 2.9.2 should be generating more garbage. Mike On Thu, Mar 25, 2010 at 3:55 PM, Siraj Haider w

Re: Garbage Collection performance on 2.9.2

2010-03-25 Thread Siraj Haider
Indexing happens in a different thread on intervals. I open a new IndexWriter for each indexing session. After indexing session if there is a modification in the index I close the searcher and open a new one. I have two searchers that I flip flop when opening an index. On 3/25/2010 3:26 PM,

Re: Garbage Collection performance on 2.9.2

2010-03-25 Thread Michael McCandless
How do you reopen your searchers after indexing? Do you keep a single IW open for all time? Mike On Thu, Mar 25, 2010 at 3:11 PM, Siraj Haider wrote: > Indexing happen with frequent intervals on our indexes, but I think > searching is the cause of the issue, because as soon as the indexes are h

Re: Garbage Collection performance on 2.9.2

2010-03-25 Thread Siraj Haider
Indexing happen with frequent intervals on our indexes, but I think searching is the cause of the issue, because as soon as the indexes are hit with a lot of searches, the gc cycles become more frequent. -siraj On 3/24/2010 5:19 PM, Michael McCandless wrote: Is this during indexing or searchi

Re: Garbage Collection performance on 2.9.2

2010-03-24 Thread Michael McCandless
Is this during indexing or searching? Mike On Wed, Mar 24, 2010 at 3:45 PM, Grant Ingersoll wrote: > > On Mar 24, 2010, at 2:13 PM, Siraj Haider wrote: > >> We upgraded to 2.9.2 from 2.3.2 and the garbage collection performance >> deteriorated drastically.  The system is going to Full GC cycles

Re: Garbage Collection performance on 2.9.2

2010-03-24 Thread Grant Ingersoll
On Mar 24, 2010, at 2:13 PM, Siraj Haider wrote: > We upgraded to 2.9.2 from 2.3.2 and the garbage collection performance > deteriorated drastically. The system is going to Full GC cycles with long > pauses very frequently. Did something got changed that we need to account > for? Yes, quite