I've been able to reduce these GC outages by: 1) Optimizing my schema. This reduced my index size by more than 50% 2) Smaller cache sizes. I started with filterCache, documentCache & queryCache sizes of ~10,000. They're now at ~500 3) Reduce heap allocation. I started at 27 GB, now I'm 'only' allocating 8 GB 4) Update to trunk (was using Dec 2/08 code, now using Jan 26/09)
I still see outages due to garbage collection every ~10 minutes, but they last ~2 seconds (instead of 20+ seconds). Note that my throughput dropped from ~30 hits/second to ~23 hits/second. Luckily, I'm still hitting my performance requirements, so I'm able to accept that. Thanks for the tips! Wojtek yonik wrote: > > On Tue, Feb 3, 2009 at 11:58 AM, wojtekpia <wojte...@hotmail.com> wrote: >> I noticed your wiki post about sorting with a function query instead of >> the >> Lucene sort mechanism. Did you see a significantly reduced memory >> footprint >> by doing this? > > FunctionQuery derives field values from the FieldCache... so it would > use the same amount of memory as sorting. > > -Yonik > > -- View this message in context: http://www.nabble.com/Performance-%22dead-zone%22-due-to-garbage-collection-tp21588427p21922773.html Sent from the Solr - User mailing list archive at Nabble.com.
