Re: improving RAM usage by IndexWriter

2007-03-19 Thread Marvin Humphrey
On Mar 19, 2007, at 5:09 AM, Michael McCandless wrote: I think some of these changes are similar to how KinoSearch builds a segment. Yup... sounds familiar. ;) I'm still working through some lingering issues before I can make a clean patch, Well, where is it? Don't keep it a secret! M

improving RAM usage by IndexWriter

2007-03-19 Thread Michael McCandless
Hi, I've been looking into improving performance of IndexWriter, specifically how it makes use of RAM to buffer added documents. I've created a new class (MultiDocumentWriter) that can build a single segment from many documents at once, more efficiently than the current single document segment ap