On 6/7/06, Benjamin Stein <[EMAIL PROTECTED]> wrote:
During indexing, I have been using a RAMDirectory to store many thousands of documents in memory before flushing the buffer to disk using IndexWriter.addIndexes. For the most part this works very well, except that performance degrades tremendously over time due to the implicit call (or two!) to optimize() inside the addIndexes function.
I could probably store the little RAMDirectories to disk as many FSDirectories, and then addIndexes() of *all* the FSDirectories at the end instead of every time. That would probably be smart. Glad I asked myself!