On Dec 17, 2012, at 23:21 , Marvin Humphrey <[email protected]> wrote:
> > http://lucy.apache.org/docs/perl/Lucy/Docs/Cookbook/FastUpdates.html#ABSTRACT > > While index updates are fast on average, worst-case update performance may > be significantly slower. To make index updates consistently quick, we must > manually intervene to control the process of index segment consolidation. > > To guarantee good responsiveness by the "indexer" process, both "indexer" and > "updater" need to limit the amount of existing content that they will recycle > and you need an additional BackgroundMerger process as described in > Lucy::Docs::Cookbook::FastUpdates to keep the number of segments from growing > out of control. My "indexer" process already uses the LightMergeManager as described in the FastUpdates cookbook entry. But you're right, the "updater" also has to use a LightMergeManager. Another question regarding LightMergeManager: The cookbook entry recommends to use a ceiling of 10 documents per segment. That seems a bit low to me. Shouldn't something like 50, 100 or even more docs be OK on typical hardware? And regarding the BackgroundMerger: Can the background merging simply be run periodically as a cron job? Nick
