On 4/12/07, Neville Burnell <[EMAIL PROTECTED]> wrote: > Firstly, thanks Dave for all your hard work. Ferret Rocks!, > > I am just testing 0.11.4.win32 and it seems to work just fine, however > the index creation phase of my app is perhaps 3x slower under 0.11.4 vs > 0.10.9 > > Details follow: > > System: windows xp sp2, index on local hard disk, Ruby 1.8.6 > > Run #1, Ferret 0.10.9 > - Reboot > - Build index, 35,000 rows added in 297 seconds > - > Run #2, Ferret 0.11.4 > - Reboot > - Build index, 35,000 rows added in 1044 seconds
Ouch, that sucks. There is a difference in indexing speed on Linux too depending a lot on the parameters you use but bulk indexing is largely unchanged. The differences are due to the changes I've made to make Ferret more stable when indexing and adding the ability to Ferret to recover when the index is corrupted. This makes Ferret much slower when opening an index but the indexing procedure hasn't changed. I haven't really looked at the performance in Windows. A few questions here might allow me to fix this problem. Are you using the Index class or the IndexWriter class? What parameters are you passing to the indexer? I'll see what I can do but I can't promise anything. > Searching both indexes "feels" about the same Searching should be the same, although opening the index for searching will be slower. But this shouldn't be done for every search so it shouldn't be a problem. > Any comments on whether Ferret 0.11.4 should be much slower for bulk > inserts ? I guess I already answered this. No, it shouldn't be slower for bulk updates. Actually, looking at your times, it seems like you may not have the optimal settings for indexing as even 297 seconds seems like a long time to index 35,000 documents although it depends on the documents and where they are coming from. If you give me a little more information I may be able to help you speed this up. Cheers, Dave -- Dave Balmain http://www.davebalmain.com/ _______________________________________________ Ferret-talk mailing list [EMAIL PROTECTED] http://rubyforge.org/mailman/listinfo/ferret-talk
