RE: Commit performance

2007-08-21 Thread Gunther, Andrew
I've seen even longer commit times with our 2GB index and have not had a chance to look into it deeper. What I have noticed is when there are Searchers registered commits take a lot longer time. Perhaps looking at the optional attributes for commit (waitSearcher, waitFlush) would help. Since we

Re: Commit performance

2007-08-21 Thread Chris Hostetter
: How long should a commit take? I've got about 9.8G of data for 9M of : records. (Yes, I'm indexing too much data.) My commits are taking 20-30 the low levels of updating aren't my forte, but as i recall the dominant factor in how long it takes to execute a commit is the number of deleted

RE: Commit performance

2007-08-21 Thread Chris Hostetter
: chance to look into it deeper. What I have noticed is when there are : Searchers registered commits take a lot longer time. Perhaps looking at that's probably the warming time taken to reopen the new searcher ... waitSearcher=false should cause those commits to reutrn much faster (the down