This is with lucene 3.0.3 running JDK 6u20 64-bit. I'm running into an issue where merges are looping seemingly randomly with the use of ConcurrentMergeSchduler. By "seemingly randomly", I mean that with repeated process restarts against very much the same data set this behavior will occur, but it doesn't seem to be triggered by a specific document, i.e. this is not caused by specific data.
The following is the DEBUG logging on IndexMerger. Has anyone seen this before or know what the issue is and the resolution for this? Note that using "merge: total" as a milestone marker, you'll see that the Merge Thread #0 is looping repeatedly. 2011-10-25T23:27:36.791+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: setInfoStream: dir=org.apache.lucene.store.NIOFSDirectory@/home/merger/25331545000616551-12 lockFactory=org.apache.lucene.store.NativeFSLockFactory@142c29ff mergePolicy=org.apache.lucene.index.BalancedSegmentMergePolicy@5421b305 mergeScheduler=org.apache.lucene.index.ConcurrentMergeScheduler@70703869 ramBufferSizeMB=100.0 maxBufferedDocs=-1 maxBuffereDeleteTerms=-1 maxFieldLength=2147483647 index= 2011-10-25T23:27:36.795+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: flush at addIndexesNoOptimize 2011-10-25T23:27:36.795+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: flush: now pause all indexing threads 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: flush: segment=null docStoreSegment=null docStoreOffset=0 flushDocs=false flushDeletes=true flushDocStores=false numDocs=0 numBufDelTerms=0 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: index before flush 2011-10-25T23:27:36.796+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: now start transaction 2011-10-25T23:27:36.803+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: add merge to pendingMerges: _0:Cx30877->_0 _0:Cx12519->_0 [total 1 pending] 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: add merge to pendingMerges: _0:Cx28305->_0 _0:Cx19527->_0 [total 2 pending] 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: add merge to pendingMerges: _0:Cx4605->_0 _0:Cx37050->_0 [total 3 pending] 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: add merge to pendingMerges: _0:Cx30862->_0 _0:Cx16948->_0 [total 4 pending] 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: add merge to pendingMerges: _0:Cx22130->_0 _0:Cx47560->_0 [total 5 pending] 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: add merge to pendingMerges: _0:Cx11198->_0 _0:Cx53059->_0 [total 6 pending] 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: CMS: now merge 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: CMS: index: _0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0** _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:Cx30877->_0** _0:Cx12519->_0** 2011-10-25T23:27:36.804+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: CMS: consider merge _0:Cx30877->_0 _0:Cx12519->_0 into _0 [mergeDocStores] 2011-10-25T23:27:36.805+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: CMS: launch new thread [Lucene Merge Thread #0] 2011-10-25T23:27:36.805+0000 DEBUG pool-9-thread-1 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; pool-9-thread-1]: CMS: too many merge threads running; stalling... 2011-10-25T23:27:36.805+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: start 2011-10-25T23:27:36.806+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:36.806+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; Lucene Merge Thread #0]: merging _0:Cx30877->_0 _0:Cx12519->_0 into _0 [mergeDocStores] 2011-10-25T23:27:36.807+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:36 UTC 2011; Lucene Merge Thread #0]: merge: *total 43396 docs* 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: commitMerge: _0:Cx30877->_0 _0:Cx12519->_0 into _0 [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0** _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:Cx30877->_0** _0:Cx12519->_0** 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30877->_0 _0:Cx12519->_0 into _0 [mergeDocStores] 2011-10-25T23:27:37.476+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [15 segments ; isCommit = false] 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:Cx4605->_0 _0:Cx37050->_0 into _2 [mergeDocStores] 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:37.477+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: merging _0:Cx4605->_0 _0:Cx37050->_0 into _2 [mergeDocStores] 2011-10-25T23:27:37.478+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:37 UTC 2011; Lucene Merge Thread #0]: *merge: total 41655 docs* 2011-10-25T23:27:38.071+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: commitMerge: _0:Cx4605->_0 _0:Cx37050->_0 into _2 [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _0:Cx4605->_0** _0:Cx37050->_0** _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _0:Cx4605->_0 _0:Cx37050->_0 into _2 [mergeDocStores] 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [14 segments ; isCommit = false] 2011-10-25T23:27:38.072+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores] 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: merging _0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores] 2011-10-25T23:27:38.073+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: *merge: total 47810 docs* 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: commitMerge: _0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** _0:Cx47560->_0** _0:Cx30862->_0** _0:Cx16948->_0** _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _0:Cx30862->_0 _0:Cx16948->_0 into _3 [mergeDocStores] 2011-10-25T23:27:38.709+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [13 segments ; isCommit = false] 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores] 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:38.710+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: merging _0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores] 2011-10-25T23:27:38.711+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:38 UTC 2011; Lucene Merge Thread #0]: *merge: total 69690 docs* 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: commitMerge: _0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _0:Cx22130->_0** _0:Cx47560->_0** _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _0:Cx22130->_0 _0:Cx47560->_0 into _4 [mergeDocStores] 2011-10-25T23:27:39.750+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [12 segments ; isCommit = false] 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores] 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:39.751+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: merging _0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores] 2011-10-25T23:27:39.752+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:39 UTC 2011; Lucene Merge Thread #0]: *merge: total 64257 docs* 2011-10-25T23:27:40.770+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: commitMerge: _0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores] index=_0:Cx11198->_0** _0:Cx53059->_0** _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _0:Cx11198->_0 _0:Cx53059->_0 into _5 [mergeDocStores] 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit = false] 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: add merge to pendingMerges: _0:C43396 [total 1 pending] 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _0:C43396 into _6 [mergeDocStores] 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:40.771+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: merging _0:C43396 into _6 [mergeDocStores] 2011-10-25T23:27:40.772+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:40 UTC 2011; Lucene Merge Thread #0]: *merge: total 43396 docs* 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: commitMerge: _0:C43396 into _6 [mergeDocStores] index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _0:C43396 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _0:C43396 into _6 [mergeDocStores] 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit = false] 2011-10-25T23:27:41.384+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.tis" 2011-10-25T23:27:41.386+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.prx" 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.nrm" 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.fnm" 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.tii" 2011-10-25T23:27:41.387+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.frq" 2011-10-25T23:27:41.389+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.fdx" 2011-10-25T23:27:41.389+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: delete "_0.fdt" 2011-10-25T23:27:41.394+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: add merge to pendingMerges: _6:C43396 [total 1 pending] 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _6:C43396 into _7 [mergeDocStores] 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: merging _6:C43396 into _7 [mergeDocStores] 2011-10-25T23:27:41.395+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:41 UTC 2011; Lucene Merge Thread #0]: *merge: total 43396 docs* 2011-10-25T23:27:42.012+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: commitMerge: _6:C43396 into _7 [mergeDocStores] index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _6:C43396 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _6:C43396 into _7 [mergeDocStores] 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit = false] 2011-10-25T23:27:42.030+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.frq" 2011-10-25T23:27:42.032+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.fdx" 2011-10-25T23:27:42.032+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.tis" 2011-10-25T23:27:42.035+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.tii" 2011-10-25T23:27:42.035+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.prx" 2011-10-25T23:27:42.036+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.fnm" 2011-10-25T23:27:42.036+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.fdt" 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: delete "_6.nrm" 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: add merge to pendingMerges: _7:C43396 [total 1 pending] 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _7:C43396 into _8 [mergeDocStores] 2011-10-25T23:27:42.043+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:42.044+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: merging _7:C43396 into _8 [mergeDocStores] 2011-10-25T23:27:42.044+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:42 UTC 2011; Lucene Merge Thread #0]: *merge: total 43396 docs* 2011-10-25T23:27:43.958+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: commitMerge: _7:C43396 into _8 [mergeDocStores] index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _7:C43396 2011-10-25T23:27:43.958+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _7:C43396 into _8 [mergeDocStores] 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit = false] 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.fnm" 2011-10-25T23:27:43.959+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.tis" 2011-10-25T23:27:43.963+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.nrm" 2011-10-25T23:27:43.963+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.frq" 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.tii" 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.fdx" 2011-10-25T23:27:43.965+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.fdt" 2011-10-25T23:27:43.975+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: delete "_7.prx" 2011-10-25T23:27:43.976+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: add merge to pendingMerges: _8:C43396 [total 1 pending] 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _8:C43396 into _9 [mergeDocStores] 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: merging _8:C43396 into _9 [mergeDocStores] 2011-10-25T23:27:43.977+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:27:43 UTC 2011; Lucene Merge Thread #0]: *merge: total 43396 docs* 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: commitMerge: _24m:C43396 into _24n [mergeDocStores] index=_5:C64257 _4:C69690 _3:C47810 _0:Cx30401->_0** _0:Cx36858->_0** _0:Cx37828->_0** _2:C41655 _0:Cx28305->_0** _0:Cx19527->_0** _2:Cx75008->_0** _24m:C43396 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: commitMergeDeletes _24m:C43396 into _24n [mergeDocStores] 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: now checkpoint "segments_1" [11 segments ; isCommit = false] 2011-10-25T23:59:53.355+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.tis" 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.nrm" 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.tii" 2011-10-25T23:59:53.358+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.fdt" 2011-10-25T23:59:53.367+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.fnm" 2011-10-25T23:59:53.367+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.frq" 2011-10-25T23:59:53.369+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.fdx" 2011-10-25T23:59:53.369+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: delete "_24m.prx" 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: add merge to pendingMerges: _24n:C43396 [total 1 pending] 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _24n:C43396 into _24o [mergeDocStores] 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:59:53.370+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: merging _24n:C43396 into _24o [mergeDocStores] 2011-10-25T23:59:53.371+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:53 UTC 2011; Lucene Merge Thread #0]: *merge: total 43396 docs* 2011-10-25T23:59:59.071+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.tis" 2011-10-25T23:59:59.074+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.prx" 2011-10-25T23:59:59.075+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.fdt" 2011-10-25T23:59:59.083+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.fnm" 2011-10-25T23:59:59.083+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.frq" 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.fdx" 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.tii" 2011-10-25T23:59:59.085+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IFD [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: delete "_24u.nrm" 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: add merge to pendingMerges: _24v:C43396 [total 1 pending] 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: CMS: merge thread: do another merge _24v:C43396 into _24w [mergeDocStores] 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: now merge 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: merging _24v:C43396 into _24w [mergeDocStores] 2011-10-25T23:59:59.086+0000 DEBUG Lucene Merge Thread #0 org.apache.lucene.index.IndexWriter IW 15 [Tue Oct 25 23:59:59 UTC 2011; Lucene Merge Thread #0]: *merge: total 43396 docs* -- View this message in context: http://lucene.472066.n3.nabble.com/IndexWriter-loops-trying-to-merge-using-ConcurrentMergeScheduler-tp3455163p3455163.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional commands, e-mail: java-user-h...@lucene.apache.org