Re: [JENKINS] Lucene-Solr-4.x-Linux-Java6-64 - Build # 263 - Failure!
RateLimiter + Serial Merge Scheduler too it seems? Toning this thing down seems like a good idea because we also sometimes use ThrottledIndexOutput: i bet if you are unlucky to get both its really really slow. On Mon, Jun 25, 2012 at 8:08 AM, Uwe Schindler u...@thetaphi.de wrote: Hi, I killed that one after 3.5 hrs hanging in Kumoroji tests: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux-Java6-64/263/console - It looks like RateLimiter limited too much What should we do? Tone down the limiter generally or how can we prevent such slowness? Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Policeman Jenkins Server [mailto:jenk...@sd-datasolutions.de] Sent: Monday, June 25, 2012 2:05 PM To: dev@lucene.apache.org Subject: [JENKINS] Lucene-Solr-4.x-Linux-Java6-64 - Build # 263 - Failure! Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux-Java6- 64/263/ All tests passed Build Log: [...truncated 3928 lines...] [junit4] 2012-06-25 12:05:09 [junit4] Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode): [junit4] [junit4] Thread-4 prio=10 tid=0x7f6bfc0aa000 nid=0x4749 waiting on condition [0x7f6c08498000] [junit4] java.lang.Thread.State: TIMED_WAITING (sleeping) [junit4] at java.lang.Thread.sleep(Native Method) [junit4] at java.lang.Thread.sleep(Thread.java:302) [junit4] at org.apache.lucene.store.RateLimiter.pause(RateLimiter.java:83) [junit4] at org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutp utWrapper.java:82) [junit4] at org.apache.lucene.store.DataOutput.writeBytes(DataOutput.java:49) [junit4] at org.apache.lucene.store.RAMOutputStream.writeTo(RAMOutputStream.java:65 ) [junit4] at org.apache.lucene.codecs.BlockTermsWriter$TermsWriter.flushBlock(BlockTer msWriter.java:294) [junit4] at org.apache.lucene.codecs.BlockTermsWriter$TermsWriter.finishTerm(BlockTer msWriter.java:212) [junit4] at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:163) [junit4] at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:65) [junit4] at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:3 24) [junit4] at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:110) [junit4] at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3504) [junit4] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3139) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.j ava:37) [junit4] - locked 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:186) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:145) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(Base TokenStreamTestCase.java:562) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenSt reamTestCase.java:64) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(Bas eTokenStreamTestCase.java:421) [junit4] [junit4] Thread-3 prio=10 tid=0x7f6bfc0a8800 nid=0x4748 waiting for monitor entry [0x7f6c0859a000] [junit4] java.lang.Thread.State: BLOCKED (on object monitor) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.j ava:34) [junit4] - waiting to lock 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:186) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:145) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(Base TokenStreamTestCase.java:562) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenSt reamTestCase.java:64) [junit4
[JENKINS] Lucene-Solr-4.x-Linux-Java6-64 - Build # 263 - Failure!
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux-Java6-64/263/ All tests passed Build Log: [...truncated 3928 lines...] [junit4] 2012-06-25 12:05:09 [junit4] Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode): [junit4] [junit4] Thread-4 prio=10 tid=0x7f6bfc0aa000 nid=0x4749 waiting on condition [0x7f6c08498000] [junit4]java.lang.Thread.State: TIMED_WAITING (sleeping) [junit4] at java.lang.Thread.sleep(Native Method) [junit4] at java.lang.Thread.sleep(Thread.java:302) [junit4] at org.apache.lucene.store.RateLimiter.pause(RateLimiter.java:83) [junit4] at org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:82) [junit4] at org.apache.lucene.store.DataOutput.writeBytes(DataOutput.java:49) [junit4] at org.apache.lucene.store.RAMOutputStream.writeTo(RAMOutputStream.java:65) [junit4] at org.apache.lucene.codecs.BlockTermsWriter$TermsWriter.flushBlock(BlockTermsWriter.java:294) [junit4] at org.apache.lucene.codecs.BlockTermsWriter$TermsWriter.finishTerm(BlockTermsWriter.java:212) [junit4] at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:163) [junit4] at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:65) [junit4] at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:324) [junit4] at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:110) [junit4] at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3504) [junit4] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3139) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:37) [junit4] - locked 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:186) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:145) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:562) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenStreamTestCase.java:64) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:421) [junit4] [junit4] Thread-3 prio=10 tid=0x7f6bfc0a8800 nid=0x4748 waiting for monitor entry [0x7f6c0859a000] [junit4]java.lang.Thread.State: BLOCKED (on object monitor) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:34) [junit4] - waiting to lock 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:186) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:145) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:562) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenStreamTestCase.java:64) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:421) [junit4] [junit4] Thread-2 prio=10 tid=0x7f6bfc06a000 nid=0x4747 waiting for monitor entry [0x7f6c0869b000] [junit4]java.lang.Thread.State: BLOCKED (on object monitor) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:34) [junit4] - waiting to lock 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at
RE: [JENKINS] Lucene-Solr-4.x-Linux-Java6-64 - Build # 263 - Failure!
Hi, I killed that one after 3.5 hrs hanging in Kumoroji tests: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux-Java6-64/263/console - It looks like RateLimiter limited too much What should we do? Tone down the limiter generally or how can we prevent such slowness? Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Policeman Jenkins Server [mailto:jenk...@sd-datasolutions.de] Sent: Monday, June 25, 2012 2:05 PM To: dev@lucene.apache.org Subject: [JENKINS] Lucene-Solr-4.x-Linux-Java6-64 - Build # 263 - Failure! Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux-Java6- 64/263/ All tests passed Build Log: [...truncated 3928 lines...] [junit4] 2012-06-25 12:05:09 [junit4] Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.7-b02 mixed mode): [junit4] [junit4] Thread-4 prio=10 tid=0x7f6bfc0aa000 nid=0x4749 waiting on condition [0x7f6c08498000] [junit4]java.lang.Thread.State: TIMED_WAITING (sleeping) [junit4] at java.lang.Thread.sleep(Native Method) [junit4] at java.lang.Thread.sleep(Thread.java:302) [junit4] at org.apache.lucene.store.RateLimiter.pause(RateLimiter.java:83) [junit4] at org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutp utWrapper.java:82) [junit4] at org.apache.lucene.store.DataOutput.writeBytes(DataOutput.java:49) [junit4] at org.apache.lucene.store.RAMOutputStream.writeTo(RAMOutputStream.java:65 ) [junit4] at org.apache.lucene.codecs.BlockTermsWriter$TermsWriter.flushBlock(BlockTer msWriter.java:294) [junit4] at org.apache.lucene.codecs.BlockTermsWriter$TermsWriter.finishTerm(BlockTer msWriter.java:212) [junit4] at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:163) [junit4] at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:65) [junit4] at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:3 24) [junit4] at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:110) [junit4] at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3504) [junit4] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3139) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.j ava:37) [junit4] - locked 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:186) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:145) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(Base TokenStreamTestCase.java:562) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenSt reamTestCase.java:64) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(Bas eTokenStreamTestCase.java:421) [junit4] [junit4] Thread-3 prio=10 tid=0x7f6bfc0a8800 nid=0x4748 waiting for monitor entry [0x7f6c0859a000] [junit4]java.lang.Thread.State: BLOCKED (on object monitor) [junit4] at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.j ava:34) [junit4] - waiting to lock 0xe0601d98 (a org.apache.lucene.index.SerialMergeScheduler) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1703) [junit4] at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) [junit4] at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1344) [junit4] at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1084) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:186) [junit4] at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWrit er.java:145) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(Base TokenStreamTestCase.java:562) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenSt reamTestCase.java:64) [junit4] at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(Bas eTokenStreamTestCase.java:421) [junit4] [junit4] Thread-2 prio=10 tid=0x7f6bfc06a000 nid=0x4747 waiting for monitor entry [0x7f6c0869b000] [junit4]java.lang.Thread.State: BLOCKED (on object monitor) [junit4
