I committed a fix .. this was a fun one: SimpleText had a bug where if you indexed a SORTED doc value with the string value "END", its checkIntegrity got confused and falsely detected corruption.
It just took our random tests this long to index the string "END" ... Soon we will be indexing the full works of Shakespeare... Mike McCandless http://blog.mikemccandless.com On Sat, Feb 28, 2015 at 7:28 AM, Policeman Jenkins Server <[email protected]> wrote: > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11897/ > Java: 32bit/jdk1.8.0_40-ea-b22 -server -XX:+UseConcMarkSweepGC > > 1 tests failed. > FAILED: > org.apache.lucene.codecs.simpletext.TestSimpleTextDocValuesFormat.testSortedFixedLengthVsStoredFields > > Error Message: > SimpleText failure: expected checksum line but got length 3 > (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat))) > > Stack Trace: > org.apache.lucene.index.CorruptIndexException: SimpleText failure: expected > checksum line but got length 3 > (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat))) > at > __randomizedtesting.SeedInfo.seed([4879A5F99AD2035B:A4FCD66955DBA1EC]:0) > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.checkFooter(SimpleTextUtil.java:90) > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesReader.checkIntegrity(SimpleTextDocValuesReader.java:527) > at > org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135) > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:143) > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105) > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3928) > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3509) > at > org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40) > at > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1798) > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2733) > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2838) > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2805) > at > org.apache.lucene.index.RandomIndexWriter.commit(RandomIndexWriter.java:252) > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.doTestSortedVsStoredFields(BaseDocValuesFormatTestCase.java:1448) > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.testSortedFixedLengthVsStoredFields(BaseDocValuesFormatTestCase.java:1493) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:497) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > at > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) > at java.lang.Thread.run(Thread.java:745) > Suppressed: java.lang.AssertionError > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesWriter.close(SimpleTextDocValuesWriter.java:441) > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:144) > ... 48 more > > > > > Build Log: > [...truncated 5611 lines...] > [junit4] Suite: > org.apache.lucene.codecs.simpletext.TestSimpleTextDocValuesFormat > [junit4] 2> NOTE: reproduce with: ant test > -Dtestcase=TestSimpleTextDocValuesFormat > -Dtests.method=testSortedFixedLengthVsStoredFields > -Dtests.seed=4879A5F99AD2035B -Dtests.multiplier=3 -Dtests.slow=true > -Dtests.locale=et -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true > -Dtests.file.encoding=UTF-8 > [junit4] ERROR 1.68s J1 | > TestSimpleTextDocValuesFormat.testSortedFixedLengthVsStoredFields <<< > [junit4] > Throwable #1: org.apache.lucene.index.CorruptIndexException: > SimpleText failure: expected checksum line but got length 3 > (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat))) > [junit4] > at > __randomizedtesting.SeedInfo.seed([4879A5F99AD2035B:A4FCD66955DBA1EC]:0) > [junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.checkFooter(SimpleTextUtil.java:90) > [junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesReader.checkIntegrity(SimpleTextDocValuesReader.java:527) > [junit4] > at > org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135) > [junit4] > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:143) > [junit4] > at > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105) > [junit4] > at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3928) > [junit4] > at > org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3509) > [junit4] > at > org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40) > [junit4] > at > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1798) > [junit4] > at > org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2733) > [junit4] > at > org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2838) > [junit4] > at > org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2805) > [junit4] > at > org.apache.lucene.index.RandomIndexWriter.commit(RandomIndexWriter.java:252) > [junit4] > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.doTestSortedVsStoredFields(BaseDocValuesFormatTestCase.java:1448) > [junit4] > at > org.apache.lucene.index.BaseDocValuesFormatTestCase.testSortedFixedLengthVsStoredFields(BaseDocValuesFormatTestCase.java:1493) > [junit4] > at java.lang.Thread.run(Thread.java:745) > [junit4] > Suppressed: java.lang.AssertionError > [junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextDocValuesWriter.close(SimpleTextDocValuesWriter.java:441) > [junit4] > at > org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:144) > [junit4] > ... 48 more > [junit4] 2> NOTE: leaving temporary files on disk at: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/test/J1/temp/lucene.codecs.simpletext.TestSimpleTextDocValuesFormat > 4879A5F99AD2035B-001 > [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, > docValues:{}, sim=DefaultSimilarity, locale=et, timezone=Africa/Addis_Ababa > [junit4] 2> NOTE: Linux 3.13.0-45-generic i386/Oracle Corporation > 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=27185056,total=64880640 > [junit4] 2> NOTE: All tests run in this JVM: > [TestSimpleTextFieldInfoFormat, TestVarGapDocFreqIntervalPostingsFormat, > TestSimpleTextNormsFormat, TestBloomPostingsFormat, > TestSimpleTextPostingsFormat, TestSimpleTextDocValuesFormat] > [junit4] Completed on J1 in 57.94s, 84 tests, 1 error <<< FAILURES! > > [...truncated 50 lines...] > BUILD FAILED > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The > following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The > following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The > following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The > following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:456: The > following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:2081: > The following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:58: > The following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1351: > The following error occurred while executing this line: > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:958: > There were test failures: 19 suites, 501 tests, 1 error, 19 ignored (19 > assumptions) > > Total time: 27 minutes 47 seconds > Build step 'Invoke Ant' marked build as failure > [description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b22 -server > -XX:+UseConcMarkSweepGC > Archiving artifacts > Recording test results > Email was triggered for: Failure - Any > Sending email for trigger: Failure - Any > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
