I committed a fix ... MockRandomMP was failing to take IW's buffered deletes into account, so it though the index was in fact optimized.
Mike McCandless http://blog.mikemccandless.com On Mon, Mar 16, 2015 at 10:13 AM, Robert Muir <rcm...@gmail.com> wrote: > It seems the test assumes after it does forceMerge(1), that it can > open a reader that has no deletes. but this is not the case. > > with its mockrandom mergepolicy, it ends out with a single-segment > index like this: > leaf: _ak(5.1.0):c5727/988:delGen=1 maxDoc=5727, deleted=988 > > On Mon, Mar 16, 2015 at 9:38 AM, Michael McCandless > <luc...@mikemccandless.com> wrote: >> Reproduces ... I'll dig. >> >> Mike McCandless >> >> http://blog.mikemccandless.com >> >> >> On Mon, Mar 16, 2015 at 8:40 AM, Apache Jenkins Server >> <jenk...@builds.apache.org> wrote: >>> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/788/ >>> >>> 1 tests failed. >>> REGRESSION: >>> org.apache.lucene.codecs.lucene49.TestLucene49NormsFormat.testUndeadNorms >>> >>> Error Message: >>> expected:<0> but was:<121> >>> >>> Stack Trace: >>> java.lang.AssertionError: expected:<0> but was:<121> >>> at >>> __randomizedtesting.SeedInfo.seed([A05EC27B0D94C2A8:AD8B8616D87AD314]:0) >>> at org.junit.Assert.fail(Assert.java:93) >>> at org.junit.Assert.failNotEquals(Assert.java:647) >>> at org.junit.Assert.assertEquals(Assert.java:128) >>> at org.junit.Assert.assertEquals(Assert.java:472) >>> at org.junit.Assert.assertEquals(Assert.java:456) >>> at >>> org.apache.lucene.index.BaseNormsFormatTestCase.testUndeadNorms(BaseNormsFormatTestCase.java:397) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886) >>> at >>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >>> at >>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >>> at >>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) >>> at >>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >>> at >>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781) >>> at >>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792) >>> at >>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) >>> at >>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >>> at >>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54) >>> at >>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >>> at >>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >>> at >>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) >>> at >>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >>> at >>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) >>> at java.lang.Thread.run(Thread.java:745) >>> >>> >>> >>> >>> Build Log: >>> [...truncated 4911 lines...] >>> [junit4] Suite: org.apache.lucene.codecs.lucene49.TestLucene49NormsFormat >>> [junit4] 2> NOTE: download the large Jenkins line-docs file by running >>> 'ant get-jenkins-line-docs' in the lucene directory. >>> [junit4] 2> NOTE: reproduce with: ant test >>> -Dtestcase=TestLucene49NormsFormat -Dtests.method=testUndeadNorms >>> -Dtests.seed=A05EC27B0D94C2A8 -Dtests.multiplier=2 -Dtests.nightly=true >>> -Dtests.slow=true >>> -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt >>> -Dtests.locale=pl -Dtests.timezone=Europe/Riga -Dtests.asserts=true >>> -Dtests.file.encoding=US-ASCII >>> [junit4] FAILURE 1.85s J1 | TestLucene49NormsFormat.testUndeadNorms <<< >>> [junit4] > Throwable #1: java.lang.AssertionError: expected:<0> but >>> was:<121> >>> [junit4] > at >>> __randomizedtesting.SeedInfo.seed([A05EC27B0D94C2A8:AD8B8616D87AD314]:0) >>> [junit4] > at >>> org.apache.lucene.index.BaseNormsFormatTestCase.testUndeadNorms(BaseNormsFormatTestCase.java:397) >>> [junit4] > at java.lang.Thread.run(Thread.java:745) >>> [junit4] IGNOR/A 0.01s J1 | TestLucene49NormsFormat.testMergeStability >>> [junit4] > Assumption #1: The MockRandom PF randomizes content on the >>> fly, so we can't check it >>> [junit4] 2> NOTE: leaving temporary files on disk at: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/backward-codecs/test/J1/temp/lucene.codecs.lucene49.TestLucene49NormsFormat >>> A05EC27B0D94C2A8-001 >>> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50), >>> sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {content=DFR >>> GB1, foobar=DFR G3(800.0)}, locale=pl, timezone=Europe/Riga >>> [junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation >>> 1.7.0_65 (64-bit)/cpus=16,threads=1,free=311078728,total=472383488 >>> [junit4] 2> NOTE: All tests run in this JVM: >>> [TestDocValuesUpdatesOnOldSegments, TestLucene42NormsFormat, >>> TestLucene40BlockFormat, TestBackwardsCompatibility, TestBitVector, >>> TestLucene40StoredFieldsFormat, TestLucene41PostingsFormat3, >>> TestLucene41StoredFieldsFormat, TestLucene49NormsFormat] >>> [junit4] Completed on J1 in 262.45s, 17 tests, 1 failure, 1 skipped <<< >>> FAILURES! >>> >>> [...truncated 27 lines...] >>> BUILD FAILED >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:536: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:477: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build.xml:456: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:2166: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/module-build.xml:58: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1370: >>> The following error occurred while executing this line: >>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:976: >>> There were test failures: 29 suites, 689 tests, 1 failure, 74 ignored (74 >>> assumptions) >>> >>> Total time: 94 minutes 49 seconds >>> Build step 'Invoke Ant' marked build as failure >>> Archiving artifacts >>> Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716 >>> Archived 5 artifacts >>> Archive block size is 32768 >>> Received 0 blocks and 1412631 bytes >>> Compression is 0.0% >>> Took 0.65 sec >>> Recording test results >>> Email was triggered for: Failure >>> Sending email for trigger: Failure >>> >>> >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >>> For additional commands, e-mail: dev-h...@lucene.apache.org >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org >> For additional commands, e-mail: dev-h...@lucene.apache.org >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
