This one was a bit tricky, it is due to the Long cache that is maintained by the JVM for small values. The memory postings format uses Pair<Long, Pair<Long, Long>> as outputs, and these 3 longs per arc made the test fail since our manual RAM usage estimation would add up each of these longs that are stored in the root arcs although they are actually cached. I committed a fix.
On Thu, Jun 19, 2014 at 10:31 AM, Adrien Grand <[email protected]> wrote: > I'm digging. > > On Thu, Jun 19, 2014 at 9:47 AM, <[email protected]> wrote: >> Build: builds.flonkings.com/job/Lucene-4x-Linux-Java7-64-test-only/24232/ >> >> 1 tests failed. >> REGRESSION: org.apache.lucene.index.TestPostingsFormat.testRamBytesUsed >> >> Error Message: >> Actual RAM usage 7300, but got 5056, 30.739726027397264% error >> >> Stack Trace: >> java.lang.AssertionError: Actual RAM usage 7300, but got 5056, >> 30.739726027397264% error >> at >> __randomizedtesting.SeedInfo.seed([938578EBCDD641CE:61266AAB07A95E98]:0) >> at org.junit.Assert.fail(Assert.java:93) >> at org.junit.Assert.assertTrue(Assert.java:43) >> at >> org.apache.lucene.index.BaseIndexFileFormatTestCase.testRamBytesUsed(BaseIndexFileFormatTestCase.java:248) >> at >> org.apache.lucene.index.BasePostingsFormatTestCase.testRamBytesUsed(BasePostingsFormatTestCase.java:81) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) >> at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> at >> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >> at >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >> at >> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360) >> at java.lang.Thread.run(Thread.java:745) >> >> >> >> >> Build Log: >> [...truncated 1116 lines...] >> [junit4] Suite: org.apache.lucene.index.TestPostingsFormat >> [junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=TestPostingsFormat -Dtests.method=testRamBytesUsed >> -Dtests.seed=938578EBCDD641CE -Dtests.slow=true -Dtests.locale=fr_CA >> -Dtests.timezone=America/Mexico_City -Dtests.file.encoding=UTF-8 >> [junit4] FAILURE 4.15s J0 | TestPostingsFormat.testRamBytesUsed <<< >> [junit4] > Throwable #1: java.lang.AssertionError: Actual RAM usage >> 7300, but got 5056, 30.739726027397264% error >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([938578EBCDD641CE:61266AAB07A95E98]:0) >> [junit4] > at >> org.apache.lucene.index.BaseIndexFileFormatTestCase.testRamBytesUsed(BaseIndexFileFormatTestCase.java:248) >> [junit4] > at >> org.apache.lucene.index.BasePostingsFormatTestCase.testRamBytesUsed(BasePostingsFormatTestCase.java:81) >> [junit4] > at java.lang.Thread.run(Thread.java:745) >> [junit4] IGNOR/A 0.03s J0 | TestPostingsFormat.testMergeStability >> [junit4] > Assumption #1: The MockRandom PF randomizes content on the >> fly, so we can't check it >> [junit4] 2> NOTE: leaving temporary files on disk at: >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/build/core/test/J0/./lucene.index.TestPostingsFormat-938578EBCDD641CE-001 >> [junit4] 2> NOTE: test params are: codec=Lucene49: >> {oqnxms=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, >> sim=DefaultSimilarity, locale=fr_CA, timezone=America/Mexico_City >> [junit4] 2> NOTE: Linux 3.2.0-26-generic amd64/Oracle Corporation >> 1.7.0_55 (64-bit)/cpus=8,threads=1,free=152374032,total=301465600 >> [junit4] 2> NOTE: All tests run in this JVM: [TestFilterAtomicReader, >> TestFastDecompressionMode, TestRecyclingIntBlockAllocator, TestMathUtil, >> Before3, Before3, TestBackwardsCompatibility, TestIndexWriterOnJRECrash, >> TestNRTReaderWithThreads, TestSimpleExplanationsOfNonMatches, >> TestTermsEnum2, TestNewestSegment, TestSearcherManager, >> TestPayloadsOnVectors, TestLogMergePolicy, TestStressAdvance, TestDocument, >> TestLucene40PostingsFormat, TestFuzzyQuery, TestFieldCacheSanityChecker, >> TestPhrasePrefixQuery, TestFieldCacheRangeFilter, Test4GBStoredFields, >> TestRegexpRandom2, TestNumericDocValuesUpdates, TestImpersonation, >> NestedTeardownChain, NestedSetupChain, TestNumericRangeQuery64, >> TestDeletionPolicy, TestDuelingCodecs, TestCompoundFile, TestStressIndexing, >> TestMinimize, TestArrayUtil, TestDirectoryReader, TestBagOfPositions, >> TestDoubleBarrelLRUCache, TestPagedBytes, TestReuseDocsEnum, >> TestPostingsFormat] >> [junit4] Completed on J0 in 7.30s, 9 tests, 1 failure, 1 skipped <<< >> FAILURES! >> >> [...truncated 499 lines...] >> BUILD FAILED >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/build.xml:49: >> The following error occurred while executing this line: >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:1297: >> The following error occurred while executing this line: >> /var/lib/jenkins/workspace/Lucene-4x-Linux-Java7-64-test-only/checkout/lucene/common-build.xml:921: >> There were test failures: 413 suites, 3466 tests, 1 failure, 130 ignored >> (119 assumptions) >> >> Total time: 6 minutes 17 seconds >> Build step 'Invoke Ant' marked build as failure >> Recording test results >> Email was triggered for: Failure >> Sending email for trigger: Failure >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] > > > > -- > Adrien -- Adrien --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
