I think because this test uses so much RAM in its "fake index", it should not use RAMDirectory. Ill change it over to using newFSDirectory for now and hopefully it stops these OOMs
Separately maybe Mike can take a look to see if it could be a little more RAM efficient. The tests internal datastructures take 100+MB sometimes! On Thu, Jul 26, 2012 at 2:26 AM, Apache Jenkins Server <[email protected]> wrote: > Build: https://builds.apache.org/job/Lucene-Solr-tests-only-trunk/14944/ > > 1 tests failed. > REGRESSION: org.apache.lucene.index.TestPostingsFormat.test > > Error Message: > Java heap space > > Stack Trace: > java.lang.OutOfMemoryError: Java heap space > at > __randomizedtesting.SeedInfo.seed([C8523F9DB2B1447:84D11C2375D779BF]:0) > at org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:73) > at org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:46) > at > org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:152) > at > org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:138) > at > org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:123) > at > org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:73) > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:42) > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:33) > at > org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.write(SimpleTextFieldsWriter.java:54) > at > org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.access$200(SimpleTextFieldsWriter.java:33) > at > org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter$SimpleTextPostingsWriter.startDoc(SimpleTextFieldsWriter.java:128) > at > org.apache.lucene.index.TestPostingsFormat.buildIndex(TestPostingsFormat.java:419) > at > org.apache.lucene.index.TestPostingsFormat.test(TestPostingsFormat.java:877) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891) > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > > > > > Build Log: > [...truncated 591 lines...] > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestSizeBoundedForceMerge > [junit4:junit4] Completed on J0 in 0.10s, 11 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestSloppyPhraseQuery2 > [junit4:junit4] Completed on J0 in 1.66s, 9 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestConstantScoreQuery > [junit4:junit4] Completed on J0 in 0.04s, 3 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestFieldInfos > [junit4:junit4] Completed on J0 in 0.01s, 2 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.store.TestWindowsMMap > [junit4:junit4] Completed on J0 in 0.38s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.util.automaton.TestDeterminism > [junit4:junit4] Completed on J0 in 0.97s, 2 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.codecs.lucene40.TestBitVector > [junit4:junit4] Completed on J0 in 0.92s, 9 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestStressIndexing2 > [junit4:junit4] Completed on J0 in 1.23s, 3 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.util.TestSmallFloat > [junit4:junit4] Completed on J0 in 0.15s, 2 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestDocValuesIndexing > [junit4:junit4] Completed on J0 in 0.96s, 14 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.util.TestVersion > [junit4:junit4] Completed on J0 in 0.01s, 2 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestDocBoost > [junit4:junit4] Completed on J0 in 0.02s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestNot > [junit4:junit4] Completed on J0 in 0.04s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.util.TestNumericUtils > [junit4:junit4] Completed on J0 in 2.06s, 12 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestMixedCodecs > [junit4:junit4] Completed on J0 in 4.59s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestAtomicUpdate > [junit4:junit4] Completed on J0 in 3.98s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestMultiPhraseQuery > [junit4:junit4] IGNORED 0.00s J0 | > TestMultiPhraseQuery.testMultiSloppyWithRepeats > [junit4:junit4] > Cause: Annotated @Ignore() > [junit4:junit4] Completed on J0 in 0.26s, 16 tests, 1 skipped > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestOmitNorms > [junit4:junit4] Completed on J0 in 0.45s, 5 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.spans.TestSpanFirstQuery > [junit4:junit4] Completed on J0 in 0.01s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.util.automaton.TestSpecialOperations > [junit4:junit4] Completed on J0 in 0.20s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.TestSearch > [junit4:junit4] Completed on J0 in 0.02s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: > org.apache.lucene.util.automaton.TestLevenshteinAutomata > [junit4:junit4] Completed on J0 in 0.81s, 4 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestFieldCacheTermsFilter > [junit4:junit4] Completed on J0 in 0.04s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.codecs.pulsing.TestPulsingReuse > [junit4:junit4] Completed on J0 in 0.03s, 2 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.store.TestBufferedIndexInput > [junit4:junit4] Completed on J0 in 1.96s, 4 tests > [junit4:junit4] > [junit4:junit4] Suite: > org.apache.lucene.util.junitcompat.TestSetupTeardownChaining > [junit4:junit4] Completed on J0 in 0.03s, 2 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestTopDocsCollector > [junit4:junit4] Completed on J0 in 0.06s, 8 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestCrashCausesCorruptIndex > [junit4:junit4] Completed on J0 in 0.14s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestDocumentWriter > [junit4:junit4] Completed on J0 in 0.13s, 7 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestIndexWriterWithThreads > [junit4:junit4] Completed on J0 in 24.43s, 12 tests > [junit4:junit4] > [junit4:junit4] HEARTBEAT J1: 2012-07-26T06:22:58, no events in: 68.1s, > approx. at: TestPostingsFormat.test > [junit4:junit4] Suite: org.apache.lucene.analysis.TestGraphTokenizers > [junit4:junit4] Completed on J0 in 26.73s, 8 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestShardSearching > [junit4:junit4] Completed on J0 in 11.69s, 1 test > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestNumericRangeQuery64 > [junit4:junit4] Completed on J0 in 9.27s, 34 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.search.TestSearcherManager > [junit4:junit4] Completed on J0 in 10.70s, 6 tests > [junit4:junit4] > [junit4:junit4] Suite: org.apache.lucene.index.TestPostingsFormat > [junit4:junit4] ERROR 118s J1 | TestPostingsFormat.test > [junit4:junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space > [junit4:junit4] > at > __randomizedtesting.SeedInfo.seed([C8523F9DB2B1447:84D11C2375D779BF]:0) > [junit4:junit4] > at > org.apache.lucene.store.RAMFile.newBuffer(RAMFile.java:73) > [junit4:junit4] > at > org.apache.lucene.store.RAMFile.addBuffer(RAMFile.java:46) > [junit4:junit4] > at > org.apache.lucene.store.RAMOutputStream.switchCurrentBuffer(RAMOutputStream.java:152) > [junit4:junit4] > at > org.apache.lucene.store.RAMOutputStream.writeBytes(RAMOutputStream.java:138) > [junit4:junit4] > at > org.apache.lucene.store.MockIndexOutputWrapper.writeBytes(MockIndexOutputWrapper.java:123) > [junit4:junit4] > at > org.apache.lucene.store.MockIndexOutputWrapper.writeByte(MockIndexOutputWrapper.java:73) > [junit4:junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:42) > [junit4:junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextUtil.write(SimpleTextUtil.java:33) > [junit4:junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.write(SimpleTextFieldsWriter.java:54) > [junit4:junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter.access$200(SimpleTextFieldsWriter.java:33) > [junit4:junit4] > at > org.apache.lucene.codecs.simpletext.SimpleTextFieldsWriter$SimpleTextPostingsWriter.startDoc(SimpleTextFieldsWriter.java:128) > [junit4:junit4] > at > org.apache.lucene.index.TestPostingsFormat.buildIndex(TestPostingsFormat.java:419) > [junit4:junit4] > at > org.apache.lucene.index.TestPostingsFormat.test(TestPostingsFormat.java:877) > [junit4:junit4] > at > sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > [junit4:junit4] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > [junit4:junit4] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > [junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891) > [junit4:junit4] > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > [junit4:junit4] > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) > [junit4:junit4] > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > [junit4:junit4] > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > [junit4:junit4] > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > [junit4:junit4] > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) > [junit4:junit4] > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825) > [junit4:junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > [junit4:junit4] > > [junit4:junit4] 2> NOTE: reproduce with: ant test > -Dtestcase=TestPostingsFormat -Dtests.method=test > -Dtests.seed=C8523F9DB2B1447 -Dtests.multiplier=3 -Dtests.slow=true > -Dtests.locale=ar_TN -Dtests.timezone=Antarctica/Davis > -Dtests.file.encoding=UTF-8 > [junit4:junit4] 2> > [junit4:junit4] > (@AfterClass output) > [junit4:junit4] 2> NOTE: test params are: codec=SimpleText, > sim=DefaultSimilarity, locale=ar_TN, timezone=Antarctica/Davis > [junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. > 1.6.0_32 (64-bit)/cpus=16,threads=1,free=3453200,total=420544512 > [junit4:junit4] 2> NOTE: All tests run in this JVM: [Test10KPulsings, > TestStressAdvance, TestDocIdSet, TestMultiTermQueryRewrites, > TestCollectionUtil, TestAutomatonQuery, TestIdentityHashSet, > TestNoMergeScheduler, TestTopScoreDocCollector, TestNeverDelete, > TestHugeRamFile, TestPerFieldPostingsFormat, TestSegmentTermEnum, > TestCharTermAttributeImpl, TestDateTools, TestTermVectorsWriter, > TestNoMergePolicy, TestReuseDocsEnum, TestWildcard, TestSpansAdvanced, > TestIntsRef, TestNamedSPILoader, TestSimpleSearchEquivalence, TestDoc, > TestLockFactory, TestTopDocsMerge, TestBoolean2, TestNumericTokenStream, > TestBytesRefHash, TestBooleanQuery, TestMergeSchedulerExternal, TestPayloads, > TestStressIndexing, TestDocsAndPositions, TestSameTokenSamePosition, > TestSimilarity, TestPhrasePrefixQuery, TestPayloadSpans, > TestSpanMultiTermQueryWrapper, TestIndexWriterMergePolicy, TestBinaryTerms, > TestForceMergeForever, TestPrefixFilter, TestMultiLevelSkipList, > TestMultiValuedNumericRangeQuery, TestIndexWriterConfig, TestIntBlockCodec, > TestPackedInts, TestSimilarity2, TestDocumentsWriterStallControl, > TestPostingsFormat] > [junit4:junit4] 2> > [junit4:junit4] Completed on J1 in 125.08s, 1 test, 1 error <<< FAILURES! > [...truncated 552 lines...] > > [...truncated 1294 lines...] > > [...truncated 1294 lines...] > > [...truncated 1294 lines...] > > [...truncated 1294 lines...] > > [...truncated 1280 lines...] > BUILD FAILED > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/build.xml:29: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/build.xml:50: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/common-build.xml:1094: > The following error occurred while executing this line: > /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-tests-only-trunk/checkout/lucene/common-build.xml:789: > There were test failures: 305 suites, 1721 tests, 1 error, 14 ignored (12 > assumptions) > > Total time: 6 minutes 23 seconds > Build step 'Execute shell' marked build as failure > Archiving artifacts > Recording test results > Publishing Clover coverage report... > No Clover report will be published due to a Build Failure > Email was triggered for: Failure > Sending email for trigger: Failure > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] -- lucidimagination.com --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
