This is a new test i added yesterday that passes huge strings to TestRandomChains.
The OOM is because: [junit4] 2> tokenizer= [junit4] 2> org.apache.lucene.analysis.ngram.NGramTokenizer(LUCENE_50, 20, 68) I'll shorten the length of the strings we use in this test. On Wed, Mar 19, 2014 at 4:40 AM, <[email protected]> wrote: > Build: builds.flonkings.com/job/Lucene-trunk-Linux-java7-64-analyzers/62/ > > 1 tests failed. > REGRESSION: > org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings > > Error Message: > Java heap space > > Stack Trace: > java.lang.OutOfMemoryError: Java heap space > at > __randomizedtesting.SeedInfo.seed([8B587EAF1B1924E2:E103C1BE42570411]:0) > at java.util.Arrays.copyOfRange(Arrays.java:2694) > at java.lang.String.<init>(String.java:203) > at > org.apache.lucene.analysis.tokenattributes.CharTermAttributeImpl.toString(CharTermAttributeImpl.java:267) > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:696) > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:605) > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:506) > at > org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings(TestRandomChains.java:923) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876) > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) > at > org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783) > at > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) > > > > > Build Log: > [...truncated 679 lines...] > [junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains > [junit4] 2> TEST FAIL: useCharFilter=true text='udjvij jvmnqembqwru lezr > ezgrcxud ;;\n1610431719< \ud83c\ude59\ud83c\udef1 > \udb40\udc3b\udb40\udc58\udb40\udc04\udb40\udc5a\udb40\udc65 > \ua964\ua962\ua97b\ua96b\ua962 [)tl{0,5} jmdgw hmwuwfiyr cgpkxvyosff dkjbbcw > \u0620\udb17\udd39\u024a\ud0a4 dcs' > [junit4] 2> Exception from random analyzer: > [junit4] 2> charfilters= > [junit4] 2> tokenizer= > [junit4] 2> org.apache.lucene.analysis.ngram.NGramTokenizer(LUCENE_50, > 20, 68) > [junit4] 2> filters= > [junit4] 2> > org.apache.lucene.analysis.tr.TurkishLowerCaseFilter(ValidatingTokenFilter@5bf2a40a > > term=,bytes=[],positionIncrement=1,positionLength=1,startOffset=0,endOffset=0) > [junit4] 2> > org.apache.lucene.analysis.pt.PortugueseStemFilter(ValidatingTokenFilter@550ae9ec > > term=,bytes=[],positionIncrement=1,positionLength=1,startOffset=0,endOffset=0,keyword=false) > [junit4] 2> > org.apache.lucene.analysis.shingle.ShingleFilter(ValidatingTokenFilter@5ebd61d1 > > term=,bytes=[],positionIncrement=1,positionLength=1,startOffset=0,endOffset=0,keyword=false,type=word, > 84, 100) > [junit4] 2> > org.apache.lucene.analysis.fa.PersianNormalizationFilter(ValidatingTokenFilter@799eac3a > > term=,bytes=[],positionIncrement=1,positionLength=1,startOffset=0,endOffset=0,keyword=false,type=word) > [junit4] 2> offsetsAreCorrect=true > [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRandomChains > -Dtests.method=testRandomChainsWithLargeStrings -Dtests.seed=8B587EAF1B1924E2 > -Dtests.slow=true -Dtests.locale=mt -Dtests.timezone=NET > -Dtests.file.encoding=UTF-8 > [junit4] ERROR 24.3s J2 | > TestRandomChains.testRandomChainsWithLargeStrings <<< > [junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space > [junit4] > at > __randomizedtesting.SeedInfo.seed([8B587EAF1B1924E2:E103C1BE42570411]:0) > [junit4] > at java.util.Arrays.copyOfRange(Arrays.java:2694) > [junit4] > at java.lang.String.<init>(String.java:203) > [junit4] > at > org.apache.lucene.analysis.tokenattributes.CharTermAttributeImpl.toString(CharTermAttributeImpl.java:267) > [junit4] > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:696) > [junit4] > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:605) > [junit4] > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:506) > [junit4] > at > org.apache.lucene.analysis.core.TestRandomChains.testRandomChainsWithLargeStrings(TestRandomChains.java:923) > [junit4] 2> NOTE: test params are: codec=Lucene45, > sim=DefaultSimilarity, locale=mt, timezone=NET > [junit4] 2> NOTE: Linux 3.2.0-26-generic amd64/Oracle Corporation > 1.7.0_25 (64-bit)/cpus=8,threads=1,free=271110664,total=303824896 > [junit4] 2> NOTE: All tests run in this JVM: [EdgeNGramTokenFilterTest, > TestPrefixAwareTokenFilter, TestLengthFilterFactory, > TestCommonGramsQueryFilterFactory, TestIndonesianStemFilterFactory, > TestStopFilter, TestBasqueAnalyzer, TestMultiWordSynonyms, > TestHyphenationCompoundWordTokenFilterFactory, TestRandomChains] > [junit4] Completed on J2 in 62.61s, 2 tests, 1 error <<< FAILURES! > > [...truncated 370 lines...] > BUILD FAILED > /var/lib/jenkins/workspace/Lucene-trunk-Linux-java7-64-analyzers/checkout/lucene/module-build.xml:60: > The following error occurred while executing this line: > /var/lib/jenkins/workspace/Lucene-trunk-Linux-java7-64-analyzers/checkout/lucene/common-build.xml:1275: > The following error occurred while executing this line: > /var/lib/jenkins/workspace/Lucene-trunk-Linux-java7-64-analyzers/checkout/lucene/common-build.xml:907: > There were test failures: 247 suites, 1316 tests, 1 error, 1 ignored > > Total time: 2 minutes 31 seconds > Build step 'Invoke Ant' marked build as failure > Recording test results > Email was triggered for: Failure > Sending email for trigger: Failure > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
