OK this is because of the maxShingleSize=42: this is a bit too large :) Combined with LTC randomly changing IWC to flush by doc count not RAM, where the docs turn out to be immense.
I think we can safely ignore it. Mike McCandless http://blog.mikemccandless.com On Sat, Nov 8, 2014 at 4:52 AM, Michael McCandless <[email protected]> wrote: > I'm digging on this. > > Mike McCandless > > http://blog.mikemccandless.com > > > On Fri, Nov 7, 2014 at 12:32 PM, Policeman Jenkins Server > <[email protected]> wrote: >> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11581/ >> Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: >> true) >> >> 1 tests failed. >> REGRESSION: >> org.apache.lucene.analysis.core.TestRandomChains.testRandomChains >> >> Error Message: >> Java heap space >> >> Stack Trace: >> java.lang.OutOfMemoryError: Java heap space >> at >> __randomizedtesting.SeedInfo.seed([C5B1685441CA7475:F850413506D869B5]:0) >> at java.util.Arrays.copyOf(Arrays.java:2219) >> at java.util.ArrayList.grow(ArrayList.java:242) >> at java.util.ArrayList.ensureExplicitCapacity(ArrayList.java:216) >> at java.util.ArrayList.ensureCapacityInternal(ArrayList.java:208) >> at java.util.ArrayList.add(ArrayList.java:440) >> at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:708) >> at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:614) >> at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:512) >> at >> org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:911) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) >> at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> at >> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> at >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) >> at >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) >> at >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> at >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) >> at >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) >> at >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) >> at >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) >> >> >> >> >> Build Log: >> [...truncated 5671 lines...] >> [junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains >> [junit4] 2> TEST FAIL: useCharFilter=true text='iazione, per avere l' >> [junit4] 2> Exception from random analyzer: >> [junit4] 2> charfilters= >> [junit4] 2> >> org.apache.lucene.analysis.pattern.PatternReplaceCharFilter(a, >> <ACRONYM_DEP>, java.io.StringReader@7f9422df) >> [junit4] 2> tokenizer= >> [junit4] 2> >> org.apache.lucene.analysis.ngram.NGramTokenizer(org.apache.lucene.util.AttributeFactory$1@615f1014, >> 8, 24) >> [junit4] 2> filters= >> [junit4] 2> >> org.apache.lucene.analysis.es.SpanishLightStemFilter(ValidatingTokenFilter@481ebffc >> >> term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false) >> [junit4] 2> >> org.apache.lucene.analysis.util.ElisionFilter(ValidatingTokenFilter@229660da >> term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false, >> [x, clzpifvs, weh, iimrekiuz, xbqs, ptdzhpgxh, ]) >> [junit4] 2> >> org.apache.lucene.analysis.miscellaneous.ASCIIFoldingFilter(ValidatingTokenFilter@3c4b40ac >> >> term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false, >> true) >> [junit4] 2> >> org.apache.lucene.analysis.shingle.ShingleFilter(ValidatingTokenFilter@27352b95 >> >> term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false, >> 42) >> [junit4] 2> offsetsAreCorrect=true >> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRandomChains >> -Dtests.method=testRandomChains -Dtests.seed=C5B1685441CA7475 >> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=iw >> -Dtests.timezone=Atlantic/Madeira -Dtests.asserts=true >> -Dtests.file.encoding=US-ASCII >> [junit4] ERROR 70.7s J1 | TestRandomChains.testRandomChains <<< >> [junit4] > Throwable #1: java.lang.OutOfMemoryError: Java heap space >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([C5B1685441CA7475:F850413506D869B5]:0) >> [junit4] > at java.util.Arrays.copyOf(Arrays.java:2219) >> [junit4] > at java.util.ArrayList.grow(ArrayList.java:242) >> [junit4] > at >> java.util.ArrayList.ensureExplicitCapacity(ArrayList.java:216) >> [junit4] > at >> java.util.ArrayList.ensureCapacityInternal(ArrayList.java:208) >> [junit4] > at java.util.ArrayList.add(ArrayList.java:440) >> [junit4] > at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:708) >> [junit4] > at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:614) >> [junit4] > at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:512) >> [junit4] > at >> org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:911) >> [junit4] 2> NOTE: leaving temporary files on disk at: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/common/test/J1/temp/lucene.analysis.core.TestRandomChains-C5B1685441CA7475-001 >> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): >> {dummy=PostingsFormat(name=Direct)}, docValues:{}, >> sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {dummy=IB >> LL-LZ(0.3)}, locale=iw, timezone=Atlantic/Madeira >> [junit4] 2> NOTE: Linux 3.13.0-39-generic amd64/Oracle Corporation >> 1.7.0_67 (64-bit)/cpus=8,threads=1,free=443073304,total=518979584 >> [junit4] 2> NOTE: All tests run in this JVM: [TestReverseStringFilter, >> TestIndicNormalizer, TestSpaces, TestCatalanAnalyzer, TestAnalyzers, >> TestClassicAnalyzer, TestStemmerOverrideFilter, TestCharArrayMap, >> TestGalicianAnalyzer, TestLatvianStemFilterFactory, >> TestLimitTokenCountFilterFactory, GreekAnalyzerTest, >> TestUAX29URLEmailAnalyzer, TestPatternReplaceFilterFactory, >> TestStemmerOverrideFilterFactory, TestLatvianAnalyzer, >> TestPatternReplaceFilter, TestSoraniStemFilterFactory, >> TestFrenchMinimalStemFilter, TestASCIIFoldingFilter, >> TestGalicianStemFilterFactory, TestHindiNormalizer, TestNGramFilters, >> DateRecognizerSinkTokenizerTest, TestDanishAnalyzer, TestHindiAnalyzer, >> TestIndonesianAnalyzer, TestScandinavianNormalizationFilterFactory, >> TestIrishLowerCaseFilter, TestCommonGramsFilterFactory, >> TestLimitTokenPositionFilter, TestMorphAlias, TestMorphData, >> TestCollationDocValuesField, TestIgnore, TestNorwegianMinimalStemFilter, >> TestTurkishLowerCaseFilterFactory, TokenOffsetPayloadTokenFilterTest, >> TestSnowballPorterFilterFactory, TestRollingCharBuffer, TestCircumfix, >> TestSoraniNormalizationFilter, CommonGramsFilterTest, >> TestFrenchLightStemFilter, TestElisionFilterFactory, TestStandardFactories, >> TestGermanAnalyzer, TestEmptyTokenStream, TestHyphenatedWordsFilter, >> TestSpanishLightStemFilterFactory, TestKStemFilterFactory, >> TestPersianNormalizationFilter, TestKeywordRepeatFilter, >> TestStrangeOvergeneration, TestCzechStemFilterFactory, >> TokenRangeSinkTokenizerTest, TestHindiStemmer, TestEnglishAnalyzer, >> TestTeeSinkTokenFilter, TestCJKWidthFilter, TestTruncateTokenFilter, >> TestCaseSensitive, TestSnowball, TestTurkishLowerCaseFilter, >> TestPatternReplaceCharFilterFactory, TestGermanLightStemFilterFactory, >> TestMultiWordSynonyms, TestRandomChains] >> [junit4] Completed on J1 in 109.96s, 2 tests, 1 error <<< FAILURES! >> >> [...truncated 367 lines...] >> [junit4] JVM J1: stdout was not empty, see: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20141107_172909_727.sysout >> [junit4] >>> JVM J1: stdout (verbatim) ---- >> [junit4] java.lang.OutOfMemoryError: Java heap space >> [junit4] Dumping heap to >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/heapdumps/java_pid2872.hprof >> ... >> [junit4] Heap dump file created [523653577 bytes in 1.878 secs] >> [junit4] <<< JVM J1: EOF ---- >> >> [...truncated 9 lines...] >> BUILD FAILED >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:525: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:473: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:452: The >> following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:2140: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/analysis/build.xml:106: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/analysis/build.xml:38: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:58: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1358: >> The following error occurred while executing this line: >> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:965: >> There were test failures: 266 suites, 1347 tests, 1 error, 1 ignored >> >> Total time: 27 minutes 54 seconds >> Build step 'Invoke Ant' marked build as failure >> [description-setter] Description set: Java: 64bit/jdk1.7.0_67 >> -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true) >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure - Any >> Sending email for trigger: Failure - Any >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
