This is another instance of https://issues.apache.org/jira/browse/LUCENE-4065 (it passes false to enablePositionIncrements).
I'll disable offsets checking for now for this filter. On Fri, Jun 15, 2012 at 6:47 AM, <[email protected]> wrote: > Build: > http://jenkins.sd-datasolutions.de/job/Lucene-Solr-4.x-Linux-Java6-64/127/ > > 1 tests failed. > REGRESSION: org.apache.lucene.analysis.core.TestRandomChains.testRandomChains > > Error Message: > stage 2: inconsistent startOffset at pos=0: 0 vs 7; token=w hch > > Stack Trace: > java.lang.IllegalStateException: stage 2: inconsistent startOffset at pos=0: > 0 vs 7; token=w hch > at > __randomizedtesting.SeedInfo.seed([47E517F18498EF9F:7A043E90C38AF25F]:0) > at > org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:119) > at > org.apache.lucene.analysis.cjk.CJKWidthFilter.incrementToken(CJKWidthFilter.java:62) > at > org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:78) > at > org.apache.lucene.analysis.hu.HungarianLightStemFilter.incrementToken(HungarianLightStemFilter.java:48) > at > org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:78) > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:640) > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:550) > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:446) > at > org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:858) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1969) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:814) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:875) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:889) > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:821) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > at > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) > at > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) > at > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) > > > > > Build Log: > [...truncated 4653 lines...] > [junit4] Completed on J1 in 20.68s, 6 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.fi.TestFinnishAnalyzer > [junit4] Completed on J0 in 1.74s, 4 tests > [junit4] > [junit4] Suite: > org.apache.lucene.analysis.miscellaneous.TestRemoveDuplicatesTokenFilter > [junit4] Completed on J0 in 9.54s, 5 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.pt.TestPortugueseAnalyzer > [junit4] Completed on J0 in 1.33s, 4 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.pt.TestPortugueseStemFilter > [junit4] Completed on J0 in 2.21s, 4 tests > [junit4] > [junit4] Suite: > org.apache.lucene.analysis.payloads.TypeAsPayloadTokenFilterTest > [junit4] Completed on J0 in 0.01s, 1 test > [junit4] > [junit4] Suite: org.apache.lucene.analysis.hu.TestHungarianAnalyzer > [junit4] Completed on J0 in 1.80s, 4 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.ar.TestArabicLetterTokenizer > [junit4] Completed on J0 in 0.01s, 2 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.ca.TestCatalanAnalyzer > [junit4] Completed on J0 in 1.70s, 5 tests > [junit4] > [junit4] Suite: > org.apache.lucene.analysis.query.QueryAutoStopWordAnalyzerTest > [junit4] Completed on J0 in 0.24s, 7 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.lv.TestLatvianAnalyzer > [junit4] Completed on J0 in 1.38s, 4 tests > [junit4] > [junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains > [junit4] ERROR 9.99s J0 | TestRandomChains.testRandomChains > [junit4] > Throwable #1: java.lang.IllegalStateException: stage 2: > inconsistent startOffset at pos=0: 0 vs 7; token=w hch > [junit4] > at > __randomizedtesting.SeedInfo.seed([47E517F18498EF9F:7A043E90C38AF25F]:0) > [junit4] > at > org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:119) > [junit4] > at > org.apache.lucene.analysis.cjk.CJKWidthFilter.incrementToken(CJKWidthFilter.java:62) > [junit4] > at > org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:78) > [junit4] > at > org.apache.lucene.analysis.hu.HungarianLightStemFilter.incrementToken(HungarianLightStemFilter.java:48) > [junit4] > at > org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:78) > [junit4] > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:640) > [junit4] > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:550) > [junit4] > at > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:446) > [junit4] > at > org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:858) > [junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native > Method) > [junit4] > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > [junit4] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > [junit4] > at java.lang.reflect.Method.invoke(Method.java:597) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1969) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:814) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:875) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:889) > [junit4] > at > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) > [junit4] > at > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) > [junit4] > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4] > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > [junit4] > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > [junit4] > at > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) > [junit4] > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:821) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) > [junit4] > at > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) > [junit4] > at > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) > [junit4] > at > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > [junit4] > at > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) > [junit4] > at > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) > [junit4] > at > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) > [junit4] > at > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) > [junit4] > at > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) > [junit4] > at > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) > [junit4] > at > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) > [junit4] > at > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) > [junit4] > > [junit4] 2> TEST FAIL: useCharFilter=false text='vlseus wa hch > \ua827\ua806\ua810\ua80e ' > [junit4] 2> Exception from random analyzer: > [junit4] 2> charfilters= > [junit4] 2> > org.apache.lucene.analysis.pattern.PatternReplaceCharFilter(a, , > org.apache.lucene.analysis.CharReader@34042281) > [junit4] 2> tokenizer= > [junit4] 2> > org.apache.lucene.analysis.standard.StandardTokenizer(LUCENE_40, > org.apache.lucene.analysis.core.TestRandomChains$CheckThatYouDidntReadAnythingReaderWrapper@7b755dd4) > [junit4] 2> filters= > [junit4] 2> > org.apache.lucene.analysis.shingle.ShingleFilter(org.apache.lucene.analysis.ValidatingTokenFilter@6c11df8, > igcha) > [junit4] 2> org.apache.lucene.analysis.core.TypeTokenFilter(false, > org.apache.lucene.analysis.ValidatingTokenFilter@d162a12d, [<EMAIL>, > <ALPHANUM>, <COMPANY>]) > [junit4] 2> > org.apache.lucene.analysis.cjk.CJKWidthFilter(org.apache.lucene.analysis.ValidatingTokenFilter@d162a12d) > [junit4] 2> > org.apache.lucene.analysis.hu.HungarianLightStemFilter(org.apache.lucene.analysis.ValidatingTokenFilter@d162a12d) > [junit4] 2> offsetsAreCorrect=true > [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRandomChains > -Dtests.method=testRandomChains -Dtests.seed=47E517F18498EF9F > -Dtests.multiplier=3 -Dtests.locale=ar_QA -Dtests.timezone=Africa/Sao_Tome > -Dargs="-Dfile.encoding=UTF-8" > [junit4] 2> > [junit4] > (@AfterClass output) > [junit4] 2> NOTE: test params are: codec=Lucene40: > {dummy=Pulsing40(freqCutoff=8 minBlockSize=92 maxBlockSize=258)}, > sim=DefaultSimilarity, locale=ar_QA, timezone=Africa/Sao_Tome > [junit4] 2> NOTE: Linux 2.6.32-41-server amd64/Sun Microsystems Inc. > 1.6.0_32 (64-bit)/cpus=8,threads=1,free=79845912,total=245694464 > [junit4] 2> NOTE: All tests run in this JVM: [TestGreekStemmer, > TestGalicianStemFilter, TestBulgarianAnalyzer, TokenTypeSinkTokenizerTest, > NumericPayloadTokenFilterTest, TestRussianLetterTokenizer, > TestRussianLightStemFilter, TestEmptyTokenStream, TestSwedishAnalyzer, > TestChineseTokenizer, TestPersianAnalyzer, TestStemmerOverrideFilter, > TestGermanMinimalStemFilter, TestHungarianLightStemFilter, TestCzechStemmer, > TestGermanNormalizationFilter, TestSnowball, TestKeywordAnalyzer, > DateRecognizerSinkTokenizerTest, TestFinnishAnalyzer, > TestRemoveDuplicatesTokenFilter, TestPortugueseAnalyzer, > TestPortugueseStemFilter, TypeAsPayloadTokenFilterTest, > TestHungarianAnalyzer, TestArabicLetterTokenizer, TestCatalanAnalyzer, > QueryAutoStopWordAnalyzerTest, TestLatvianAnalyzer, TestRandomChains] > [junit4] 2> > [junit4] Completed on J0 in 10.24s, 1 test, 1 error <<< FAILURES! > [...truncated 354 lines...] > > [...truncated 5108 lines...] > > [...truncated 5108 lines...] > > [...truncated 5108 lines...] > > [...truncated 5108 lines...] > > [...truncated 5108 lines...] > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] -- lucidimagination.com --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
