[ 
https://issues.apache.org/jira/browse/LUCENE-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561799#comment-15561799
 ] 

Andy Hind commented on LUCENE-7476:
-----------------------------------

I spotted this running org.apache.lucene.analysis.core.TestFactories with 
@Repeat (iterations = 100) from eclipse
I just got 9 failures running this again. It is odd that I do not see them in 
the build failures. 

I believe the 9 fails are all the same 

{code}
java.lang.IllegalStateException: incrementToken() called while in wrong state: 
INCREMENT_FALSE
        at 
__randomizedtesting.SeedInfo.seed([18C3960FB72D4F07:2AB7AA6A139D55E3]:0)
        at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
        at 
org.apache.lucene.analysis.MockTokenizer.incrementToken(MockTokenizer.java:136)
        at 
org.apache.lucene.analysis.ja.JapaneseNumberFilter.incrementToken(JapaneseNumberFilter.java:152)
        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:716)
        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:627)
        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:525)
        at 
org.apache.lucene.analysis.core.TestFactories.doTestTokenFilter(TestFactories.java:108)
        at 
org.apache.lucene.analysis.core.TestFactories.test(TestFactories.java:61)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)

{code}

The log gives:
{code}
TEST FAIL: useCharFilter=false text='1'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=false text='2'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=false 
text='\ufe0f\ufe06\ufe03\ufe04\ufe0c\ufe0f\ufe08\ufe06\ufe04 7'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='\u7e08\uda09\udd65\u0cc2= 
\u04cd\u3bc3\uc780lW 39'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='ell'emendamento n. 8'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='uaoqfm \ue274\ud98f\udce3\ud771\ufd82\ub336 
8'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=false text='\u06c1L 1'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='R\u06b0\u4410\u03a1\u03d4 205'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='etaan huomenna klo 1'
NOTE: reproduce with: ant test  -Dtestcase=TestFactories -Dtests.method=test 
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk 
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
NOTE: leaving temporary files on disk at: 
/tmp/lucene.analysis.core.TestFactories_18C3960FB72D4F07-001
NOTE: test params are: 
codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
 chunkSize=17439, maxDocsPerChunk=83, blockSize=212), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, 
chunkSize=17439, blockSize=212)), sim=ClassicSimilarity, locale=uk, 
timezone=Atlantic/Jan_Mayen
NOTE: Linux 4.4.0-38-generic amd64/Oracle Corporation 1.8.0_91 
(64-bit)/cpus=4,threads=1,free=34383216,total=359661568
NOTE: All tests run in this JVM: [TestFactories]
{code}

> Fix transient failure in JapaneseNumberFilter run from TestFactories
> --------------------------------------------------------------------
>
>                 Key: LUCENE-7476
>                 URL: https://issues.apache.org/jira/browse/LUCENE-7476
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: core/other
>    Affects Versions: 6.2.1
>            Reporter: Andy Hind
>            Priority: Trivial
>         Attachments: LUCENE-7476.patch
>
>
> Repeatedly running TestFactories show this test to fail ~10% of the time.
> I believe the fix is trivial and related to loosing the state of the 
> underlying input stream when testing some analyzer life cycle flows. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to