[ 
https://issues.apache.org/jira/browse/LUCENE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032559#comment-15032559
 ] 

Hoss Man commented on LUCENE-6914:
----------------------------------

failure produced by attached test patch...

{noformat}
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestDecimalDigitFilter -Dtests.method=testDoubleStruck 
-Dtests.seed=3126DECB8CE805E -Dtests.slow=true -Dtests.locale=ga 
-Dtests.timezone=Africa/Juba -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.03s | TestDecimalDigitFilter.testDoubleStruck <<<
   [junit4]    > Throwable #1: org.junit.ComparisonFailure: term 0 
expected:<1[984]> but was:<1[𝟡8𝟜]>
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([3126DECB8CE805E:92961DD9D4C68E38]:0)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:186)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:301)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:305)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:309)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.assertAnalyzesTo(BaseTokenStreamTestCase.java:359)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.assertAnalyzesTo(BaseTokenStreamTestCase.java:368)
   [junit4]    >        at 
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkOneTerm(BaseTokenStreamTestCase.java:429)
   [junit4]    >        at 
org.apache.lucene.analysis.core.TestDecimalDigitFilter.testDoubleStruck(TestDecimalDigitFilter.java:74)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
{noformat}

> DecimalDigitFilter skips characters in some cases (supplemental?)
> -----------------------------------------------------------------
>
>                 Key: LUCENE-6914
>                 URL: https://issues.apache.org/jira/browse/LUCENE-6914
>             Project: Lucene - Core
>          Issue Type: Bug
>    Affects Versions: 5.4
>            Reporter: Hoss Man
>         Attachments: LUCENE-6914.patch
>
>
> Found this while writing up the solr ref guide for DecimalDigitFilter. 
> With input like "𝟙𝟡𝟠𝟜" ("Double Struck" 1984) the filter produces "1𝟡8𝟜" (1, 
> double struck 9, 8, double struck 4)  add some non-decimal characters in 
> between the digits (ie: "𝟙x𝟡x𝟠x𝟜") and you get the expected output 
> ("1x9x8x4").  This doesn't affect all decimal characters though, as evident 
> by the existing test cases.
> Perhaps this is an off by one bug in the "if the original was supplementary, 
> shrink the string" code path?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to