[ https://issues.apache.org/jira/browse/LUCENE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386052#comment-15386052 ]
Adrien Grand commented on LUCENE-6914: -------------------------------------- bq. now that we know the problem and can trivially reproduce with randomized tests, i'm not sure it's really relevant I find explicit tests helpful because they are easier to dig into if they fail, so obvious problems can be more easily identified/fixed. I think we should commit this patch, this filter is used in several of our language analyzers so this bug might be hitting quite a lot of users? > DecimalDigitFilter skips characters in some cases (supplemental?) > ----------------------------------------------------------------- > > Key: LUCENE-6914 > URL: https://issues.apache.org/jira/browse/LUCENE-6914 > Project: Lucene - Core > Issue Type: Bug > Affects Versions: 5.4 > Reporter: Hoss Man > Attachments: LUCENE-6914.patch, LUCENE-6914.patch, LUCENE-6914.patch > > > Found this while writing up the solr ref guide for DecimalDigitFilter. > With input like "𝟙𝟡𝟠𝟜" ("Double Struck" 1984) the filter produces "1𝟡8𝟜" (1, > double struck 9, 8, double struck 4) add some non-decimal characters in > between the digits (ie: "𝟙x𝟡x𝟠x𝟜") and you get the expected output > ("1x9x8x4"). This doesn't affect all decimal characters though, as evident > by the existing test cases. > Perhaps this is an off by one bug in the "if the original was supplementary, > shrink the string" code path? -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org