Standard analyzer does not correctly tokenize combining character U+0364
COMBINING LATIN SMALL LETTRE E
-------------------------------------------------------------------------------------------------------
Key: LUCENE-1545
URL: https://issues.apache.org/jira/browse/LUCENE-1545
Project: Lucene - Java
Issue Type: Bug
Components: Analysis
Affects Versions: 2.4
Environment: Linux x86_64, Sun Java 1.6
Reporter: Andreas Hauser
Fix For: 2.9
Standard analyzer does not correctly tokenize combining character U+0364
COMBINING LATIN SMALL LETTRE E.
The word "moͤchte" is incorrectly tokenized into "mo" "chte", the combining
character is lost.
Expected result is only on token "moͤchte".
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
