krickert opened a new pull request, #1164: URL: https://github.com/apache/opennlp/pull/1164
## Summary Stacked on #1138 (OPENNLP-1868); merge bottom-up. When #1138 merges, retarget this PR to main before deleting its branch. Adds the bidirectional emoji/emoticon fold to the normalizer stack: - **EmojiEmoticons**: the mapping table, loaded from a project-authored data file (no third-party data set; one row per mapping with fold type, standard, Unicode version, and notes for provenance). - **EmojiToEmoticonCharSequenceNormalizer / EmoticonToEmojiCharSequenceNormalizer**: offset-aware in both directions; length changes report exact alignment runs. - **TextNormalizer.Builder `emojiToEmoticon()` / `emoticonToEmoji()`** rungs in the canonical builder order. - **EMOJI_FOLD dimension** in TermAnalyzer for per-token folded layers. - Dev Manual coverage in the normalizer chapter. ## Test plan - New: `EmojiEmoticonsTest`, `EmojiToEmoticonCharSequenceNormalizerTest`, `EmoticonToEmojiCharSequenceNormalizerTest` - Full `opennlp-api` and `opennlp-runtime` suites green (1,380 tests) https://issues.apache.org/jira/browse/OPENNLP-1869 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
