krickert opened a new pull request, #1190: URL: https://github.com/apache/opennlp/pull/1190
Adds a stemmer that reads standard Hunspell `.dic`/`.aff` dictionary pairs, built on the `StemmerFactory` seam from OPENNLP-1883. Supported affix features: alias compression (AF), NEEDAFFIX, ONLYINCOMPOUND, FORBIDDENWORD, CIRCUMFIX, twofold suffix analysis through continuation classes, and compound word positioning including linking forms as used in German compounds. Parsing is regex-free; unsupported dictionary features fail loud at load time rather than degrading silently. Dictionaries are user-supplied and nothing is bundled: the in-tree tests use a project-authored miniature dictionary, and `dev/README-hunspell-dictionaries.md` documents acquiring published dictionaries together with their license files. The manual gains a Hunspell section whose example is asserted by `HunspellManualExampleTest`. Additionally verified against published dictionaries for English, Spanish, Hungarian, and German through the gated `HunspellRealDictionaryTest` (runs only when `-Dopennlp.hunspell.dict.dir` is set; skipped otherwise, and no dictionary data enters the tree). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
