[
https://issues.apache.org/jira/browse/LUCENE-6254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325665#comment-14325665
]
Dawid Weiss commented on LUCENE-6254:
-------------------------------------
There actually is a dictionary-driven lemmatization engine in Lucene (for
Polish). You could simply compile a dictionary for morfologik-stemming and
reuse the same code.
In fact, this is how folks at the https://www.languagetool.org/ are using it
(and they have support for multiple languages).
> Dictionary-based lemmatizer
> ---------------------------
>
> Key: LUCENE-6254
> URL: https://issues.apache.org/jira/browse/LUCENE-6254
> Project: Lucene - Core
> Issue Type: New Feature
> Components: modules/analysis
> Reporter: Erlend Garåsen
> Labels: patch
> Fix For: 5.0
>
>
> The only way to achieve lemmatization today is to use the
> SynonymFilterFactory. The available stemmers are also inaccurate since they
> are only following simplistic rules.
> A dictionary-based lemmatizer will be more precise because it has the
> opportunity to know the part of speech. Thus it provides a more precise
> method to stem words compared to other dictionary-based stemmers such as
> Hunspell.
> This is my effort to develop such a lemmatizer for Apache Lucene. The
> documentation is temporarily placed here:
> http://folk.uio.no/erlendfg/solr/lemmatizer.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
