[ 
https://issues.apache.org/jira/browse/LUCENE-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12801911#action_12801911
 ] 

Robert Muir commented on LUCENE-2055:
-------------------------------------

Hello DM, me marking this as a bug does not mean it will be a backwards 
incompatible fix, i have not even proposed a patch yet.

This is undeniably a bug, each stemmer proudly lists that it implements the 
snowball algorithm, but it is not correct.
it is my understanding that such problems (buggy stemming impls) are the reason 
the snowball project was created in the first place

So, we can fix the bug in 2 different ways:
* delete the old stemmers and in the analyzers replace them with 
SnowballStemFilters (it does fix the bug, as they now become correct)
* keep the buggy code and behavior with version


> Fix buggy stemmers and Remove duplicate analysis functionality
> --------------------------------------------------------------
>
>                 Key: LUCENE-2055
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2055
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/analyzers
>            Reporter: Robert Muir
>             Fix For: 3.1
>
>
> would like to remove stemmers in the following packages, and instead in their 
> analyzers use a SnowballStemFilter instead.
> * analyzers/fr
> * analyzers/nl
> * analyzers/ru
> below are excerpts from this code where they proudly proclaim they use the 
> snowball algorithm.
> I think we should delete all of this custom stemming code in favor of the 
> actual snowball package.
> {noformat}
> /**
>  * A stemmer for French words. 
>  * <p>
>  * The algorithm is based on the work of
>  * Dr Martin Porter on his snowball project<br>
>  * refer to http://snowball.sourceforge.net/french/stemmer.html<br>
>  * (French stemming algorithm) for details
>  * </p>
>  */
> public class FrenchStemmer {
> /**
>  * A stemmer for Dutch words. 
>  * <p>
>  * The algorithm is an implementation of
>  * the <a 
> href="http://snowball.tartarus.org/algorithms/dutch/stemmer.html";>dutch 
> stemming</a>
>  * algorithm in Martin Porter's snowball project.
>  * </p>
>  */
> public class DutchStemmer {
> /**
>  * Russian stemming algorithm implementation (see 
> http://snowball.sourceforge.net for detailed description).
>  */
> class RussianStemmer
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org

Reply via email to