[ 
https://issues.apache.org/jira/browse/LUCENE-10248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17451343#comment-17451343
 ] 

ASF subversion and git services commented on LUCENE-10248:
----------------------------------------------------------

Commit edb936f09055cc16a71b5b037bef77177786759b in lucene's branch 
refs/heads/main from Xavier Sanchez Loro
[ https://gitbox.apache.org/repos/asf?p=lucene.git;h=edb936f ]

LUCENE-10248: Spanish Plural Stemmer (#461)

Adds a new Spanish stemmer just for stemming plural to singular whilst 
maintaining gender: the SpanishPluralStemmer. The goal is to provide a 
lightweight algorithmic approach with better precision and recall than current 
approaches.

See blog post for more details: 
https://medium.com/inside-wallapop/spanish-plural-stemmer-matching-plural-and-singular-forms-in-spanish-using-lucene-93e005e38373

This approach is based on rules specified in WikiLingua: 
http://www.wikilengua.org/index.php/Plural_(formaci%C3%B3n)

Some characteristics:

* Designed to stem just plural to singular form
* Distinguishes between masculine and feminine forms
* It will increase recall but precision can be reduced depending on the use 
case/information need
* Stems plural words of foreign origin: i.e. complots, bits, punks, robots
* Support for invariant words: same plural and singular form or plural does not 
make sense: i.e. crisis, jueves, lapsus, abrebotellas, etc
* Support for special cases: i.e. yoes, clubes, itemes, faralaes
* Use it when the distinction between singular and plural is not relevant but 
gender is relevant
* Produces meaningful tokens in form of singular
* Not strange stems like “amig”: it’s true that stemmers must not generate 
grammatically correct tokens, but if we generate correct stems we decrease the 
possibility of collisions with other words

> Add SpanishPluralStemFilter
> ---------------------------
>
>                 Key: LUCENE-10248
>                 URL: https://issues.apache.org/jira/browse/LUCENE-10248
>             Project: Lucene - Core
>          Issue Type: Improvement
>          Components: modules/analysis
>    Affects Versions: 9.0
>            Reporter: Xavier Sanchez Loro
>            Priority: Major
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> We propose a new Spanish stemmer just for stemming plural to singular whilst 
> maintaining gender: the SpanishPluralStemmer. Our goal is to provide a 
> lightweight algorithmic approach with better precision and recall than 
> current approaches.
> In the following 
> [article|https://medium.com/inside-wallapop/spanish-plural-stemmer-matching-plural-and-singular-forms-in-spanish-using-lucene-93e005e38373]
>  we made a comparison of different Spanish Stemmers and use cases and which 
> value adds our contribution
> Our Solution is an algorithmic approach Spanish rules for building plural 
> forms
> based on rules defined in [wikilengua| 
> http://www.wikilengua.org/index.php/Plural_(formaci%C3%B3n)]
> Some characteristics:
>  * Designed to stem just plural to singular form
>  * Distinguishes between masculine and feminine forms
>  * It will increase recall but precision can be reduced depending on the use 
> case/information need
>  * Stems plural words of foreign origin: i.e. complots, bits, punks, robots
>  * Support for invariant words: same plural and singular form or plural does 
> not make sense: i.e. crisis, jueves, lapsus, abrebotellas, etc
>  * Support for special cases: i.e. yoes, clubes, itemes, faralaes
>  * Use it when the distinction between singular and plural is not relevant 
> but gender is relevant
>  * Produces meaningful tokens in form of singular
>  ** Not strange stems like “amig”: it’s true that stemmers must not generate 
> grammatically correct tokens, but if we generate correct stems we decrease 
> the possibility of collisions with other words



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to