[ 
https://issues.apache.org/jira/browse/LUCENE-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Grzegorz Sobczyk updated LUCENE-5421:
-------------------------------------

    Description: 
Morfologic filter search stems in input or lowercase format:
org.apache.lucene.analysis.morfologik.MorfologikFilter.incrementToken()
{code}
if (!keywordAttr.isKeyword() && (lookupSurfaceForm(termAtt) || 
lookupSurfaceForm(toLowercase(termAtt)))) {
  [...]
}
{code}
In this situation, if input token is *sienkiewicza* - it isn't stemmed
but: *Sienkiewicza* --> *Sienkiewicz*
for comparison:
*pRoDuKtY* --> *produkt*

It should stem also input token with capitalized first letter

  was:
Morfologic filter search stems in input or lowercase format:
org.apache.lucene.analysis.morfologik.MorfologikFilter.incrementToken()
{code}
if (!keywordAttr.isKeyword() && (lookupSurfaceForm(termAtt) || 
lookupSurfaceForm(toLowercase(termAtt)))) {
{code}
In this situation, if input token is *sienkiewicza* - it isn't stemmed
but: *Sienkiewicza* --> *Sienkiewicz*
for comparison:
*pRoDuKtY* --> *produkt*

It should stem also input token with capitalized first letter


> MorfologicFilter doesn't stem properly invented names: surnames, rivers, etc.
> -----------------------------------------------------------------------------
>
>                 Key: LUCENE-5421
>                 URL: https://issues.apache.org/jira/browse/LUCENE-5421
>             Project: Lucene - Core
>          Issue Type: Bug
>          Components: modules/analysis
>    Affects Versions: 4.6.1
>            Reporter: Grzegorz Sobczyk
>
> Morfologic filter search stems in input or lowercase format:
> org.apache.lucene.analysis.morfologik.MorfologikFilter.incrementToken()
> {code}
> if (!keywordAttr.isKeyword() && (lookupSurfaceForm(termAtt) || 
> lookupSurfaceForm(toLowercase(termAtt)))) {
>   [...]
> }
> {code}
> In this situation, if input token is *sienkiewicza* - it isn't stemmed
> but: *Sienkiewicza* --> *Sienkiewicz*
> for comparison:
> *pRoDuKtY* --> *produkt*
> It should stem also input token with capitalized first letter



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to