[ https://issues.apache.org/jira/browse/LUCENE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12621175#action_12621175 ]
Doron Cohen commented on LUCENE-1350: ------------------------------------- DM Thanks for taking care of this large change! By Mike's comments on LUCENE-1333 seems LUCENE-1333 will be committed and this one will be canceled so I feel kinda bad for the time you put in the last patch here. > Filters which are "consumers" should not reset the payload or flags and > should better reuse the token > ----------------------------------------------------------------------------------------------------- > > Key: LUCENE-1350 > URL: https://issues.apache.org/jira/browse/LUCENE-1350 > Project: Lucene - Java > Issue Type: Bug > Components: Analysis, contrib/* > Reporter: Doron Cohen > Assignee: Doron Cohen > Fix For: 2.3.3 > > Attachments: LUCENE-1350.patch, LUCENE-1350.patch > > > Passing tokens with payloads through SnowballFilter results in tokens with no > payloads. > A workaround for this is to apply stemming first and only then run whatever > logic creates the payload, but this is not always convenient. > Other "consumer" filters have similar problem. > These filters can - and should - reuse the token, by implementing > next(Token), effectively also fixing the unwanted resetting. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]