[
https://issues.apache.org/jira/browse/LUCENE-4993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13653627#comment-13653627
]
Commit Tag Bot commented on LUCENE-4993:
----------------------------------------
[trunk commit] uschindler
http://svn.apache.org/viewvc?view=revision&revision=1480911
LUCENE-4993: Fix BeiderMorseFilter to preserve custom attributes when inserting
tokens with position increment 0.
> BeiderMorseFilter inserts tokens with positionIncrement=0, but ignores all
> custom attributes except OffsetAttribute
> -------------------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-4993
> URL: https://issues.apache.org/jira/browse/LUCENE-4993
> Project: Lucene - Core
> Issue Type: Bug
> Components: modules/analysis
> Affects Versions: 4.3
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
> Priority: Trivial
> Fix For: 4.4
>
> Attachments: LUCENE-4993.patch
>
>
> BeiderMorseFilter inserts sometimes additional phonetic tokens for the same
> source token. Currently it calls clearAttributes before doing this and sets
> the new token's term, positionIncrement=0 and the original offset.
> This leads to problems if the TokenStream contains other attributes inserted
> before (like KeywordAttribute, FlagsAttribute,...). Those are all reverted to
> defaults for the inserted tokens.
> The TokenFilter should remove the special case done for preserving offsets
> and instead to captureState() and restoreState().
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
