Uwe Schindler created LUCENE-4993:
-------------------------------------
Summary: BeiderMorseFilter inserts tokens with
positionIncrement=0, but ignores all custom attributes except OffsetAttribute
Key: LUCENE-4993
URL: https://issues.apache.org/jira/browse/LUCENE-4993
Project: Lucene - Core
Issue Type: Bug
Components: modules/analysis
Affects Versions: 4.3
Reporter: Uwe Schindler
Assignee: Uwe Schindler
Priority: Trivial
Fix For: 4.4
BeiderMorseFilter inserts sometimes additional phonetic tokens for the same
source token. Currently it calls clearAttributes before doing this and sets the
new token's term, positionIncrement=0 and the original offset.
This leads to problems if the TokenStream contains other attributes inserted
before (like KeywordAttribute, FlagsAttribute,...). Those are all reverted to
defaults for the inserted tokens.
The TokenFilter should remove the special case done for preserving offsets and
instead to captureState() and restoreState().
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
