KeywordMarkerFilter resets keyword attribute state to false for tokens not in
protwords.txt
-------------------------------------------------------------------------------------------
Key: LUCENE-2901
URL: https://issues.apache.org/jira/browse/LUCENE-2901
Project: Lucene - Java
Issue Type: Bug
Components: Analysis
Affects Versions: 3.1
Reporter: Drew Farris
Priority: Minor
KeywordMarkerFilter sets true or false for the KeywordAttribute on all tokens.
This erases previous state established further up the filter chain, for example
in the case where a custom filter wants to prevent a token from being stemmed.
If a token is already marked as a keyword (KeywordAttribute.isKeyword() ==
true), perhaps the KeywordMarkerFilterFactory should not re-set the state to
false.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
