[ 
https://issues.apache.org/jira/browse/LUCENE-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13894538#comment-13894538
 ] 

Simon Willnauer commented on LUCENE-5437:
-----------------------------------------

well the keyword attribute is supported all over the place for that purpose. 
For BW compat we have the version attribute and to remove duplicates there is 
RemoveDuplicatesTokenFilter. We should really think about if we want to add an 
abstract class here. I don't think so to be honest. Another way is to make it 
an option or to use a delegator and store the state in the delegate TokenFilter?

> ASCIIFoldingFilter that emits both unfolded and folded tokens
> -------------------------------------------------------------
>
>                 Key: LUCENE-5437
>                 URL: https://issues.apache.org/jira/browse/LUCENE-5437
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Nik Everett
>            Assignee: Simon Willnauer
>            Priority: Minor
>         Attachments: LUCENE-5437.patch
>
>
> I've found myself wanting an ASCIIFoldingFilter that emits both the folded 
> tokens and the original, unfolded tokens.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to