[ https://issues.apache.org/jira/browse/LUCENE-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620680#comment-16620680 ]
Uwe Schindler edited comment on LUCENE-8498 at 9/19/18 2:38 PM: ---------------------------------------------------------------- Sorry, the issue is about LowercaseTokenizer :-) So +1 to rmeove the tokenizer and removal of chartokenizer's normalization methods (the abstract method and the factory methods using java.util.function). was (Author: thetaphi): Sorry, the issue is about LowercaseTokenizer :-) So +1 to rmeove the tokenizer and removal of chartokenizer's normalization methods. > Deprecate/Remove LowerCaseTokenizer > ----------------------------------- > > Key: LUCENE-8498 > URL: https://issues.apache.org/jira/browse/LUCENE-8498 > Project: Lucene - Core > Issue Type: New Feature > Reporter: Alan Woodward > Priority: Major > Attachments: LUCENE-8498.patch > > > LowerCaseTokenizer combines tokenization and filtering in a way that prevents > us improving the normalization API. We should deprecate and remove it, as it > can be replaced simply with a LetterTokenizer and LowerCaseFilter. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org