[
https://issues.apache.org/jira/browse/LUCENE-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16072994#comment-16072994
]
Ahmet Arslan commented on LUCENE-7773:
--------------------------------------
Can someone please look into this issue? This issue addresses a
[TODO|https://github.com/apache/lucene-solr/blob/master/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java#L43]
introduced by [~rcmuir] in
[this|https://github.com/apache/lucene-solr/commit/bc3a3dc5d47af0c00748468b1ae14b4a18854366]
commit.
> Remove unused/deprecated token types from StandardTokenizer
> -----------------------------------------------------------
>
> Key: LUCENE-7773
> URL: https://issues.apache.org/jira/browse/LUCENE-7773
> Project: Lucene - Core
> Issue Type: Improvement
> Components: modules/analysis
> Affects Versions: 6.5
> Reporter: Ahmet Arslan
> Priority: Minor
> Labels: analyzers
> Fix For: 7.0
>
> Attachments: LUCENE-7773.patch, LUCENE-7773.patch
>
>
> StandardTokenizer does not recognize e-mail, company etc. This issue removes
> those token types.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]