[
https://issues.apache.org/jira/browse/LUCENE-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498309#comment-16498309
]
Junte Zhang commented on LUCENE-8278:
-------------------------------------
I think I have tested the patch:
{code:java}
patch -p1 -i LUCENE-8278.patch
patching file lucene/analysis/common/build.xml
patching file
lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/ASCIITLD.jflex-macro
patching file
lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/UAX29URLEmailTokenizerImpl.java
patching file
lucene/analysis/common/src/java/org/apache/lucene/analysis/standard/UAX29URLEmailTokenizerImpl.jflex
patching file
lucene/analysis/common/src/test/org/apache/lucene/analysis/standard/TestUAX29URLEmailTokenizer.java
patching file
lucene/analysis/common/src/tools/java/org/apache/lucene/analysis/standard/GenerateJflexTLDMacros.java
{code}
then ant compile
Started Solr and created a core with a fieldType:
{code:java}
<fieldType name="urlEmail" class="solr.TextField">
<analyzer>
<tokenizer class="solr.UAX29URLEmailTokenizerFactory"/>
</analyzer>
</fieldType>{code}
Then tested in the Solr Admin but didn't see a difference, but perhaps I missed
something.
> UAX29URLEmailTokenizer is not detecting some tokens as URL type
> ---------------------------------------------------------------
>
> Key: LUCENE-8278
> URL: https://issues.apache.org/jira/browse/LUCENE-8278
> Project: Lucene - Core
> Issue Type: Bug
> Reporter: Junte Zhang
> Assignee: Steve Rowe
> Priority: Minor
> Attachments: LUCENE-8278.patch
>
>
> We are using the UAX29URLEmailTokenizer so we can use the token types in our
> plugins.
> However, I noticed that the tokenizer is not detecting certain URLs as <URL>
> but <ALPHANUM> instead.
> Examples that are not working:
> * example.com is <ALPHANUM>
> * example.net is <ALPHANUM>
> But:
> * https://example.com is <URL>
> * as is https://example.net
> Examples that work:
> * example.ch is <URL>
> * example.co.uk is <URL>
> * example.nl is <URL>
> I have checked this JIRA, and could not find an issue. I have tested this on
> Lucene (Solr) 6.4.1 and 7.3.
> Could someone confirm my findings and advise what I could do to (help)
> resolve this issue?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
