StandardTokenizer - Improper Hostname Recognition
-------------------------------------------------

                 Key: LUCENE-1403
                 URL: https://issues.apache.org/jira/browse/LUCENE-1403
             Project: Lucene - Java
          Issue Type: Bug
    Affects Versions: 2.3.2, 2.3.1
         Environment: Java 5
            Reporter: Cullin Wible


As of 2.3.1 the documentation for the StandardTokenizer states that it 
"Recognizes email addresses and internet hostnames as one token."

However hostnames such as "my-host.com" are recognized as two tokens "my" and 
"host.com".

Any host with a dash in the name is not recognized properly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to