Alan Woodward created LUCENE-8395:

             Summary: WordDelimiterGraphFilter can incorrectly add holes to a 
                 Key: LUCENE-8395
             Project: Lucene - Core
          Issue Type: New Feature
            Reporter: Alan Woodward
            Assignee: Alan Woodward
         Attachments: LUCENE-8395.patch

If a token consists entirely of delimiter characters, then 
WordDelimiterGraphFilter will remove the token and insert a hole into the 
TokenStream.  However, it does this even if {{preserve_original}} is set, which 
results in an extra gap being added to the stream.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to