ASF subversion and git services commented on LUCENE-8395:

Commit 8997d41357ab95eaa88702b93c75de4b1813457b in lucene-solr's branch 
refs/heads/master from [~romseygeek]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=8997d41 ]

LUCENE-8395: WordDelimiterGraphFilter can incorrectly add holes

> WordDelimiterGraphFilter can incorrectly add holes to a TokenStream
> -------------------------------------------------------------------
>                 Key: LUCENE-8395
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8395
>             Project: Lucene - Core
>          Issue Type: New Feature
>            Reporter: Alan Woodward
>            Assignee: Alan Woodward
>            Priority: Major
>         Attachments: LUCENE-8395.patch
> If a token consists entirely of delimiter characters, then 
> WordDelimiterGraphFilter will remove the token and insert a hole into the 
> TokenStream.  However, it does this even if {{preserve_original}} is set, 
> which results in an extra gap being added to the stream.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to