Jim Ferenczi created LUCENE-8250:
------------------------------------

             Summary: Should FilteringTokenFilter handle positionLength
                 Key: LUCENE-8250
                 URL: https://issues.apache.org/jira/browse/LUCENE-8250
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Jim Ferenczi


FilteringTokenFilter does not handle the position length graph attribute when 
removing a token from the stream. This doesn't work well with graph token 
stream that sets position length since removing a token from the stream can 
invalidate the position length set on the previous tokens. 
This issue was first discussed in 
https://issues.apache.org/jira/browse/LUCENE-4065 but it has a different 
purpose which is why I am opening a new issue here.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to