[jira] (LUCENE-7668) WordDelimiterGraphFilter fails to preserve token type

[Uwe Schindler (JIRA)]

Title: Message Title

Uwe Schindler commented on LUCENE-7668   Re: WordDelimiterGraphFilter fails to preserve token type There is one possibility: As CannedTokenStream is a source and owns the attributes, it could use the Token Attributefactory (see the final field on deprecated Token class) in its ctor. Because of this one could use copyTo of Token to copy it into the Token behind all attributes. But as CannedTokenStream only supports the attributes of Token, we could also just ensure all of those are copied. So look which attributes are implemented and use those! Not sure what's the better idea. Add Comment   This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)