[
https://issues.apache.org/jira/browse/LUCENE-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632188#action_12632188
]
Karl Wettin commented on LUCENE-1391:
-------------------------------------
Hi Wouter,
are you refering to unigram tokens? They should of course keep the original
values, I'll take a look at that.
I'm not sure how one would/could retain the token type or flags in an output
token that is a combination of multiple input tokens as their values might
differ.
> Token type and flags values get lost when using ShingleMatrixFilter
> -------------------------------------------------------------------
>
> Key: LUCENE-1391
> URL: https://issues.apache.org/jira/browse/LUCENE-1391
> Project: Lucene - Java
> Issue Type: Bug
> Components: contrib/analyzers
> Affects Versions: 2.4
> Reporter: Wouter Heijke
>
> While using the new ShingleMatrixFilter I noticed that a token's type and
> flags get lost while using this filter. ShingleFilter does respect these
> values like the other filters I know.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
