[
https://issues.apache.org/jira/browse/LUCENE-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632191#action_12632191
]
Wouter Heijke commented on LUCENE-1391:
---------------------------------------
Hi Karl,
Yes the unigram tokens is what i'm referring to. The output tokens can have
'Shingle', or something I can define, even concattenated types could be handy
in some cases!
Now that I come to it, I'm also missing setTokenType like ShingleFilter has.
> Token type and flags values get lost when using ShingleMatrixFilter
> -------------------------------------------------------------------
>
> Key: LUCENE-1391
> URL: https://issues.apache.org/jira/browse/LUCENE-1391
> Project: Lucene - Java
> Issue Type: Bug
> Components: contrib/analyzers
> Affects Versions: 2.4
> Reporter: Wouter Heijke
> Assignee: Karl Wettin
>
> While using the new ShingleMatrixFilter I noticed that a token's type and
> flags get lost while using this filter. ShingleFilter does respect these
> values like the other filters I know.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]