[ 
https://issues.apache.org/jira/browse/LUCENE-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632191#action_12632191
 ] 

Wouter Heijke commented on LUCENE-1391:
---------------------------------------

Hi Karl,
Yes the unigram tokens is what i'm referring to. The output tokens can have 
'Shingle', or something I can define, even concattenated types could be handy 
in some cases!
Now that I come to it, I'm also missing setTokenType like ShingleFilter has.

> Token type and flags values get lost when using ShingleMatrixFilter
> -------------------------------------------------------------------
>
>                 Key: LUCENE-1391
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1391
>             Project: Lucene - Java
>          Issue Type: Bug
>          Components: contrib/analyzers
>    Affects Versions: 2.4
>            Reporter: Wouter Heijke
>            Assignee: Karl Wettin
>
> While using the new ShingleMatrixFilter I noticed that a token's type and 
> flags get lost while using this filter. ShingleFilter does respect these 
> values like the other filters I know.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to