[
https://issues.apache.org/jira/browse/LUCENE-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12742385#action_12742385
]
Uwe Schindler commented on LUCENE-1804:
---------------------------------------
OK, I was wondering, because TokenFilter is there for this pupose and
TokenStream only provides the AttributeSource ctor because the TokenFilter
subclass needs this. So one could also simply create a TokenFilter and put it
ontop of the Tokenizer to wrap? new TokenFilter(new WrappedTokenizer()) - why
need a Tokenizer for that when TokenFilter is made for it?
But for completeness, this ctor should also get the Reader/CharStream (as all
other ctors have the Reader param).
> Can't specify AttributeSource for Tokenizer
> -------------------------------------------
>
> Key: LUCENE-1804
> URL: https://issues.apache.org/jira/browse/LUCENE-1804
> Project: Lucene - Java
> Issue Type: Bug
> Reporter: Yonik Seeley
> Attachments: LUCENE-1804.patch
>
>
> One can't currently specify the attribute source for a Tokenizer like one can
> with any other TokenStream.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
