> , or each tokenizer
should read "or each Tokenizer or TokenFilter"


On Mon, Aug 10, 2009 at 12:55 PM, Yonik
Seeley<[email protected]> wrote:
> On Mon, Aug 10, 2009 at 12:44 PM, Uwe Schindler<[email protected]> wrote:
>>the CharTokenizer should only clear the TermAttribute, as it is only using 
>>this attribute.
>
> It's certainly not clear to me - is there an established convention?
> Either Tokenizer clears all attributes, or each tokenizer clears those
> attributes it cares about.  But in the latter case, wouldn't that
> potentially cause multiple TokenFilters to clear the same attribute?
>
> -Yonik
> http://www.lucidimagination.com
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to