Clearing the attributes should be required in those places where we
cleared (or reinit'ed) Token previously, right?
Michael
On 8/10/09 10:42 AM, Yonik Seeley wrote:
Thinking through this a little more, I don't see an alternative to the
tokenizer clearing all attributes at the start of incrementToken().
Consider a DefaultPayloadTokenFilter that only sets a payload if one
isn't already set - it's clear that this filter can't clear the
payload attribute, so it must be cleared by the head of the chain -
the tokenizer. Right?
-Yonik
http://www.lucidimagination.com
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
