Working on Lucene-1101 I checked if SinkTokenizer.next(Token) should also call Token.clear(). (It shouldn't, because it ignores the input token.)
However I think that calls to next() would end up creating Tokens for nothing (by TokenStream.next()). May currently be an empty case (if all current uses call next(Token)), but still - is it safer for SinkTokenizer to implement next() rather than next(Token)?
