> Just as note related to this discussion: > > TokenFilter#reset says: > > /** Reset the filter as well as the input TokenStream. */ > > However, CachingTokenFilter does not reset the input TokenStream.
That's a bug :-) but it is not a problem, as CachingTokenFilter will not call the input filter again, when it was reset (it then only delivers cached tokens). TokenFilters should really do a "reset" on reset() and should have a rewind() method (interface "Rewindable") if they cache Tokens. The problem is BW compatibility for CachingTokenFilter. The new TeeSinkTokenFilter is new and can conform to this spec. Deprecated Tee/SinkTokenizers have the same problem like CachingTokenFilter. Uwe --------------------------------------------------------------------- To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org