Two-pass TokenFilter

2014-08-20 Thread Christian Beil
Hey guys, I need a TokenFilter that filters some tokens like the FilteringTokenFilter. The problem is, in order to do the filtering I need to know all tokens in advance. I thought I'll adapt the CachingTokenFilter in order to collect all tokens in the first pass. In the second pass it can use thi

Re: Two-pass TokenFilter

2014-08-24 Thread Christian Beil
MT+02:00 Ahmet Arslan : > Hi, > > Can you elaborate more, what do you mean by "I need to know all tokens > in advance." > > Ahmet > > > On Wednesday, August 20, 2014 6:48 PM, Christian Beil < > christian.a.b...@gmail.com> wrote: > Hey guys, >