Re: Question on CachingWrapperFilter

2009-06-09 Thread Michael McCandless
I think, once we can efficiently apply cheap random-access docIDSets the way deleted docs are applied (ie, distribute down to all SegmentTermDocs) then it'd be useful for this filter manager to also pre-fold deletes in, such that SegmentTermDocs would only have a single random-access docIDSet to ch

Re: Question on CachingWrapperFilter

2009-06-03 Thread Shai Erera
Thanks Paul ! I'll work such a utility (which takes a Filter and reads it into an OpenBitSet, SortedVIntList) and then post back in case you'll be interested in adopting it, and change CWF to use it, or something else. Shai On Tue, Jun 2, 2009 at 9:35 PM, Paul Elschot wrote: > On Tuesday 02 Ju

Re: Question on CachingWrapperFilter

2009-06-02 Thread Paul Elschot
On Tuesday 02 June 2009 16:39:06 Shai Erera wrote: > Hi > > I read CWF today and initially I thought this is going to cache a Filter > in-memory for me, so that I can more efficiently use it for subsequent > searches. But I learned that all it does is cache the DocIdSet returned by > the wrapped F

Question on CachingWrapperFilter

2009-06-02 Thread Shai Erera
Hi I read CWF today and initially I thought this is going to cache a Filter in-memory for me, so that I can more efficiently use it for subsequent searches. But I learned that all it does is cache the DocIdSet returned by the wrapped Filter. This is good in and on itself, but I wonder if we shoul