I've been looking at multiple optimizations we could do in our Lucene indexes (currently around ~8B total spread out in indexes of ~250M documents each) for querying fields that have very low cardinality (usually true/false, or in some cases, less than 10 categories). I would have thought Lucene offered some kind of compact bit-set implementation for a field of this type, but I can't seem to find anything. Or maybe I'm not looking in the right places.
Is there a field type that would help us in this case? Or what's the best way to implement compact bit-set fields in Lucene, if they're not there already? We're using Lucene 4.3.1 currently. Thanks! Marcos Juarez
