I think a general purpose one like the one in hadoop should be fine, personally. Plus we already have it accessible on the classpath. :)
On Thu, May 27, 2010 at 1:40 PM, Drew Farris <[email protected]> wrote: > Should be easy enough to add. > > From what I can tell hadoop's DynamicBloomFilter and hbase's > DynamicByteBloomFilter have similar origins but have diverged a bit. I > haven't had time to do anything but skim them at this point, does anyone > else have a sense as to which would be better to use? > > > http://svn.apache.org/viewvc/hbase/trunk/src/main/java/org/apache/hadoop/hbase/util/DynamicByteBloomFilter.java?view=markup > > > http://svn.apache.org/viewvc/hadoop/common/trunk/src/java/org/apache/hadoop/util/bloom/DynamicBloomFilter.java?view=markup > > > On Thu, May 27, 2010 at 3:25 PM, Jake Mannix <[email protected]> > wrote: > > > Now that we talk about it, it would totally make sense for the > CollocDriver > > to optionally spit out a (serialized) BloomFilter at the end of its > > processing. You can even do it in parallel and then OR the separate > pieces > > together... > > > > -jake > > > > On May 27, 2010 12:09 PM, "Drew Farris" <[email protected]> wrote: > > > > On Thu, May 27, 2010 at 2:59 PM, Jake Mannix <[email protected]> > > wrote: > > > Ditto this. I though... > > Not that I know of. > > > > There are a couple implementations in hbase too, not sure how similar > these > > are to the one in hadoop: > > > > > > > http://svn.apache.org/repos/asf/hbase/trunk/src/main/java/org/apache/hadoop/hbase/util/ > > > > ByteBloomFilter and DynamicByteBloomFilter > > >
