BloomFilter is not redundant, because it stores information about _all_ keys while the index summary stores every 1/128 key.
On Tue, May 4, 2010 at 3:47 PM, Weijun Li <[email protected]> wrote: > Hello, > > We stored about 47mil keys in one Cassandra node and what a memory dump > shows for one of the SStableReader: > > SSTableReader: 386MB. Among this 386MB, IndexSummary takes about 231MB > but BloomFilter takes 155MB with an embedded huge array long[19.4mil]. > > It seems that BloomFilter is taking too much memory. If this is the case > BloomFilter seems to be redundant comparing to the size of index. > > So is this desired behavior? Is there a formula to estimate the size of > needed memory for BloomFilter? > > Thanks, > > -Weijun > > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com
