Re: Index interval tuning

2011-05-11 Thread Héctor Izquierdo Seliva
El mié, 11-05-2011 a las 14:24 +1200, aaron morton escribió: What version and what were the values for RecentBloomFilterFalsePositives and BloomFilterFalsePositives ? The bloom filter metrics are updated in SSTableReader.getPosition() the only slightly odd thing I can see is that we do not

Re: Index interval tuning

2011-05-11 Thread aaron morton
What are the values for RecentBloomFilterFalsePositives and BloomFilterFalsePositives the non ratio ones ? - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 11 May 2011, at 19:53, Héctor Izquierdo Seliva wrote: El mié, 11-05-2011 a las

Re: Index interval tuning

2011-05-11 Thread Héctor Izquierdo Seliva
Sorry aaron, here are the values you requested RecentBloomFilterFalsePositives = 5; BloomFilterFalsePositives = 385260; uptime of the node is three days and a half, more or less El mié, 11-05-2011 a las 22:05 +1200, aaron morton escribió: What are the values for

Re: Index interval tuning

2011-05-11 Thread Chris Burroughs
On 05/10/2011 10:24 PM, aaron morton wrote: What version and what were the values for RecentBloomFilterFalsePositives and BloomFilterFalsePositives ? The bloom filter metrics are updated in SSTableReader.getPosition() the only slightly odd thing I can see is that we do not count a key

Re: Index interval tuning

2011-05-11 Thread Jonathan Ellis
Close: the problem is we don't count *any* true positives *unless* cache is enabled. Fix attached to https://issues.apache.org/jira/browse/CASSANDRA-2637. On Wed, May 11, 2011 at 7:04 AM, Chris Burroughs chris.burrou...@gmail.com wrote: On 05/10/2011 10:24 PM, aaron morton wrote: What version

Re: Index interval tuning

2011-05-11 Thread aaron morton
Thanks A - Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 12 May 2011, at 03:44, Jonathan Ellis wrote: Close: the problem is we don't count *any* true positives *unless* cache is enabled. Fix attached to

Re: Index interval tuning

2011-05-10 Thread Peter Schuller
That reminds me, my false positive ration is stuck at 1.0, so I guess bloom filters aren't doing a lot for me. That sounds unlikely unless you're hitting some edge case like reading a particular row that happened to be a collision, and only that row. This is from JMX stats on the column family

Re: Index interval tuning

2011-05-10 Thread Chris Burroughs
On 05/10/2011 02:12 PM, Peter Schuller wrote: That reminds me, my false positive ration is stuck at 1.0, so I guess bloom filters aren't doing a lot for me. That sounds unlikely unless you're hitting some edge case like reading a particular row that happened to be a collision, and only that

Re: Index interval tuning

2011-05-10 Thread aaron morton
What version and what were the values for RecentBloomFilterFalsePositives and BloomFilterFalsePositives ? The bloom filter metrics are updated in SSTableReader.getPosition() the only slightly odd thing I can see is that we do not count a key cache hit a a true positive for the bloom filter. If

Index interval tuning

2011-05-09 Thread Héctor Izquierdo Seliva
Hi everyone. I have a few sstables with around 500 million keys, and memory usage has grown a lot, I suppose because of the indexes. This sstables are comprised of skinny rows, but a lot of them. Would tuning index interval make the memory usage go down? And what would the performance hit be? I

Re: Index interval tuning

2011-05-09 Thread Peter Schuller
I have a few sstables with around 500 million keys, and memory usage has grown a lot, I suppose because of the indexes. This sstables are comprised of skinny rows, but a lot of them. Would tuning index interval make the memory usage go down? And what would the performance hit be? Assuming no

Re: Index interval tuning

2011-05-09 Thread Héctor Izquierdo Seliva
El lun, 09-05-2011 a las 17:58 +0200, Peter Schuller escribió: I have a few sstables with around 500 million keys, and memory usage has grown a lot, I suppose because of the indexes. This sstables are comprised of skinny rows, but a lot of them. Would tuning index interval make the memory