Re: Memory usage continually increases with reads

2010-04-28 Thread Time Less
This sounds similar to /proc/sys/vm/swappiness misconfiguration. Is it zero or close to zero? If setting it 0 solves your problem, make sure all your nodes get this: /etc/sysctl.conf: vm.swappiness=0 On Wed, Apr 28, 2010 at 12:12 PM, Kyusik Chung kyu...@discovereads.comwrote: Hello. I am

Re: Worst case #iops to read a row

2010-04-13 Thread Time Less
If I have 10B rows in my CF, and I can fit 10k rows per SStable, and the SStables are spread across 5 nodes, and I have 1 bloom filter false positive and 1 tombstone and ask the wrong node for the key, then: Mv = (((2B/10k)+1+1)*3)+1 == ((200,000)+2)*3+1 == 300,007 iops to read a key.

Re: Worst case #iops to read a row

2010-04-12 Thread Time Less
What if we have 10B rows in the column family? What sort of index do you use that would only require one iop to find the row index block? basically what is described in sections 5.3 and 5.4 here: http://labs.google.com/papers/bigtable.html Incorrect. Section 4 of the paper describes the