Hi,
we're using Riak 1.3.1 with a Bitcask storage engine on a 4 node cluster.
Properties of the bucket used:
{"props":{"allow_mult":false,"
basic_quorum":false,"big_vclock":50,"chash_keyfun":{"mod":"riak_core_util","fun":"chash_std_keyfun"},"dw":"quorum","last_write_wins":false,"linkfun":{"mod":"riak_kv_wm_link_walker","fun":"mapreduce_linkfun"},"n_val":2,"name":"c","notfound_ok":true,"old_vclock":86400,"postcommit":[],"pr":0,"precommit":[],"pw":0,"r":"one","rw":"quorum","small_vclock":50,"w":"one","young_vclock":20}}
3 nodes crashed today morning almost simultaneously, fourth node had
crashed earlier this nignt. It's hard to figure out the reason of the crash
looking into the logs, but I suppose this is due to insufficient RAM
available on the servers (this maillist doesn't like big attachments but I
can send logs if it will help).
Actually, I'm dealing with Riak memory usage for some time already. Some
time ago I figured out that memory usage is much more than it is promised
in the documentation (
http://riak-users.197444.n3.nabble.com/memory-consumption-td4028674.html).
After that I tried to reduce number of keys stored, changing the
expiry_secs setting from 2 months to 1 month. I expected the memory usage
to drop in half because new keys are put into Riak at a approximately same
rate for last two months and Bitcask stores all keys in memory. But that
didn't happen. Memory usage have dropped a little but grew again in a few
days.
So the questions are:
* is there a cheap way to figure out the number of keys stored in a bucket?
* how long does it take to purge old keys from the storage?
* is it possible to see how many keys were expired for the last
minute/hour/day?
* are there some other ways to reduce memory usage I'm missing except for
adding new servers?
Thanks in advance.
_______________________________________________
riak-users mailing list
[email protected]
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
