Deleting data from bitcask backend

2013-09-16 Thread Charl Matthee
Hi, We have a 8-node riak v1.4.0 cluster writing data to bitcask backends. We've recently started running out of disk across all nodes and so implemented a 30-day sliding window data retention policy. This policy is enforced by a go app that concurrently deletes documents outside the window.

Re: Deleting data from bitcask backend

2013-09-16 Thread Alex Moore
Hi Charl, The problem is that even though documents seem to no longer be  available (doing a GET on a deleted document returns an expected 404)  the disk usage is not seeming reducing much and has currently been at  ~80% utilisation across all nodes for almost a week.  When you delete a document,

Re: Deleting data from bitcask backend

2013-09-16 Thread Evan Vigil-McClanahan
riak-admin vnode-status can be used to get information about the number of bitcask files, their fragmentation and dead bytes, but since it uses a lot of blocking vnode commands, it can spike latencies, so should only be used off-peak. On Mon, Sep 16, 2013 at 7:36 AM, Alex Moore amo...@basho.com

Re: Deleting data from bitcask backend

2013-09-16 Thread Alex Moore
Hey Charl,Thanks for the logs and the config. I do see bitcask merges occurring in your console.log, so it's not stuck.I would recommend running "riak-admin vnode-status" during an off-peak time like Evan mentioned, that way we can see what your dead bytes/fragmentation levels look like. This will

error starting risk 1.4.2 from prebuilt distro for MacOS

2013-09-16 Thread Roman Shestakov
hello, I am trying to run pre-built Riak 1.4.2 distribution for Mac OS but getting errors on ./bin/riak start (Error reading /Users/romanshestakov/Development/riak-1.4.2/bin/../etc/app.config) here are the steps: rs:Development romanshestakov$ curl -O

error starting risk 1.4.2 from prebuilt distro for MacOS

2013-09-16 Thread Roman Shestakov
hello, I am trying to run pre-built Riak 1.4.2 distribution for Mac OS but getting errors on ./bin/riak start (Error reading /Users/romanshestakov/Development/riak-1.4.2/bin/../etc/app.config) here are the steps: rs:Development romanshestakov$ curl -O

error starting risk 1.4.2 from prebuilt distro for MacOS

2013-09-16 Thread Roman Shestakov
hello, I am trying to run pre-built Riak 1.4.2 distribution for Mac OS but getting errors on ./bin/riak start (Error reading /Users/romanshestakov/Development/riak-1.4.2/bin/../etc/app.config) here are the steps: rs:Development romanshestakov$ curl -O

Re: error starting risk 1.4.2 from prebuilt distro for MacOS

2013-09-16 Thread Christian Dahlqvist
Hi Roman, Can you please verify that your app.config file is correct and does not contain any errors by running `riak chkconfig`? Best regards, Christian On 15 Sep 2013, at 01:05, Roman Shestakov roman.shesta...@gmail.com wrote: hello, I am trying to run pre-built Riak 1.4.2