Re: Problem with ZK log files and snapshots

2018-07-18 Thread Jostein Elvaker Haande
On Wed, 18 Jul 2018 at 12:28, Norbert Kalmar wrote: > Hi, > > You should use PurgeTxnLog as per > https://zookeeper.apache.org/doc/r3.4.8/zookeeperAdmin.html#sc_maintenance > It needs 3 parameters: txn log dir, smapshot dir and number of snaps/log to > keep (3 minimum!) > Hi, I'm well aware of

Re: Problem with ZK log files and snapshots

2018-07-18 Thread Norbert Kalmar
Hi, You should use PurgeTxnLog as per https://zookeeper.apache.org/doc/r3.4.8/zookeeperAdmin.html#sc_maintenance It needs 3 parameters: txn log dir, smapshot dir and number of snaps/log to keep (3 minimum!) Example: java -cp

Re: Problem with ZK log files and snapshots

2018-07-18 Thread Jostein Elvaker Haande
Another thing I can't make heads or tails of, is whether or not it's safe to delete these transaction logs and snapshots manually. If yes, should this be done while ZooKeeper is stopped? Some of my instances are consuming quite a bit of disk space because of this issue, and to keep increasing

Re: Problem with ZK log files and snapshots

2018-07-17 Thread Baskar Duraikannu
If your transactions are short lived (something like you are taking a lock and then releasing it), you will find that “containers” holding these locks are not cleaned by Zookeeper. This in turn will make snapshot files big and will cause all sorts of issues. I found myself in that situation few

Problem with ZK log files and snapshots

2018-07-16 Thread Jostein Elvaker Haande
Hello, I'm using ZooKeeper 3.4.12, and I'm facing an issue where the ZK log files keep up eating disk space. I'm running this on several machines, and the symptoms I'm seeing are the seem: - I see a lot of log files - Rarely, if ever any snapshot files I started digging into it, and from