Apart from the autopurge options, also set the number of transactions after which a snapshot is taken (snapCount). This number should be set depending on the rate of updates to zookeeper.
On Wed, May 28, 2014 at 12:32 AM, Danijel Schiavuzzi <[email protected] > wrote: > You have to configure ZooKeeper to automatically purge old logs. > ZooKeeper's logs tend to grow very quickly in size, so you should enable > the autopurge option in zoo.cfg or they will eat your available disk > space. I suggest you read ZooKeeper's Installation And Maintainance Guide. > > > On Tuesday, May 27, 2014, Andres Gomez <[email protected]> wrote: > >> Hi all, >> >> I use storm with kafka! Actually, I use a topology with trident storm = >> when I use: >> >> 1- trasactional trident spout >> 2- Some functions >> >> I have a problem in my zookeeper cluster, because storm continually = >> writes at zkPath --> /trasactional/ and this generate a lot of logs and = >> snapshot by which the disk fills up quickly! I see the logs and i can = >> see that storm writes the state of transactional spout (commit of offset = >> of kafka).=20 >> >> Do you have a similar problem? Do you know how I could fix it? Is there = >> any way to write less frequently in zookeeper? >> >> >> Regards, >> >> Andres >> > > > -- > Danijel Schiavuzzi > > E: [email protected] > W: www.schiavuzzi.com > T: +385989035562 > Skype: danijels7 >
