Re: Zookeeper does not clean up deleted nodes

2013-04-08 Thread Benjamin Reed
are you looking at the leader or the follower? the leader keeps the last few transactions in memory to speed up syncing with new followers. that might be what you are seeing. On Mon, Apr 8, 2013 at 3:32 AM, Mathias Hodler mathias.hod...@gmail.comwrote: Hi, I made some tests and it seems like

Re: Zookeeper does not clean up deleted nodes

2013-04-08 Thread Henry Robinson
As Ben says, this is a feature, not a bug. However, the memory usage is still excessive; see this jira: https://issues.apache.org/jira/browse/ZOOKEEPER-1473 Henry On 8 April 2013 09:31, Benjamin Reed br...@apache.org wrote: are you looking at the leader or the follower? the leader keeps the

Re: Zookeeper does not clean up deleted nodes

2013-04-08 Thread Mathias Hodler
Thanks, this could be the reason. I only used a single zookeeper server, so it should act as a leader. So if I need to store larger files (about 1MB) the only option is to increase the heap space? I know that zookeeper is designed for small files, but I'm using zookeeper with solr and solr stores

Re: Zookeeper does not clean up deleted nodes

2013-04-08 Thread Benjamin Reed
it would be very simple to make that 500 configurable. you should propose a change. On Mon, Apr 8, 2013 at 9:40 AM, Mathias Hodler mathias.hod...@gmail.comwrote: Thanks, this could be the reason. I only used a single zookeeper server, so it should act as a leader. So if I need to store

Re: Zookeeper does not clean up deleted nodes

2013-04-08 Thread Mathias Hodler
I created a new issue https://issues.apache.org/jira/browse/ZOOKEEPER-1687 2013/4/8 Benjamin Reed br...@apache.org it would be very simple to make that 500 configurable. you should propose a change. On Mon, Apr 8, 2013 at 9:40 AM, Mathias Hodler mathias.hod...@gmail.com wrote: Thanks,