Zookeeper on 60+Gb mem

Hi, I just wondered: has anybody ever ran zookeeper to the max on a 68GB quadruple extra large high memory EC2 instance? With, say, 60GB allocated or so? Because EC2 with EBS is a nice way to grow your zookeeper cluster (data on the ebs columes, upgrade as your memory utilization grows) -

Re: Zookeeper on 60+Gb mem

...@apache.org het volgende geschreven: Tuning GC is going to be critical, otw all the sessions will timeout (and potentially expire) during GC pauses. Patrick On Tue, Oct 5, 2010 at 1:18 PM, Maarten Koopmans maar...@vrijheid.netwrote: Yes, and syncing after a crash will be interesting

Re: Zookeeper on 60+Gb mem

, Patrick Hunt ph...@apache.org wrote: Tuning GC is going to be critical, otw all the sessions will timeout (and potentially expire) during GC pauses. Patrick On Tue, Oct 5, 2010 at 1:18 PM, Maarten Koopmans maar...@vrijheid.netwrote: Yes, and syncing after a crash will be interesting as well

Size of a znode in memory

Hi, Is there a way to know/measure the size of a znode? My average znode has a name of 32 bytes and user data of max 128 bytes. Or is the only way to run a smoke test and watch the heap growth via jconsole or so? Thanks, Maarten

Closing a client fails

Hi, I am using the Zookeeper Java client class from Scala for some synchronous communication (no watches, no async). Fairly simple. Every now and then my application needs to use ZK and then creates a client, does its thing, and closes the client. What happens though is that I keep having

Re: node symlinks

Hi Mahadev, My use is mapping a flat object store (like S3) to a filesystem and opening it up via WebDAV. So Zookeeper mirror the filesystem (each node corresponds to a collection or a file), and is used for locking and provides the pointer to the actual data object in e.g. S3 A symlink

Re: node symlinks

Ted, Thanks for you thinking along with me, your line of thought is what I originally had in mind, but I have some boundary conditions that I think make things subtly different. I am curious as to what you think. First, I think your numbers are right. Even so, every multiple of that number

total # nodes

Hi, Relating to the previous question: is there a quick way to get the total # nodes in a Zookeeper cluster (so I can determine utilization)? Best, Maarten

Re: total # of zknodes

to read it over the network, so you will need to adjust your initLimit accordingly. of course this is all back-of-the-envelope. i would suggest doing some quick benchmarks to test and make sure your results are in line with expectation. ben On 07/15/2010 02:56 AM, Maarten Koopmans wrote

Re: c client on win32

/ZOOKEEPER-586 Maarten Koopmans wrote: Hi, Has anybody managed to get the c client / dll compiled on Win32, and if so, how? I did a quick pass with MunGW and Cygwin, and they failed horribly. I'd like to load the DLL to bind it to a scripting language on windows as well. Thanks, Maarten Geen

Re: c client on win32

Hm, seems like my cygwin on Win7 fails me. I get a crash on checking the static flag for g++ in configure in 3.2.1 Weird. Maarten Koopmans schreef: I applied the patch to the trunk, but somehow autoconf fails on the fresh checkout (or my brain fails me, more likely ;-) What do you do

Re: c client on win32

. Is cygwin officially supported on win7? 32 or 64bit? (i'm 32bit) (ps. let's move followups to zookeeper-dev and off the user list) Regards, Patrick Maarten Koopmans wrote: Hm, seems like my cygwin on Win7 fails me. I get a crash on checking the static flag for g++ in configure in 3.2.1 Weird

zkfuse

Hi, I just started using zkfuse, and this may very well suit my needs for now. Thumbs up to the ZooKeeper team! What operations are supported (i.e. what is the best use of zkfuse). I can see how files, dirs there creation and listing map quite nicely. ACLs? I have noticed two things on a

legacy style watchers - or none at all

Hi, I am coding away on yet another client interface, and I can live in a situation where I have no watchers. Callbacks into my interpreter are a bit risky as well, so I am opting for the legacy style now, wrapping the c interface in such a way that it never allows watchers on paths (and

c client on win32

Hi, Has anybody managed to get the c client / dll compiled on Win32, and if so, how? I did a quick pass with MunGW and Cygwin, and they failed horribly. I'd like to load the DLL to bind it to a scripting language on windows as well. Thanks, Maarten

Re: c client on win32

patches we'd be happy to work with you to achieve. Regards, Patrick Maarten Koopmans wrote: Patrick, I'll stick to the Java API - the C API feels to much of a second class citizen. Besides, I think we might wnat to try with the beta of Cygwin first before filing it in Jira. Ultimately