c client on win32

2009-11-20 Thread Maarten Koopmans
Hi, Has anybody managed to get the c client / dll compiled on Win32, and if so, how? I did a quick pass with MunGW and Cygwin, and they failed horribly. I'd like to load the DLL to bind it to a scripting language on windows as well. Thanks, Maarten

Re: c client on win32

2009-11-20 Thread Maarten Koopmans
patches we'd be happy to work with you to achieve. Regards, Patrick Maarten Koopmans wrote: Patrick, I'll stick to the Java API - the C API feels to much of a second class citizen. Besides, I think we might wnat to try with the beta of Cygwin first before filing it in Jira. Ultimately

legacy style watchers - or none at all

2009-11-23 Thread Maarten Koopmans
Hi, I am coding away on yet another client interface, and I can live in a situation where I have no watchers. Callbacks into my interpreter are a bit risky as well, so I am opting for the legacy style now, wrapping the c interface in such a way that it never allows watchers on paths (and

Re: c client on win32

2009-11-24 Thread Maarten Koopmans
/ZOOKEEPER-586 Maarten Koopmans wrote: Hi, Has anybody managed to get the c client / dll compiled on Win32, and if so, how? I did a quick pass with MunGW and Cygwin, and they failed horribly. I'd like to load the DLL to bind it to a scripting language on windows as well. Thanks, Maarten Geen

Re: c client on win32

2009-11-24 Thread Maarten Koopmans
Hm, seems like my cygwin on Win7 fails me. I get a crash on checking the static flag for g++ in configure in 3.2.1 Weird. Maarten Koopmans schreef: I applied the patch to the trunk, but somehow autoconf fails on the fresh checkout (or my brain fails me, more likely ;-) What do you do

Re: c client on win32

2009-11-24 Thread Maarten Koopmans
. Is cygwin officially supported on win7? 32 or 64bit? (i'm 32bit) (ps. let's move followups to zookeeper-dev and off the user list) Regards, Patrick Maarten Koopmans wrote: Hm, seems like my cygwin on Win7 fails me. I get a crash on checking the static flag for g++ in configure in 3.2.1 Weird

zkfuse

2009-11-24 Thread Maarten Koopmans
Hi, I just started using zkfuse, and this may very well suit my needs for now. Thumbs up to the ZooKeeper team! What operations are supported (i.e. what is the best use of zkfuse). I can see how files, dirs there creation and listing map quite nicely. ACLs? I have noticed two things on a

Re: zkfuse

2009-11-24 Thread Maarten Koopmans
Hi Mahadev, Quite simple: it will function as the locking/versioning back end for a custom WebDAV daemon (that stores its data in an internal cloud, i.e. Eucalyptus/Walrus). So a user joe that has a file /foo/bar would translate to: /(sha1(joe))/foo/bar - file bar

total # of zknodes

2010-07-15 Thread Maarten Koopmans
Hi, I am mapping a filesystem to ZooKeeper, and use it for locking and mapping a filesystem namespace to a flat data object space (like S3). So assuming proper nesting and small ZooKeeper nodes ( 1KB), how many nodes could a cluster with a few GBs of memory per instance realistically hold

Re: total # of zknodes

2010-07-15 Thread Maarten Koopmans
to read it over the network, so you will need to adjust your initLimit accordingly. of course this is all back-of-the-envelope. i would suggest doing some quick benchmarks to test and make sure your results are in line with expectation. ben On 07/15/2010 02:56 AM, Maarten Koopmans wrote

node symlinks

2010-07-24 Thread Maarten Koopmans
Hi, I have a number of nodes that will grow larger than one cluster can hold, so I am looking for a way to efficiently stack clusters. One way is to have a zookeeper node symlink to another cluster. Has anybody ever done that and some tips, or alternative approaches? Currently I use Scala,

total # nodes

2010-07-24 Thread Maarten Koopmans
Hi, Relating to the previous question: is there a quick way to get the total # nodes in a Zookeeper cluster (so I can determine utilization)? Best, Maarten

Re: node symlinks

2010-07-26 Thread Maarten Koopmans
Hi Mahadev, My use is mapping a flat object store (like S3) to a filesystem and opening it up via WebDAV. So Zookeeper mirror the filesystem (each node corresponds to a collection or a file), and is used for locking and provides the pointer to the actual data object in e.g. S3 A symlink

Re: node symlinks

2010-07-26 Thread Maarten Koopmans
Ted, Thanks for you thinking along with me, your line of thought is what I originally had in mind, but I have some boundary conditions that I think make things subtly different. I am curious as to what you think. First, I think your numbers are right. Even so, every multiple of that number

Closing a client fails

2010-08-24 Thread Maarten Koopmans
Hi, I am using the Zookeeper Java client class from Scala for some synchronous communication (no watches, no async). Fairly simple. Every now and then my application needs to use ZK and then creates a client, does its thing, and closes the client. What happens though is that I keep having

Size of a znode in memory

2010-08-25 Thread Maarten Koopmans
Hi, Is there a way to know/measure the size of a znode? My average znode has a name of 32 bytes and user data of max 128 bytes. Or is the only way to run a smoke test and watch the heap growth via jconsole or so? Thanks, Maarten

Zookeeper on 60+Gb mem

2010-10-05 Thread Maarten Koopmans
Hi, I just wondered: has anybody ever ran zookeeper to the max on a 68GB quadruple extra large high memory EC2 instance? With, say, 60GB allocated or so? Because EC2 with EBS is a nice way to grow your zookeeper cluster (data on the ebs columes, upgrade as your memory utilization grows) -

Re: Zookeeper on 60+Gb mem

2010-10-05 Thread Maarten Koopmans
...@apache.org het volgende geschreven: Tuning GC is going to be critical, otw all the sessions will timeout (and potentially expire) during GC pauses. Patrick On Tue, Oct 5, 2010 at 1:18 PM, Maarten Koopmans maar...@vrijheid.netwrote: Yes, and syncing after a crash will be interesting

Re: Zookeeper on 60+Gb mem

2010-10-05 Thread Maarten Koopmans
, Patrick Hunt ph...@apache.org wrote: Tuning GC is going to be critical, otw all the sessions will timeout (and potentially expire) during GC pauses. Patrick On Tue, Oct 5, 2010 at 1:18 PM, Maarten Koopmans maar...@vrijheid.netwrote: Yes, and syncing after a crash will be interesting as well