Re: ZkClient package

2010-07-14 Thread Thomas Koch
Jun Rao: > Hi, > > ZkClient (http://github.com/sgroschupf/zkclient) provides a nice wrapper > around the ZooKeeper client and handles things like retry during > ConnectionLoss events, and auto reconnect. Does anyone (other than Katta) > use it? Would people recommend using it? Thanks, > > Jun Hi

Re: building client tools

2010-07-14 Thread Martin Waite
Hi Andrei, I needed to install the following: apt-get install libtool autoconf libcppunit-dev There could well be other packages that were already installed on my machine (automake, gcc etc), but my build works now. I have since found that zookeeper is already packaged in debian testing, and

Re: building client tools

2010-07-14 Thread Martin Waite
Hi Sergey, I ran apt-get install libcppunit-dev - this pulled in libcppunit-1.12-1 automatically. Thanks for the help. regards, Martin On 13 July 2010 18:47, Sergey Doroshenko wrote: > Andrei is right. Also, libcppunit-dev might be neeeded too. > "sudo apt-get install libcppunit-1.12-1 libcpp

Re: building client tools

2010-07-14 Thread Martin Waite
Hi Mahadev, The suggestions from Sergey and Andrei have fixed this for me. regards, Martin On 13 July 2010 19:11, Mahadev Konar wrote: > Hi Martin, > There is a list of tools, i.e cppunit. That is the only required tool to > build the zookeeper c library. The readme says that it can be done w

unit test failure

2010-07-14 Thread Martin Waite
Hi, I am attempting to build the C client on debian lenny. autoconf, configure, make and make install all appear to work cleanly. I ran: autoreconf -if ./configure make make install make run-check However, the unit tests fail: $ make run-check make zktest-st zktest-mt make[1]: Entering direc

Re: unit test failure

2010-07-14 Thread Mahadev Konar
HI Martin, Can you check if you have a stale java process (ZooKeeperServer) running on your machine? That might cause some issues with the tests. Thanks mahadev On 7/14/10 8:03 AM, "Martin Waite" wrote: > Hi, > > I am attempting to build the C client on debian lenny. > > autoconf, config

Re: ZkClient package

2010-07-14 Thread Adam Rosien
Thomas - I like the ideas of your proposal, it seems very natural to use Callable/Future for zk operations rather than something with more opaque semantics (does this method block? etc.). Let's discuss this more, I'd be more than happy to help out. We're still using 3.2.1 so I'll probably have to

What does this exception mean?

2010-07-14 Thread Avinash Lakshman
Hi All I run into this periodically. I am curious to know what this means, why would this happen and how am I to react to it programmatically. org.apache.thrift.TException: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /Config/Stats/count

Achieving quorum with only half of the nodes

2010-07-14 Thread Sergei Babovich
Hi, We are currently evaluating use of ZK in our infrastructure. In our setup we have a set of servers running from two different power feeds. If one power feed goes away so does half of the servers. This makes problematic to configure ZK ensemble that would tolerate such outage. The network p

Errors with Python bindings

2010-07-14 Thread Rich Schumacher
I'm running a Tornado webserver and using ZooKeeper to store some metadata and occasionally the ZooKeeper connection will error out irrevocably. Any subsequent calls to ZooKeeper from this process will result in a SystemError. Here is the relevant portion of the Python traceback: ... File "

Re: What does this exception mean?

2010-07-14 Thread Benjamin Reed
that means that your connection to zookeeper has broken. usually because the server you were connected to failed. see http://wiki.apache.org/hadoop/ZooKeeper/ErrorHandling ben On 07/14/2010 11:41 AM, Avinash Lakshman wrote: Hi All I run into this periodically. I am curious to know what this

Re: Achieving quorum with only half of the nodes

2010-07-14 Thread Benjamin Reed
by custom QuorumVerifier are you referring to http://hadoop.apache.org/zookeeper/docs/r3.3.1/zookeeperHierarchicalQuorums.html ? ben On 07/14/2010 12:43 PM, Sergei Babovich wrote: Hi, We are currently evaluating use of ZK in our infrastructure. In our setup we have a set of servers running fr

Re: Achieving quorum with only half of the nodes

2010-07-14 Thread Flavio Junqueira
Hi Sergei, I'm not sure what the implementation of QuorumVerifier you have in mind would look like to make your setting work. Even if you don't have partitions, variation in message delays can cause inconsistencies in your ZooKeeper cluster. Keep in mind that we make the assumption that quorums int

Re: Achieving quorum with only half of the nodes

2010-07-14 Thread Sergei Babovich
Just another implementation of QuorumVerifier (based on existing implementation: either majority or hierarchical quorums). Probably hierarchical quorum is simplest to adjust - it already has notion of groups, etc. On 07/14/2010 04:46 PM, Benjamin Reed wrote: by custom QuorumVerifier are you r

Re: Achieving quorum with only half of the nodes

2010-07-14 Thread Sergei Babovich
Thanks, Flavio, Yep... I see. This is a problem. Any better idea? As an alternative option we could probably consider running single ZK node on EC2 - only in order to handle this specific case. Does it make sense to you? Is it feasible? Would it result in considerable performance impact due to

Re: Achieving quorum with only half of the nodes

2010-07-14 Thread Ted Dunning
On Wed, Jul 14, 2010 at 2:16 PM, Sergei Babovich wrote: > Yep... I see. This is a problem. Any better idea? > I think that the production of slightly elaborate quorum rules to handle specific failure modes isn't a reasonable thing. What you need to do in conjunction is to estimate likelihoods of

Re: Errors with Python bindings

2010-07-14 Thread Henry Robinson
Hi Rich - No, there's not a very easy way to verify the Python bindings version afaik - would be a useful feature to have though. My first suggestion is to move to the bindings shipped with 3.3.1 - we fixed a lot of problems with the Python bindings which improved their stability a lot. Could you