Re: version of zookeeper

2012-11-13 Thread Neha Narkhede
Thanks for pulling up that list Jason ! I think that makes sense and we can experiment with ZK 3.3.5. Not sure how widely 3.3.6 is tested though. Regarding the 3.4.x stability, the fact that serious issues are still being reported makes me uncomfortable - https://issues.apache.org/jira/browse/ZOO

Re: version of zookeeper

2012-11-13 Thread Jason Rosenberg
According to the zookeeper home page, the current stable releases are "3.3.6" and "3.4.4". There seem to be a few interesting bug fixes in the release notes for 3.3.5 & 3.3.6: http://zookeeper.apache.org/doc/r3.3.5/releasenotes.html#changes http://zookeeper.apache.org/doc/r3.3.6/releasenotes.html#

Re: version of zookeeper

2012-11-13 Thread Neha Narkhede
> So, there are known api changes that would preclude use of 3.4.x with > kafka, it sounds like? Not really. Zookeeper 3.4.x is backwards compatible. Kafka 0.8 should still work with any of the stable zookeeper versions out there. Once ZK 3.4.x is stable, Kafka 0.8 would certainly benefit from the

Re: version of zookeeper

2012-11-13 Thread Jason Rosenberg
If you do ./sbt make-pom, it generates a pom with the version set to 3.3.4. And I do think that is the current version (if you look at the release notes, I think for 0.7.1, it mentions that one of the changes is to upgrade to 3.3.4 zookeeper client). Jason On Tue, Nov 13, 2012 at 12:38 PM, Josep

Re: version of zookeeper

2012-11-13 Thread Jason Rosenberg
Ok, So, there are known api changes that would preclude use of 3.4.x with kafka, it sounds like? Is there a notion of a supported version of zookeeper for each kafka release? How about upgrading the recommended version for 0.8 at least to the latest 3.3.x (3.3.6)? Jason On Tue, Nov 13, 2012

Re: version of zookeeper

2012-11-13 Thread Neha Narkhede
I've been observing the zookeeper mailing list for 3.4.x and haven't found it to be particularly stable. There are still serious issues being reported like leader election failures, ephemeral node deletion. I'm sure they are being fixed and there are many early adopters. But my guess is that we sho

Re: version of zookeeper

2012-11-13 Thread Jun Rao
Jason, We are just not sure about the stability of ZK 3.4.4. Does anybody know? In fact, some of the features in ZK 3.4.x (like the multi operation) can improve the availability of Kafka in 0.8. So, we'd like to move to ZK 3.4.4 if it's been widely used and is stable. Thanks, Jun On Mon, Nov 12

Re: version of zookeeper

2012-11-13 Thread David Arthur
The ZooKeeper API has been stable for a while, I do not suspect there would be any problems between 3.3.4 and 3.4.x. Personally, I have run Kafka 0.7.x with ZooKeeper 3.4.3 with no problems -David On Nov 13, 2012, at 2:30 AM, Jason Rosenberg wrote: > Hi, > > I'm wondering if there's a reason