Re: [Release 3.5.0] Any news yet?

2013-07-10 Thread Mahadev Konar
1147 is pretty close. I am working on getting this into trunk. Hopefully today/tomm. thanks mahadev On Wed, Jul 10, 2013 at 7:01 AM, Flavio Junqueira fpjunque...@yahoo.com wrote: I've also been wondering about 3.4.6. I don't mind being the RM for 3.5.0 if you want to do 3.4.6. -Flavio On

Re: Subject: [ANNOUNCE] Apache ZooKeeper 3.4.5

2012-11-19 Thread Mahadev Konar
On Nov 18, 2012, at 5:15 PM, Mahadev Konar maha...@hortonworks.com wrote: Also, I have published the artifacts to maven. Do let me know if you see any issues with that. thanks mahadev On Sun, Nov 18, 2012 at 5:09 PM, Mahadev Konar maha...@hortonworks.com wrote: Please ignore the subject

Subject: [ANNOUNCE] Apache ZooKeeper 3.4.5

2012-11-18 Thread Mahadev Konar
The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.5 ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

Re: Subject: [ANNOUNCE] Apache ZooKeeper 3.4.5

2012-11-18 Thread Mahadev Konar
Please ignore the subject in the subject. Too much copy paste :). thanks mahadev On Sun, Nov 18, 2012 at 5:06 PM, Mahadev Konar maha...@hortonworks.com wrote: The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.5 ZooKeeper is a high-performance coordination service

Re: Subject: [ANNOUNCE] Apache ZooKeeper 3.4.5

2012-11-18 Thread Mahadev Konar
Also, I have published the artifacts to maven. Do let me know if you see any issues with that. thanks mahadev On Sun, Nov 18, 2012 at 5:09 PM, Mahadev Konar maha...@hortonworks.com wrote: Please ignore the subject in the subject. Too much copy paste :). thanks mahadev On Sun, Nov 18

Re: ZOOKEEPER-1437

2012-10-14 Thread Mahadev Konar
Thanks Jordan/Hanno, The release is on hold give a couple of more bugs that were found in 3.4.4/3.4.5-rc0. If you want to go ahead and try 3.4.5 to verify if the issue that you reported is fixed that would be great Jordan, else we can wait for the new RC/release. thanks mahadev On Sun, Oct 14,

Re: ZOOKEEPER-1437

2012-10-14 Thread Mahadev Konar
Thanks Jordan! That helps a lot :). mahadev On Sun, Oct 14, 2012 at 4:53 PM, Jordan Zimmerman jor...@jordanzimmerman.com wrote: Scratch that - I just did a quickie test by overwriting the JAR directly with Mahadev's RC on one of my instances. It fixes my problem. So, hopefully that can help

Re: SASL problem with 3.4.4 Java client

2012-09-26 Thread Mahadev Konar
, 2012 at 10:05 PM, Mahadev Konar maha...@hortonworks.com wrote: Thanks for point this out JL and Robert. We have a jira for this https://issues.apache.org/jira/browse/ZOOKEEPER-1477 and we will be doing a 3.4.5 ASAP to address this. thanks mahadev On Tue, Sep 25, 2012 at 3:37 PM, JL julio.lo

Re: SASL problem with 3.4.4 Java client

2012-09-26 Thread Mahadev Konar
Hi Robert, Thanks for digging. The explanation makes sense. Can you please open a jira with the details? thanks mahadev On Wed, Sep 26, 2012 at 6:38 AM, Robert Macomber xbz...@rojoma.com wrote: On 2012-09-26, Mahadev Konar maha...@hortonworks.com wrote: Thanks for point this out JL and Robert

Re: Subject: [ANNOUNCE] Apache ZooKeeper 3.4.4

2012-09-24 Thread Mahadev Konar
Please ignore the Subject: tag! Bad copy paste from my side :). mahadev On Sun, Sep 23, 2012 at 11:57 PM, Mahadev Konar maha...@hortonworks.com wrote: The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.4. ZooKeeper is a high-performance coordination service

Re: Is it possible that follower still hold uncommitted data after truncating and reloading?

2012-09-05 Thread Mahadev Konar
Mingyuan, No that should not happen. In case that happens its a bug. thanks mahadev On Tue, Sep 4, 2012 at 9:27 PM, anmingyuan anmingy...@gmail.com wrote: Is it possible that follower still hold uncommitted data after truncating and reloading? ZKDatabase.loadDataBase() loads data from the

Re: Session refused, zxid too high

2012-08-31 Thread Mahadev Konar
Nice debugging Pat! Really interesting! :) thanks mahadev On Fri, Aug 31, 2012 at 3:12 PM, Patrick Hunt ph...@apache.org wrote: This is interesting, if you convert 0x636c65616e2d7374 to ascii you get clean-st. Looks like memory corruption to me. Patrick On Fri, Aug 31, 2012 at 1:34 PM,

Re: dont receive emails from mailinglist anymore

2012-06-29 Thread Mahadev Konar
HI Kim, You can subscribe using: http://zookeeper.apache.org/lists.html thanks mahadev On Fri, Jun 29, 2012 at 2:36 AM, kim young ill khi...@googlemail.com wrote: hi there, since a while i dont receive any email from mailinglist anymore ? what should i do ? dont find a place where i can

Re: forceSync=no

2012-06-15 Thread Mahadev Konar
Raj, Are you seeing any perf improvements by using that setting? I had run some benchmarks and didnt find much improvement even if I did forceSync = no. thanks mahadev On Fri, Jun 15, 2012 at 12:45 PM, Raj N raj.cassan...@gmail.com wrote: Thanks Patrick. So back to my original question. Will

ZooKeeper Meetup.

2012-06-11 Thread Mahadev Konar
HI folks, Apologize for the late notice, we are organizing a ZK meetup before the Summit. Ill post an agenda by tomorrow. Hopefully you can make it and we can have a healthy/useful discussion at the meetup. Here is the link: http://www.meetup.com/zookeeperusergroup/events/67732652/ thanks

Re: [ANNOUNCE] Apache ZooKeeper 3.4.3.

2012-02-14 Thread Mahadev Konar
? Mahadev Konar Hortonworks Inc. http://hortonworks.com/ On Tue, Feb 14, 2012 at 1:54 AM, Mekaraj, Prashant prashant.meka...@morganstanley.com wrote: Hi, Thanks for the release. Can we consider 3.4 out of beta now or do you recommend we wait further ? Regards, -prashant -Original Message

[ANNOUNCE] Apache ZooKeeper 3.4.3.

2012-02-13 Thread Mahadev Konar
The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.3. ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

ZooKeeper User Group Meetup.

2012-02-10 Thread Mahadev Konar
Hi folks, There have been some changes to the Meetup location. Please take a look at : http://www.meetup.com/zookeeperusergroup/events/49372662/ The address has changed to 4401 Great America Pkwy, Santa Clara, CA ( 1GA building). Sorry abt the confusion. -- Mahadev Konar Hortonworks Inc

Re: ZooKeeper Memory Usage

2012-02-09 Thread Mahadev Konar
that? -- -- Mike Mike Schilli m...@perlmeister.com -- Mahadev Konar Hortonworks Inc. http://hortonworks.com/

Re: ZK Meetup on Friday/Feb 10th.

2012-02-05 Thread Mahadev Konar
Forgot to send the link :): http://www.meetup.com/zookeeperusergroup/events/49372662/ On Sun, Feb 5, 2012 at 10:52 PM, Mahadev Konar maha...@hortonworks.com wrote: Hi folks,  Thanks to Ben we have some spots available at the meetup. I have also updated the agenda with some details. Also

Re: getting the server version from a java client

2012-01-30 Thread Mahadev Konar
was hoping for something like KeeperException.UnimplementedException, but it's not the case). Thanks in advance for your help, N. -- Mahadev Konar Hortonworks Inc. http://hortonworks.com/

Re: getting the server version from a java client

2012-01-30 Thread Mahadev Konar
be less environment dependent as well. Do you want me to create a JIRA for it? Cheers, N. On Mon, Jan 30, 2012 at 7:12 PM, Patrick Hunt ph...@apache.org wrote: +1, that would be a good api addition. On Mon, Jan 30, 2012 at 10:10 AM, Mahadev Konar maha...@hortonworks.com wrote: Keywal

ZooKeeper User Group and upcoming meetup.

2012-01-23 Thread Mahadev Konar
Hi folks, As discussed on the list, we had talked about having regular meetups for users and devs where we could talk about user issues, roadmaps and releases. We will be hosting our first user group meetup at Yahoo! (thanks to Ben) on Feb 10. The details are still under works but here is the

Re: Re: can we remove zookeeper-3.4.2/contrib directory?

2012-01-13 Thread Mahadev Konar
in contrib directory. At 2012-01-12 14:44:44,Mahadev Konar maha...@hortonworks.com wrote: Lynn, Its used for the non mainline contributions like python/perl bindings and others. You should be able to delete the contrib directory if you just using mainline ZK. May I ask why do you want to delete

Re: can we remove zookeeper-3.4.2/contrib directory?

2012-01-11 Thread Mahadev Konar
Lynn, Its used for the non mainline contributions like python/perl bindings and others. You should be able to delete the contrib directory if you just using mainline ZK. May I ask why do you want to delete the contrib dir? mahadev 2012/1/11 lulynn_2008 lulynn_2...@163.com:  Hello, What is

Re: zoo.cfg Server ID

2012-01-04 Thread Mahadev Konar
Hi Jordan,  From admin guide: The myid file consists of a single line containing only the text of that machine's id. So myid of server 1 would contain the text 1 and nothing else. The id must be unique within the ensemble and should have a value between 1 and 255

[ANNOUNCE] Apache ZooKeeper 3.4.2

2011-12-29 Thread Mahadev Konar
Hi all, The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.2 ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple

Re: NullPointerException in FileTxnsnapLog.processTransaction (ZK 3.4.1)

2011-12-19 Thread Mahadev Konar
Thanks Andrew. This seems like a blocker. Waiting for the patch :). thanks mahadev On Mon, Dec 19, 2011 at 5:28 PM, Andrew McNair andrew.mcn...@gmail.comwrote: Sorry, I'd missed this message. I just created ZOOKEEPER-1333 for the same issue. -Andrew On Mon, Dec 19, 2011 at 2:48 PM,

[ANNOUNCE] Apache ZooKeeper 3.4.1

2011-12-16 Thread Mahadev Konar
The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.1 ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

Re: Running zookeeper on multiple EC2 instances

2011-12-14 Thread Mahadev Konar
Aniket, Do keep us posted on the results. It would be interesting to learn from your findings. thanks mahadev On Wed, Dec 14, 2011 at 10:54 PM, Aniket Chakrabarti chakr...@cse.ohio-state.edu wrote: I'm testing the latency with different ratio of read/write request mix with different sized

Re: maven-metadata in Maven Central still points to 3.3.1

2011-12-10 Thread Mahadev Konar
Berk, We dont use nexus to upload the maven artifacts. Here's how we do it: https://cwiki.apache.org/confluence/display/ZOOKEEPER/HowToRelease (take a look at the publishing section). I am not sure how to fix the maven metadata but if you someone knows the way, Ill be happy to do that. thanks

Re: 3.3.2 - 3.4.0 NodeExistsException when reading snapshot

2011-12-07 Thread Mahadev Konar
Stefan, It mostly looks like https://issues.apache.org/jira/browse/ZOOKEEPER-1319, but just to confirm can you do this - do a get on the same znode /seq/y77mmizznsmdggqzx493-0030010980 on each of the servers. You can just use the zkCli.sh to do that: zkClish.sh -server hostname1 port1 get

ZooKeeper 3.4.0 release.

2011-12-07 Thread Mahadev Konar
Hi all, We have just come to realize that there is an issue that causes data loss/inconsistent data. This affects upgrades from 3.3.* to 3.4.0. The issue is https://issues.apache.org/jira/browse/ZOOKEEPER-1319. We are working on a fix and will be doing a 3.4.1 ASAP. We will be pulling back 3.4.0

Re: ZooKeeper 3.4.0 release.

2011-12-07 Thread Mahadev Konar
is available. (Mahadev and I are working on it for RC later this week, a patch should be available soon). Patrick On Wed, Dec 7, 2011 at 10:25 AM, Mahadev Konar maha...@hortonworks.com wrote: Hi all,  We have just come to realize that there is an issue that causes data loss/inconsistent data

Re: ZooKeeper 3.4.0 release.

2011-12-07 Thread Mahadev Konar
Actually, I think Ill leave the maven artifacts there but just update the downloads page and remove the tarballs. That sounds reasonable? mahadev On Wed, Dec 7, 2011 at 1:46 PM, Ivan Kelly i...@ivankelly.net wrote:  As Ted mentioned, 3.4 client should be fine with 3.3 server. But again, Ill be

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Mahadev Konar
This is exactly what Hedwig does. John as Neha mentioned, You might want to look at Kafka/Hedwig/ActiveMQ. mahadev On Tue, Dec 6, 2011 at 11:41 AM, Ted Dunning ted.dunn...@gmail.com wrote: ZK definitely provides the raw material for something like SQS. Generally, however, a queue *in* ZK

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Mahadev Konar
Sorry not John, Mike :)... mahadev PS: not getting enough sleep! :) On Tue, Dec 6, 2011 at 12:44 PM, Mahadev Konar maha...@hortonworks.com wrote: This is exactly what Hedwig does. John as Neha mentioned,  You might want to look at Kafka/Hedwig/ActiveMQ. mahadev On Tue, Dec 6, 2011 at 11

[ANNOUNCE] Apache ZooKeeper 3.4.0.

2011-11-23 Thread Mahadev Konar
Hi all, The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.0. ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple

Re: zookeeper ensemble with hbase (versus single node)

2011-11-11 Thread Mahadev Konar
Koert, I think this is a more appropriate question for the HBase mailing list. HBase uses ZooKeeper for Master failover. It is possible that if the Master is down and namenode/others are up, HBase can failiover to the new master. You have a good point of having ZK running on Master/NN/SNN, so

Re: Zookeeper 3.4

2011-11-05 Thread Mahadev Konar
AM, Mahadev Konar maha...@hortonworks.com wrote: Dima,  Batch is a new feature and touches a lot of the critical code and isnt system tested. I dont think it would be advisable to include into a stable bugfix release for now.  What do others feel abt it? thanks mahadev

Re: Recursive node deletion

2011-10-25 Thread Mahadev Konar
Dima, You can use ZKUtil.java in 3.4 (being voted on) to do the recursive delete for you. thanks mahadev On Tue, Oct 25, 2011 at 12:29 PM, Dima Gutzeit gutz...@gmail.com wrote: Dear list members, At the moment if I need to delete some node that has child nodes which in it's turn have child

Re: Running an ensemble in one JVM

2011-10-19 Thread Mahadev Konar
Regrettably, the above patches are not committed yet and where generated from zookeeper-trunk; so for the time being you need to use zookeeper-trunk instead of latest release (3.3.3). Cesar, I hope to review the patches by this weekend. Apologize for the delay in reviews. thanks mahadev

Re: current leader

2011-10-19 Thread Mahadev Konar
I think JMX can atleast give you what the stat of a given zk server is ( http://zookeeper.apache.org/doc/r3.3.3/zookeeperJMX.html) but i dont think you'd be able to register for change notification. Am interested in hearing any thoughts on a nice api for notifications though. thanks mahadev On

Re: pzxid field in stat structure

2011-10-15 Thread Mahadev Konar
Hi Tassos, There is some documention in src/zookeeper.jute: long pzxid; // last modified children But, we should probably add some documentation in the programmer's guide. Can you please open a jira/upload a patch :)? thanks mahadev On Sat, Oct 15, 2011 at 12:49 AM, Tassos Souris

Re: ANN: Curator - Netflix's ZooKeeper library

2011-10-11 Thread Mahadev Konar
Nice. Good to see the Apache License. mahadev On Mon, Oct 10, 2011 at 2:22 PM, Jordan Zimmerman jzimmer...@netflix.comwrote: https://github.com/Netflix/curator What is Curator? Curator n: a keeper or custodian of a museum or other collection - A ZooKeeper Keeper. Curator is a set of

Re: Enter your project at ZooKeepers PoweredBy wikipage!

2011-10-05 Thread Mahadev Konar
Great to see this. Thanks for taking the initiative Thomas! mahadev On Tue, Oct 4, 2011 at 2:18 AM, Thomas Koch tho...@koch.ro wrote: Ben Hall: I have used ZooKeeper at Zynga for a while now.  I added Zynga to the Wiki. Are there any other official Users pages that I should look at? Not

Re: Have smaller server identifier, so dropping the connection: (2, 1)

2011-10-05 Thread Mahadev Konar
Rajesh, What is the error message you are seeing? Did you forget to add it below? mahadev On Tue, Oct 4, 2011 at 11:26 AM, Raj N raj.cassan...@gmail.com wrote: Hi guys,     I am trying to run a 3 node zookeeper cluster. But when I start up I get this error. I tried to even cleanup the

Re: Zookeeper 3.4

2011-09-29 Thread Mahadev Konar
Raj, Below is my note to dev. I would estimate the timeline within weeks not months (probably a week or 2). For benchmarking the Multi, I'd really encourage someone to do that and post the results to the list. I dont think anyone has done a comprehensive perf testing on multi. hope that helps

Re: ephemeral node not removed after the client session is long gone

2011-09-27 Thread Mahadev Konar
Camille, I am a little confused on the explanation/text. Probably might want to update the jira (if kishore opens one) with a little more detail. thanks mahadev On Tue, Sep 27, 2011 at 2:20 PM, Fournier, Camille F. camille.fourn...@gs.com wrote: So, the node was created by 0x13220b93e610550 at

Re: Usecase: DB Sharding

2011-09-15 Thread Mahadev Konar
This might be of some help: http://wiki.apache.org/solr/ZooKeeperIntegration I am not sure if Solr/Lucene has the implementation part done or thats just the design doc. Also, http://katta.sourceforge.net/documentation/how-katta-works thanks mahadev On Sep 15, 2011, at 5:24 PM, Uday

Re: zookeeper connection loss exception occurs on new created ZooKeeper instance too much,why?

2011-09-07 Thread Mahadev Konar
to have the current mechanism of config file in a file system. Thanks, -Uday. - I do not blog but e-write: http://uds-web.blogspot.com From: Mahadev Konar maha...@hortonworks.com To: user@zookeeper.apache.org Sent: Wednesday

Re: Recovery log on /dev/shm?

2011-09-01 Thread Mahadev Konar
I had done quite a bit of benchmarks on not logging to disk. See ZOOKEEPER-866 and noticed that it actually wasnt of much help. It doesnt improve the latency by much and also the throughput was still the same. hope that helps. mahadev On Sep 1, 2011, at 2:24 PM, Benjamin Reed wrote: have

Re: zk keeps disconnecting and reconnecting

2011-08-29 Thread Mahadev Konar
-Original Message- From: Mahadev Konar [mailto:maha...@hortonworks.com] Sent: Monday, August 29, 2011 2:10 PM To: user@zookeeper.apache.org Subject: Re: zk keeps disconnecting and reconnecting Camille, Do you think we should put the fix in 3.3.4? I think 3.4 might take a while

Re: LinkedIn ZooKeeper Group

2011-08-26 Thread Mahadev Konar
Would be good to open one! mahadev On Fri, Aug 26, 2011 at 2:17 PM, Ben Hall b...@zynga.com wrote: Is there one?  I couldn't find one. Any interest in spinning one up? Ben

Re: Zookeeper on two clusters?

2011-08-25 Thread Mahadev Konar
Aleksey, I am a little confused. Whats the motivation behind merging the quorums? Why do you want 5 on each cluster? thanks mahadev On Tue, Aug 23, 2011 at 10:24 AM, Aleksey Yakovlev aleksey.yakov...@gmail.com wrote: Hi, We have two clusters but I can't just ssh from one cluster to another

Re: zk keeps disconnecting and reconnecting

2011-08-23 Thread Mahadev Konar
This looks very strange to me. Is it possible that there is version issue with ZK server and client? Mostly looks like the client is getting garbled data from the server somehow. I cant imagine how that would happen. Is it possible to run one of the servers on tracemode and see the tracelog on

Re: Using MSG_NOSIGNAL on socket sends in libzookeeper_mt

2011-08-22 Thread Mahadev Konar
Looks like we had similar issues in our tests and we ignored them in the test cases: https://issues.apache.org/jira/browse/ZOOKEEPER-482 Is this the tracking jira for SIGPIPE issue? https://issues.apache.org/jira/browse/ZOOKEEPER-1051 thanks mahadev On Mon, Aug 22, 2011 at 7:44 AM, Stephen

Re: Zookeeper chroot

2011-08-16 Thread Mahadev Konar
Damu, Not really. Currently the only option is to provide the info with the server name. thanks mahadev On Tue, Aug 16, 2011 at 10:31 AM, Damu R damu.devn...@gmail.com wrote: Hi, I see that from version 3.2.0 onwards zookeeper supports chroot option. From my understanding the client sends

Re: thread pool executor for event dispatch

2011-08-15 Thread Mahadev Konar
Martin, The problem with using a thread pool is that it becomes difficult to make sense about order of events that occur in the system. Here is the snippet from ZK wiki on client guarantees: What ZooKeeper Guarantees about Watches With regard to watches, ZooKeeper maintains these guarantees:

Re: ZooKeeper Limitation

2011-08-11 Thread Mahadev Konar
Yosef, There isnt a limit on the number of ZK node numbers directly. We do have a limit on data calls to ZK. So in your case if you have too many direct children of a single znode (say millions), the getChildren calls return an error. I'd advise against having too many direct chidlren for a

Re: Group Membership

2011-07-05 Thread Mahadev Konar
Hi Paul, I htink you might be confusing integrating ZK and group membership. ZK is a service. You probably should not be running it within your app. You can run ZK service (like the configs your provided) and then use the ZK Client API to do group membership. Also, this might be helpful:

Re: Dynamic addition of server to a running cluster

2011-07-05 Thread Mahadev Konar
Hi Paul, You are right. There isnt anyway to add a ZK server dynamically now. Alex from Y! Research is working on it. Am not sure what you mean by update /config/zoo.cfg? The current ZK servers DO NOT read the configs from any znode. So what you mentioned would not work. Hope that helps.

Re: Integrate Zookeeper with hadoop mapreduce

2011-06-30 Thread Mahadev Konar
Hi Paul, We have started using ZooKeeper in MRv2 but not yet for configs. You'll have to build a tool that would download configs from ZK and set up the environment for mapreduce to start. Hope that helps. thanks mahadev On Thu, Jun 30, 2011 at 6:47 PM, trippleface paul.ri...@gmail.com

Re: session expiry

2011-06-22 Thread Mahadev Konar
Liu, Looks like you have just one server. The client does not expire the session unless its able to talk to a server. Also, please take a look at some examples/tests on better understanding of event handling and session expiry for ZK. 2011/6/22 lei liu liulei...@gmail.com: I create group

Re: cleaning up old snapshot

2011-06-22 Thread Mahadev Konar
Jun, Thats a good ask. We dont have that on the roadmap yet. I think with ZOOKEEPER-22 that might be necessary. Please open a jira for that. We should probably address that with ZOOKEEPER-22 in mind. thanks mahadev On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao jun...@gmail.com wrote: Hi, I like

Re: cleaning up old snapshot

2011-06-22 Thread Mahadev Konar
, Jun 22, 2011 at 1:41 PM, Ted Dunning ted.dunn...@gmail.com wrote: Mahadev, What is the connection here? On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar maha...@apache.org wrote: Jun,  Thats a good ask. We dont have that on the roadmap yet. I think with ZOOKEEPER-22 that might be necessary

Re: cleaning up old snapshot

2011-06-22 Thread Mahadev Konar
keeps 1-2 days of logs around? On Wed, Jun 22, 2011 at 2:03 PM, Mahadev Konar maha...@apache.org wrote: Ted,  The connection is that with ZOOKEEPER-22 we will have to keep logs so that we can go back in time. Since we might have old requests coming along because requests will be retried, we need

Re: How to check if the zookeeper client is authenticated?

2011-06-17 Thread Mahadev Konar
Hey Semyon, You will get an event in your watcher : KeeperState.AuthFailed in case that happens. I think this probably needs more documentation since its not obvious. Semyon, mind creating a jira and if possible upload a patch for it? thanks mahadev On Fri, Jun 17, 2011 at 3:23 AM,

Re: [ANNOUNCE] ZooKeeper Committer: Camille Fournier

2011-05-19 Thread Mahadev Konar
Welcome aboard Camille! Look forward to more and more participation from you! -- thanks mahadev @mahadevkonar

Re: observers in occasionally disconnected data centers

2011-05-03 Thread Mahadev Konar
Hi Ketan, You are correct that observers need connection to quorum as well. There have been quite a few discussions on multi colo replication and read only mode of ZooKeeper. Here are the jiras for those: https://issues.apache.org/jira/browse/ZOOKEEPER-784 and

Re: list watchers from ZK shell

2011-04-19 Thread Mahadev Konar
Jun, Yes you can do that. http://zookeeper.apache.org/doc/r3.3.1/zookeeperAdmin.html#sc_zkCommands You can use the 4 letter commands to get watch info from a specific server. thanks mahadev On Mon, Apr 18, 2011 at 5:52 PM, Jun Rao jun...@gmail.com wrote: Hi, Is there a way to list all

Re: Serious problem processing hearbeat on login stampede

2011-04-18 Thread Mahadev Konar
Camille, Ted, Can we continue the discussion on https://issues.apache.org/jira/browse/ZOOKEEPER-1049? We should track all the suggestions/issues on the jira. thanks mahadev On Mon, Apr 18, 2011 at 9:03 AM, Ted Dunning ted.dunn...@gmail.com wrote: Interesting.  It does seem to suggestion the

ZK bug that removes all data.

2011-04-01 Thread Mahadev Konar
HI all, We have just noticed that there is ZK bug which deletes all the files in the local file system. This may sound weird but to prevent this bug from happening, you will have to pour some cold water on the machines that you run ZooKeeper on. Make sure that the water temperature is less than

Re: ZooKeeper chroot not transparent in zoo_create()

2011-03-23 Thread Mahadev Konar
Hi Thijs, Can you please verify this with 3.3.3 release? If it still exists with 3.3.3 please open a jira. thanks mahadev On Wed, Mar 23, 2011 at 12:12 AM, Thijs Terlouw thijsterl...@gmail.com wrote: I've recently started to use the chroot functionality (introduced in 3.2.0) as part of my

Re: Task/Job distribution using ZooKeeper

2011-03-07 Thread Mahadev Konar
Hi Sabyasachi, As Camille answered most of the questions for you but as per 2). Task distribution is a good use case for ZK but you need to be careful on how much load you put onto ZK. From your description it doesnt look like huge, so you should be good. ZK's use cases are only bounded by

Re: Question about the Barrier Java example on the ZooKeeper documentation

2011-03-05 Thread Mahadev Konar
Semih, You pointed it out right. It is possible ot enter into a situation like that. The recipe does have a bug. It can be fixed with the last client creating a special znode and every node in the list watching for that (so itll be an indication for entering the barrier). no? thanks mahadev On

Re: Watch on multiple z-nodes

2011-02-22 Thread Mahadev Konar
Hi mukunda, You can not watch multiple zk nodes with a single call to zookeeper. You can use multiple zk.get(path, true) to watch multiple paths. hope that helps. thanks mahadev On Tue, Feb 22, 2011 at 4:48 PM, Mukunda Madhava mukunda...@gmail.com wrote: Hi, We need a program which would be

Re: write permission on ZooKeeper Wiki?

2011-02-13 Thread Mahadev Konar
Hi Thomas, The facebook messaging service that they launched 2-3 months ago, uses zookeeper. There are others as well but unfortunately we cant put this up on the powered by page unless folks who are these power users agree to put this up on the website.

Re: write permission on ZooKeeper Wiki?

2011-02-13 Thread Mahadev Konar
Ben, What are the 2 level of acls? thanks mahadev On Sun, Feb 13, 2011 at 10:09 PM, Patrick Hunt ph...@apache.org wrote: Ben should we make it so that anyone logged in can edit any of the zk wiki pages? Patrick On Sun, Feb 13, 2011 at 8:39 PM, Benjamin Reed br...@yahoo-inc.com wrote: you

Re: hang in zookeeper_close() in the mt C client

2011-02-06 Thread Mahadev Konar
great. thanks michi! On Tue, Feb 1, 2011 at 1:33 PM, Michi Mutsuzaki mic...@yahoo-inc.com wrote: I'll take a look and see if I can reproduce it. --Michi On 2/1/11 1:24 PM, Patrick Hunt ph...@apache.org wrote: Great. I marked it as critical given the client hangs. If someone has a chance

Re: performance of watches

2011-01-03 Thread Mahadev Konar
at its load and determines which paths to acquire (they represent traffic flow). This could result in, at worst, 24k create() attempts immediately after. I'll read the docs--Thanks -sr On 12/16/10 8:06 PM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Sam, Just a clarifiaction

Re: question about server reconfig

2010-12-14 Thread Mahadev Konar
Hi Yuliya, The masted id is used to resolve conflicts when 2 servers have the latest transaction id during leader election. Also, its used as the first N bits for the session id to make it unique across zookeeper servers. Thanks mahadev On 12/14/10 5:25 PM, Ted Dunning

Re: need for more conditional write support

2010-12-09 Thread Mahadev Konar
Hi Qian, There have been discussions on multiple transaction in zookeeper: http://www.mail-archive.com/zookeeper-...@hadoop.apache.org/msg08315.html Which I think might help this case. There have been some discussions on this lately but not much progress. You can start a discussion on the

Re: Failure scenarios and consequences

2010-12-09 Thread Mahadev Konar
Hi Jeremy, Responses in line below: On 12/9/10 11:53 AM, Jeremy Hanna jeremy.hanna1...@gmail.com wrote: I looked around on the wiki and in the user list archives and couldn't find something definitive about certain failure scenarios. A partition splits the ensemble where a quorum is on one

Re: Failure scenarios and consequences

2010-12-09 Thread Mahadev Konar
the partition? I don't think that guarantee can exist, but wondered how to handle that. On Dec 9, 2010, at 2:04 PM, Mahadev Konar wrote: Hi Jeremy, Responses in line below: On 12/9/10 11:53 AM, Jeremy Hanna jeremy.hanna1...@gmail.com wrote: I looked around on the wiki and in the user list