[Zookeeper-user] Upcoming release 3.0.0

2008-05-12 Thread Benjamin Reed
There are a couple of changes to ZooKeeper in the works: First off, there have been some changes we have been holding off to the code base because they would not be backwards compatible, but now their time has come. We are starting to work on the 3.0.0 release. Details can be found at http://zo

Re: [Zookeeper-user] odd exceptions when using zookeeper

2008-05-23 Thread Benjamin Reed
Usually, this exception means that the server closed the socket. Are you seeing anything strange in the server log? The null pointer exception is coming from the code that parses the hostPort list. Since you are running in standalone mode your hostPort should be a string of the form host:port.

Re: [Zookeeper-user] odd exceptions when using zookeeper

2008-05-27 Thread Benjamin Reed
It is supported. We run a lot of unit tests that way. Is it possible that the machine is simply getting overloaded. (Especially with respect to disk activity?) You have a rather large timeout, so the machine would really need to be getting swamped. ben On Friday 23 May 2008 13:00:02 Juan Ramir

Re: [Zookeeper-user] Stat attributes - what do they mean?

2008-06-05 Thread Benjamin Reed
I've updated the wiki page to document these members: http://zookeeper.wiki.sourceforge.net/ZooKeeperDataModel >From the wiki: * czxid - The zxid of the change that caused this znode to be created. * mzxid - The zxid of the change that last modified this znode. * ctime - The time i

Re: [Zookeeper-user] Watch event handlers

2008-06-05 Thread Benjamin Reed
As of the latest release the same watcher will be called for all events. The event callback includes the path of the znode that changed, which is how you can distinguish events. In the next major release, we will be allowing a watch object to be passed to the requests to make it easier for prog

Re: [Zookeeper-user] Does ZooKeeper includes Paxos ?

2008-06-06 Thread Benjamin Reed
No. Internally we use an atomic broadcast protocol (which is what Paxos would provide us) to keep the replicas in sync, but the protocol is much simpler than Paxos. We take advantage the fact that we use FIFO channels (TCP) and always use a leader along with some operational rules which results in

Re: [Zookeeper-user] Does ZooKeeper includes Paxos ?

2008-06-06 Thread Benjamin Reed
t the resulting solutions will be different. ben - Original Message From: Evan Jones <[EMAIL PROTECTED]> To: Benjamin Reed <[EMAIL PROTECTED]> Cc: zookeeper-user@lists.sourceforge.net Sent: Friday, June 6, 2008 8:33:29 PM Subject: Re: [Zookeeper-user] Does ZooKeeper includes

[Zookeeper-user] Bug tracking moving to Apache

2008-06-09 Thread Benjamin Reed
We are starting the process of moving to Apache. We have been approved as a subproject of Hadoop and are in the process of moving subversion over. We will also be moving over the documentation and tracker items. For now, the only thing setup on Apache is Jira, the bug tracking system. Please re

Re: [Zookeeper-user] Node placements for Zookeeper

2008-06-17 Thread Benjamin Reed
You can do this. We only done preliminary testing with that configuration. You may need to increase the tickTime if the pipe between A and B has high latency and you start seeing timeouts. There is a bit of a gotcha that you need to keep in mind. Currently clients select servers at random to co

Re: [Zookeeper-user] Session timeout

2008-06-17 Thread Benjamin Reed
The client library is in charge of preventing expirations, if it happens it is probably because of dead servers or network problems that caused a spike in latency. Increasing your session timeout helps prevent this. If/when it happens, you need create another ZooKeeper object to reconnect to Z

Re: [Zookeeper-user] Leader Election

2008-06-17 Thread Benjamin Reed
Good point. The recipe we show guarantees there will be a single leader elected, but only the leader knows it. Jacob Levy has been implementing a client library to do leader election, so he should really chime in here, but just in case he doesn't: I believe Jacob's solution was for the leader to

Re: [Zookeeper-user] Not sure if I understand CREATOR_ALL_ACL

2008-06-20 Thread Benjamin Reed
You understand it correctly. The confusion is the result of a bug you have found. I've filed a bug report with a patch for your problem: https://issues.apache.org/jira/browse/ZOOKEEPER-48. Since there weren't any authenticated ids on the channel, when CREATOR_ALL_ACL was used the ACL was empty. (On

Re: [Zookeeper-user] How should setACL be used?

2008-06-20 Thread Benjamin Reed
Thanx Shane! You are correct the line below the if block should be moved up. I've opened issue ZOOKEEPER-49 for it. The fix and test are included in the ZOOKEEPER-48 patch. ben Shane Mingins wrote: > Hi > > Still exploring the ACL stuff in Zookeeper. Tried using setACL for a > path but get Inv

Re: [Zookeeper-user] Lost connection

2008-06-26 Thread Benjamin Reed
Martin, Is there anything that characterizes the failures you are seeing? For example, is it always after the clients have been running for a while? Were the clients idle just before the timeout? etc... I would really like to reproduce this in our lab. thanx ben Martin Schaaf wrote: > Am 26.06.2

Re: [Zookeeper-user] Lost connection

2008-06-30 Thread Benjamin Reed
> The session is expired and I try now to catch this state with > event.getState() == Watcher.Event.KeeperStateExpired. Is there an > example how to renew the session or do I have to create a new > ZooKeeper object? When a session expires the ZooKeeper object becomes invalid. You must create a ne

Re: [Zookeeper-user] Recipes for dealing with disconnection and connection expiration

2008-07-06 Thread Benjamin Reed
This is a great FAQ topic! There are two kinds of connection problems: 1) Disconnections: this callback says that we have disconnected: KeeperStateDisconnected. This state is usually due to a server failure or transient communication error that will hopefully be followed up by a reconnected ca

Re: [Zookeeper-user] Leader election

2008-07-14 Thread Benjamin Reed
The easiest way to fix this code is to move the Collections.sort(values) to right after the zk.getChildren() and then use the following Comparator with Collections.sort() and Collections.binarySearch(): /* This Comparator defines an ordering such that the strings with * the lowest sequence numb

Re: [Zookeeper-user] Scalability and ZooKeeper java client thread safety

2008-07-15 Thread Benjamin Reed
Jacob answered your first question. With respect to your last question, yes it is save to share ZooKeeper objects. The ZooKeeper object is thread safe and it is much more efficient for all threads to share the same object rather than having an object per thread. ben Anthony Urso wrote: > I have a

Re: [Zookeeper-user] Concurrency related question in Zookeeper

2008-07-16 Thread Benjamin Reed
Writes are processed serially inside of ZooKeeper. Things are pipelined though, so there can be many writes outstanding. ben Avinash Lakshman wrote: > Hi All > > I understand writes to Zookeeper are probably serialized. But suppose > I have two znodes /A/A1 and /A/A2 can modifications to these zn

Re: [Zookeeper-user] Reconfiguring Zookeeper in production

2008-07-22 Thread Benjamin Reed
Creative idea. This should work. It's kind of a pain. I don't think there is a Jira opened for this, but you should open one. It's really a matter of implementation. You should be able to add (or remove) a machine to ZooKeeper and just have it get integrated in without having to do any restarting.

Re: [Zookeeper-user] Reconfiguring Zookeeper in production

2008-07-23 Thread Benjamin Reed
Hunt wrote: > Is there a way to ask the zk cluster to switch leaders? Switch in such a > way as it doesn't cause a "virtual bounce"? (I mean can we code > something that would enable this) > > Patrick > > Benjamin Reed wrote: > > Creative idea. This shoul

Re: [Zookeeper-user] Weird exception

2008-07-23 Thread Benjamin Reed
Are you seeing any errors in the ZooKeeper server logs? Looking more closely that error is happening in a very strange location. I would think that something should show up in the error log of one of the servers. Are other clients working? I assume that the client that is getting the exception is n

Re: [Zookeeper-user] Special event none, disconnected

2008-07-24 Thread Benjamin Reed
What do you mean by "In this the events were thrown endless."? The event is a notification to the application of the disconnect or reconnect. The ZooKeeper client library takes care of reestablishing the connection. The main reason for this event is for the application to know that the watches hav

Re: [Zookeeper-user] Data races in ZooKeeper C client

2008-07-30 Thread Benjamin Reed
Sorry about that and thanx for the patch! We have moved the development process to Apache. Would you mind opening a Jira and submitting the patch through the Jira? thank you ben On Wednesday 30 July 2008 02:23:11 Austin Shoemaker wrote: > We were debugging a crash when using the C client on mul

[Zookeeper-user] ZooKeeper sourceforge mailing lists deactivated

2008-10-28 Thread Benjamin Reed
We have moved development to Apache. With the release of 3.0 of ZooKeeper on Apache we are shutting down the sourceforge site. If you are still interested in ZooKeeper (we hope you are :) please subscribe to the lists at http://hadoop.apache.org/zookeeper. thank you ben ---

[Zookeeper-user] ZooKeeper @ HadoopCamp @ ApacheCon

2008-10-31 Thread Benjamin Reed
For those of you going to ApacheCon, I will be doing a presentation of ZooKeeper on Friday at HadoopCamp. See http://us.apachecon.com/c/acus2008/schedule/hadoop-camp for more details. ben - This SF.Net email is sponsor