bound client memory size using async api

2017-05-16 Thread Jun Rao
Hi, Is there a way to bound the number of outstanding requests when using the async api? Currently, it seems that a client can run out of memory if it sends async requests too quickly. Thanks, Jun

Re: are ephemeral nodes removed when client receives session expiration

2017-01-26 Thread Jun Rao
then the > answer is > >> that it depends on which server you're talking to, one of the majority > or > >> one of the minority. > >> > >> If you ask whether the client will see its ephemerals upon creating a > new > >> session, then the answer is that it shouldn

are ephemeral nodes removed when client receives session expiration

2017-01-25 Thread Jun Rao
Hi, Does ZK guarantee that ephemeral nodes from a client are removed on the sever by the time the client receives a session expiration event? I am getting conflicting info on this ( https://issues.apache.org/jira/browse/KAFKA-4277). Could someone clarify? Thanks, Jun

detecting child changes reliably

2013-12-30 Thread Jun Rao
Hi, When a child watcher is fired, it can happen that when the children are read, a deleted node is already added back. So, from the list of children, it's as if nothing has changed. However, it could be important for an app to know in this case that something has changed. I could include some

Re: zookeeper on SSD

2012-10-03 Thread Jun Rao
+ seconds (that's not a mistake - seconds) for fsync to complete. When this happened (every few hours) all of the sessions would timeout. See this article: http://storagemojo.com/2012/06/07/the-ssd-write-cliff-in-real-life/ Patrick On Wed, Oct 3, 2012 at 9:59 AM, Jun Rao jun...@gmail.com

version Id after create

2012-06-04 Thread Jun Rao
Hi, It seems that the create API doesn't return Stat. So, the client can't figure out the initial version id of a path after it's created. Should the client just assume that the initial version is always 0? Also, what's the difference between getVersion and getCVersion? Thanks, Jun

Re: Zookeeper session losing some watchers

2011-11-07 Thread Jun Rao
Jamie, We do use chroot. However, the chroot problem will lose all watchers, not some watchers, right? Thanks, Jun On Wed, Nov 2, 2011 at 7:34 PM, Jamie Rothfeder jamie.rothfe...@gmail.comwrote: Hi Neha, I encountered a similar problem with zookeeper losing watches and found that it was

Re: Zookeeper 3.4

2011-10-27 Thread Jun Rao
interest. I personally think we should have one/more, including the most important fixes until 3.4.x code line has stabilized for production use. Patrick On Tue, Oct 25, 2011 at 10:38 PM, Jun Rao jun...@gmail.com wrote: Is there going to be a 3.3.4 release? Thanks, Jun On Tue, Oct

Re: Zookeeper 3.4

2011-10-25 Thread Jun Rao
Hi, Has the release date for ZK 3.4 be determined? Thanks, Jun On Thu, Sep 29, 2011 at 7:47 PM, Dan Mihai Dumitriu d...@midokura.comwrote: We are using that function now as well, not for the performance, but for the atomicity property. It is incredibly convenient! We built our own

Re: Zookeeper 3.4

2011-10-25 Thread Jun Rao
Is there going to be a 3.3.4 release? Thanks, Jun On Tue, Oct 25, 2011 at 12:44 PM, Patrick Hunt ph...@apache.org wrote: Voting is currently under way on the dev list: http://markmail.org/message/tpqkq57kl7tcp7xn On Tue, Oct 25, 2011 at 12:21 PM, Jun Rao jun...@gmail.com wrote: Hi

Re: zk keeps disconnecting and reconnecting

2011-08-30 Thread Jun Rao
to handle this. Thomas provided a patch with tests that presumably show the error, so all you need is a fix to make them pass. C -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Monday, August 29, 2011 12:39 PM To: user@zookeeper.apache.org; tho...@koch.ro Subject

Re: zk keeps disconnecting and reconnecting

2011-08-28 Thread Jun Rao
string look like? Patrick On Tue, Aug 23, 2011 at 2:58 PM, Jun Rao jun...@gmail.com wrote: I have a ZK server cluster running on 4 nodes (version 3.3.3) and a few ZK clients (version 3.3.0). After the clients have been running for a while, each of them starts to constantly disconnect

zk keeps disconnecting and reconnecting

2011-08-23 Thread Jun Rao
I have a ZK server cluster running on 4 nodes (version 3.3.3) and a few ZK clients (version 3.3.0). After the clients have been running for a while, each of them starts to constantly disconnect and reconnect to the ZK server. On the client, I saw lots of entries like the following: 2011/08/23

Re: zk keeps disconnecting and reconnecting

2011-08-23 Thread Jun Rao
about why you are using 4 ZK servers. This doesn't increase availability or durability over having just three ZK servers. On Tue, Aug 23, 2011 at 2:58 PM, Jun Rao jun...@gmail.com wrote: I have a ZK server cluster running on 4 nodes (version 3.3.3) and a few ZK clients (version 3.3.0). After

Re: cleaning up old snapshot

2011-06-23 Thread Jun Rao
that with ZOOKEEPER-22 in mind. thanks mahadev On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao jun...@gmail.com wrote: Hi, I like to have ZK itself manage the amount of snapshots and logs kept, instead of relying on the PurgeTxnLog utility. Is that on the roadmap already? Thanks, Jun

cleaning up old snapshot

2011-06-22 Thread Jun Rao
Hi, I like to have ZK itself manage the amount of snapshots and logs kept, instead of relying on the PurgeTxnLog utility. Is that on the roadmap already? Thanks, Jun

Re: lost ZK events across datacenters

2011-06-10 Thread Jun Rao
Hmm, those logs are pretty big, there is a 67MB file per hour. Jun On Wed, Jun 8, 2011 at 2:02 PM, Benjamin Reed br...@apache.org wrote: yes, the LogFormatter class will do it for me. ben On Wed, Jun 8, 2011 at 1:55 PM, Jun Rao jun...@gmail.com wrote: Ben, The log is binary

Re: lost ZK events across datacenters

2011-06-08 Thread Jun Rao
reporting here. C -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Friday, June 03, 2011 12:59 PM To: user@zookeeper.apache.org Subject: Re: lost ZK events across datacenters I don't expect that we can discover the problem right now. However, what are the things

Re: lost ZK events across datacenters

2011-06-08 Thread Jun Rao
can think of are: 1) the change happened before the watch was set 2) the change never got there you could get an answer to both of those questions by looking at the transaction log. ben On Fri, Jun 3, 2011 at 9:59 AM, Jun Rao jun...@gmail.com wrote: I don't expect that we can discover

Re: ephemeral node not deleted after client long gone

2011-02-11 Thread Jun Rao
Thanks, Jun On Fri, Feb 11, 2011 at 10:54 AM, Mahadev Konar maha...@apache.org wrote: Jun Rao, No it cannot happen without a zookeeper restart. Are you sure you are shutting down the client? thanks mahadev On Fri, Feb 11, 2011 at 10:43 AM, Jun Rao jun...@gmail.com wrote: Can

Re: ephemeral node not deleted after client long gone

2011-02-11 Thread Jun Rao
with negotiated timeout 3 for client /10.150.27.112:53673 -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Friday, February 11, 2011 2:58 PM To: user@zookeeper.apache.org Subject: Re: ephemeral node not deleted after client long gone Hmm, I am pretty sure the client