Re: Command to find the leader

Hi Kamani, Please see four letter words, hope that will help you. http://zookeeper.apache.org/doc/r3.4.6/zookeeperAdmin.html#sc_zkCommands Another way is to use JMX, ZK exposes set of JMX Beans which also contains server statistics.

Re: Asynchronous API's and monotonicity

Hi Mudit, A client will have a consistent order and will dispatches the request sequentially. Basically its in FIFO order, all requests from a given client are executed in the order that they were sent by the client. In your case, Z1 request will be processed first and then Z2 request. Ofcourse,

Re: Asynchronous API's and monotonicity

Hi Mudit, Thanks Flavio for showing BookKeeper. Yeah this is another option you can explore in your free time:) I'd like to introduce it briefly to you, please have a look if you are interested. Documentation available at http://zookeeper.apache.org/bookkeeper/docs/r4.2.2/ Basic

Re: Distributed Applocation using Zookeeper

Hi Kapil, ZooKeeper server guarantees a total order of messages, and it also guarantees a total order of proposals. It has internal mechanism to do the total ordering, which uses a transaction id (zxid) for the requests. As I know, each transaction is independent to each other. Could you give

Re: Distributed Applocation using Zookeeper

I hope you will be keeping each IP address as an znode in ZooKeeper. Also, if you don't have any costly operation before storing the znode in ZooKeeper, there is an optimistic way. When a request comes, pick one of the available IP from the pool and try create IP znode in ZooKeeper. Say, if two

Re: Distributed Applocation using Zookeeper

Then you can try an optimistic way of randomly picking one IP address and create znode and handles KeeperException.NodeExistsException gracefully. This makes concurrency mechanism in client side simple. I'm trying to show one approach, as I told earlier it again depends on your client side algo

Re: renaming a znode

ZK is designed to be highly performant. Probably you can test after finalizing your client side algo. Also, you can try multi API to group operations and send as a single request to the server. It helps to reduce client to server interactions. Like, op.delete(/writer/my_current1); ops.add(op);

Re: Best way to bundle zk in our product

And can I connect to ZK using zkCli if I do embedded mode. Yes, you can connect to the ZK server using zkCli admin. There is no difference - embedded mode or separate JVM. -Rakesh On Thu, Jun 26, 2014 at 8:12 PM, Lahiru Gunathilake glah...@gmail.com wrote: HI Rakesh, Thanks for your

Re: Zookeeper for storing huge centralize data and Max possible No of zNodes - Please advise

Adding one more, you can also explore Apache BookKeeper for storing millions of K/V data. Since it uses filesystem for storing the ledgers its entries(data) size won't be a constraint. But it doesn't have watch notifications. Regards, Rakesh On Fri, Aug 15, 2014 at 10:18 PM, Alvaro Gareppe

Re: Log dir locked after ZK shutdown

Hi Stevo Slavic, I hope you are experimenting with standalone server. Please see ZooKeeperServerMain#runFromConfig() to see how a standalone server can be started/shutdown. Also, you can refer ZooKeeperServerMainTest to see standalone tests. Yes, ZKServer#shutdown is not releasing all the

Re: [VOTE] Taking Bookkeeper Subproject to a Top Level Project

+1, Great! Best Regards, Rakesh On Fri, Oct 17, 2014 at 11:58 PM, Michi Mutsuzaki mi...@cs.stanford.edu wrote: +1 On Fri, Oct 17, 2014 at 8:55 AM, Greg Asta greg.a...@omnigon.com wrote: +1. -Greg -Original Message- From: Flavio Junqueira

Re: Latency in asynchronous mode

Hi Ibrahim, In async tests, could you give the details like: * number of clients * number of threads * data size storing in each znode Also, it would be good to monitor : 1) JVM stats(one way is through JMX) like heap, gc activities. This is to see if latency spike corresponds to gc activity

Re: Apache BookKeeper TLP!

Great News! Congrats all the contributors and users for the continuous effort. Best Regards, Rakesh On Sun, Nov 23, 2014 at 7:11 PM, Jiannan Wang jian...@yahoo-inc.com wrote: Awesome, wonderful news! Hope the BookKeeper project could have deeper impact to the industry and go further.

Re: Heartbeats not being received / responded to?

Hi, Frustratingly, this behavior is very inconsistent. In fact, after 5+ failures in a row on our UX lead's machine, now I just heard from him that he tried again and it worked. Could it be that there is some kind of state on Zookeeper that needs to timeout and disappear before things will

Re: Zookeeper port 3181

Hi Eyal, ZooKeeper and BookKeeper are two different services. Are you trying to setup only zookeeper cluster? Can you show the configurations and the command to start the servers. Regards, Rakesh On Wed, Apr 22, 2015 at 1:17 PM, Eyal Bar eyal@kenshoo.com wrote: Hi, The bookkeeper

Re: Purge zookeeper data best method?

Hi Tim, (1) Using PurgeTxnLog a utility exposed by ZooKeeper. Administrator can run 'cronjob' on the Zookeeper server machine. (2) Setting zoo.cfg with: Its automatic purging of snapshots and corresponding transaction logs. Probably you can visit this section for more understanding.

Re: Thread dump looks OK?

Hi John, In your threaddump, EventTread is waiting to get a watch notification or operation response from the ZooKeeper server. Event thread uses the datastructure (EventThread#waitingEvents) to keep all the notifications from the ZooKeeper server and will wait until an item is available. So, I

Re: Reasonable config for ZK

Hi Vikrant, I am wondering what should be a reasonable tick time (and other critical config) I should keep for the same? right now it is 500ms and I do see some connection loss occasionally. Do you see any disturbances in the ZooKeeper quorum, I meant any exceptions between Followers and

Re: [ANNOUNCE] New committer: Chris Nauroth

Welcome Chris, thanks for all your great work and congrats! -Rakesh On Mon, Sep 28, 2015 at 8:11 PM, Flavio Junqueira wrote: > The Apache ZooKeeper PMC is pleased to announce that Chris Nauroth has > accepted to become a committer. Chris has been a great contributor and very >

Re: 3-server Zab cluster

Hi Ibrahim, Below example taken from your older mail thread. > 1. leader (L) sends a proposal p with zxid =10 to F1 and F2. > 2. F1 logs, sends an ACK, commits, replays to clients and crashes. F2 crashes before receiving P10. L has not received any ACKs My thoughts for the above

Re: Cannot find version in repository

Hi Sam, but where can i find log of zookeeper ? Please refer the "log4j.properties" configuration file. By default its using CONSOLE appender. zookeeper.root.logger=INFO, CONSOLE You can try modifying this to use ROLLINGFILE -Rakesh On Mon, Jan 4, 2016 at 3:55 AM, sam mohel

Re: Observer doesn't write transactions?

Hey Gokul, Observer will write the transactions into the log file like other Follower servers. Could you share the server side configurations. Also, can you compare the Observer configurations with other Follower in your cluster to see any differences. Regards, Rakesh On Mon, Jun 20, 2016 at

Re: zookeeper connection

replying . Sorry I have another email , how can I check that i'm > not using a secure client-server communication , I just download zookeeper > and set configuration in zoo.cfg > > And where can I find zookeeper. Sasl.client ? > > Thanks for your time > > On Tuesday, Janua

Re: 3.4.8 release

Thank you Raul for the initiative. It would be good if we can include ZOOKEEPER-2247 into this release, it looks like the proposed patch solves the issue. Probably needs to undergo few more review cycles. Thanks, Rakesh On Tue, Jan 19, 2016 at 6:30 AM, Raúl Gutiérrez Segalés

Re: zookeeper connection

and what does this statment means [INFO] Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) By default, SASL client is enabled and ZooKeeper client tries to use SASL auth. It can be disabled by setting the system

Re: Apache ZooKeeper Meetup - Jan 27, Cloudera HQ

Thank you for organizing this Flavio! I'm interested to attend remotely. Best Regards, Rakesh On Wed, Jan 20, 2016 at 11:19 PM, Raúl Gutiérrez Segalés < r...@itevenworks.net> wrote: > Thanks for setting this up Flavio! See you all there! > > On 20 January 2016 at 08:35, Flavio Junqueira

Re: Error Start ZK 3.5.1 a second time

Hi Curtis, >>>but should I open a ticket? Is this a bug? I could see ZOOKEEPER-2244 addresses the case you have mentioned and is fixed in 3.5.2 version. Most probably 3.5.2-alpha version release will happen soon and voting is going on. If you are interested you can try testing your case

Re: [ANNOUNCE] Chris Nauroth joins the Apache ZooKeeper PMC

Congratulations, Chris! Rakesh On Sun, Aug 7, 2016 at 11:35 PM, Flavio Junqueira wrote: > In recognition of all his contributions to the project, the Apache > ZooKeeper PMC has invited Chris Nauroth to join the PMC and he has > accepted. I'd like to take the opportunity to

Re: CHANGES.txt?

), if there is no objection. Thanks! Thanks & Regards, Rakesh On Thu, Feb 2, 2017 at 9:06 PM, Rakesh Radhakrishnan <rake...@apache.org> wrote: > +1 for removing the CHANGE.txt file. > > I agree to rely on source control (github) revision logs instead of > CHANGE.txt moving forward. > >

Re: CHANGES.txt?

+1 for removing the CHANGE.txt file. I agree to rely on source control (github) revision logs instead of CHANGE.txt moving forward. Note: Jira issue ZOOKEEPER-2672 will be used to remove this file. Thanks, Rakesh On Sat, Dec 17, 2016 at 3:59 AM, Michael Han wrote: > See

Re: Query: 3.5.x version as alpha

dia Phone 0124-6243000 deepti.s.sha...@ericsson.com > www.ericsson.com > > > > Legal entity: EGI, registered office in Gwal Pahari, Haryana. This > Communication is Confidential. We only send and receive email on the basis > of the terms set out at www.ericsson.com/email_disclaimer ---

Re: Query: 3.5.x version as alpha

Hi Deepti, Thanks for the interest in 3.5 features. AFAIK, there are many companies started using 3.5.2 latest alpha version. I believe with the community support, would be able to reach to a 3.5.3 beta version soon. But, I don't have exact time frame of 3.5.3 releasing now, because that is a

Re: Sessions Expire due to Network partitioning in Zookeeper

Hi, Could you please give few more details, 1) Could you tell me the status of Server C, is this lost connection to the quorum and fails to join quorum continuously as B is the Leader ? 2) C3 is connected C. Please tell me the connection host string passed to this client. Does it contains all

Re: Sessions Expire due to Network partitioning in Zookeeper

ent C3 connects to the > > quorum successfully before the session expiration. > > According to my understanding, it looks like, when a client trying to > connect to a server that it cannot > > connect due to a network partitioning, it uses a blocking call and it waits > too

Re: Sessions Expire due to Network partitioning in Zookeeper

for me? > > Here I used a tick of 3000ms and session expiration timeout of 45000ms. > > And please find the screenshot of extacted client log outout. > > https://anonimag.es/image/JT9htnL > > It looks like C3 has taken 14 seconds to determine the disconnected event > and another

Re: [ANNOUNCE] Apache ZooKeeper 3.4.9

, 2016 at 1:22 AM, Patrick Hunt <ph...@apache.org> wrote: > > > Kudos Rakesh on pushing this through. Thanks to everyone that > contributed. > > > > Patrick > > > > On Sun, Sep 4, 2016 at 1:57 AM, Flavio Junqueira <f...@apache.org> wrote: &g

Re: [ANNOUNCE] Apache ZooKeeper 3.4.9

FYI, created ZOOKEEPER-2552 to revisit the release note and do the corrective actions. Rakesh On Mon, Sep 5, 2016 at 6:05 PM, Rakesh Radhakrishnan <rake...@apache.org> wrote: > Thanks Edward for pointing out this. Its wrongly marked the fix version as > "3.4.8", all th

[ANNOUNCE] Apache ZooKeeper 3.4.9

The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.9. ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

Re: zookeeper 3.4.6 listening on unknown random port

Hi Mazhar, I doubt the possibility of jmx remote monitoring random port. Did you configure environment variable JMXPORT to avoid random port ? Rakesh On Wed, Aug 31, 2016 at 4:06 PM, Mazhar Shaikh wrote: > Hi All, > > Im running a 3 zookeeper process and noticed

Re: Zookeeper - Network partitioning behaviour

Hi Imesha Sudasingha, For example, we have A,B,C,D,E five servers, that formed quorum and assume A is the Leader. Again assume network partition happened between A,B(minority region) and C,D,E. As we know, 3 is the majority factor to form quorum. Since Leader A is in the minority region, the

Re: Zookeeper upgrade

Probably you could do rolling restarts. You have to do this manually by, Pre-requisite:- Ensure all the servers in the cluster is running. For example, if you have three node cluster A, B and C. Assume, A & B are Followers and C is the Leader. This is to ensure that, if one of the server

Re: Adding and removing replicas?

Hi Steve, I'd suggest you to look at ZooKeeper-3.5.2 latest version and use dynamic reconfig feature. This will help to resize(add/remove zk server) your cluster without restarting entire cluster. Please refer the following links to understand more about the dynamic reconfig feature:-

Re: security

section and has to be taken care during deployment. Thanks, Rakesh On Wed, Dec 14, 2016 at 6:41 PM, Rakesh Radhakrishnan <rake...@apache.org> wrote: > 1 => AFAIK, there are many companies adopted 3.5.x latest alpha version > and no major issues reported so far. I hope beta release w

Re: security

proach for client and server. > > > > The test report mentions installing the KDC on sever 1, how to secure > > the KDC HA? Does zookeeper provide KDC HA as off-shelf support? > > > > BRs/Faxin > > > > -Original Message- > > From: Rakesh Rad

Re: How to use Kerberose auth while using Zookeeper client API

Hi Xie Gang, I hope the following links will help you, https://cwiki.apache.org/confluence/display/ZOOKEEPER/Zookeeper+and+SASL https://zookeeper.apache.org/doc/trunk/zookeeperProgrammers.html#sc_java_client_configuration

Re: How to determine if the node's type is PERSISTENT_SEQUENTIAL

Could you share more details about the problem you are facing while copying the node with type PERSISTENT_SEQUENTIAL. I'd prefer to fix those issues if possible, rather than doing work around. Rakesh On Tue, Nov 29, 2016 at 8:22 PM, Xie wrote: > Hello, > > > I'm developing

Re: zookeeper discnnected every minutes when i am getting bulk data

Like Flavio mentioned in previous mail, could you please check ZooKeeper server logs. IMHO, that will help to understand the status of the cluster and we may get hints to identify the problem. Thanks for detailing your architecture. Probably, will come back to this after analyzing ZK server logs.

Re: AvgRequestLatency metric always zero

Thanks Arshad for the good analysis. How can we go about getting these fixes? Please feel free to raise an improvement task under ZK project issue tracker, URL: https://issues.apache.org/jira/browse/ZOOKEEPER Also, I'd appreciate if you can put a patch to fix it. Probably you can refer how

[ANNOUNCE] Apache ZooKeeper 3.4.10

The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.10 ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

Re: [ANNOUNCE] Apache ZooKeeper 3.4.10

I haven't tried installing ZK via bigtop. Just a plain thought, is it possible to change base = '3.4.6' to base = '3.4.10' in https://github.com/apache/bigtop/blob/master/bigtop.bom#L116 and do a try? Rakesh On Thu, Mar 30, 2017 at 11:23 PM, yakirgb wrote: > I executed:

Re: [ANNOUNCE] Apache ZooKeeper 3.4.10

>>>https://github.com/apache/bigtop/pull/192 This is awesome! Thank you @Yakir Gibraltar for the useful work. Rakesh On Sun, Apr 2, 2017 at 5:05 PM, yakirgb wrote: > I created PR to Bigtop, checked on CentOS 7, looks fine from my

Re: Sessions Expire due to Network partitioning in Zookeeper

lain a bit more? > > > > I see that when I try with both 45000ms and 2ms, it takes around 14 - > > 15 seconds to figure out a disconnection from clients end. > > Looks like it is a constant and client has (session timeout - connection > > loss notified time) to find a

Re: New PMC Member: Michael Han

Congratulations Michael! Keep up the great efforts! Rakesh On Tue, Jun 27, 2017 at 10:18 PM, Flavio Junqueira wrote: > I'm very happy to announce that the Apache ZooKeeper PMC has voted to > invite Michael Han to join the PMC and Michael accepted. Michael has done >

Re: Version parameter passed to ZooKeeper.setACL

Hi Arpit, Stat#aversion represents "the number of changes to the ACL of this znode." On calling the zkcli#setACL api, internally ZK server will increase the 'aversion' by one. If the given 'aversion' does not match the znode's aversion it will throw BadVersionException. While invoking the

Re: Version parameter passed to ZooKeeper.setACL

; > i) public Stat setACL(final String path, List acl, int aversion or > aclVersion) > ii) "should pass aclversion only"..something like this.. > > > > --Brahma Reddy Battula > > -Original Message- > From: Rakesh Radhakrishnan [mailto

Re: Observer properties for SASL authentication in 3.4.13 version

:558) >>> at >>> org.apache.zookeeper.server.quorum.QuorumCnxManager.connectAll(QuorumCnxManager.java:610) >>> at >>> org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:838) >>> at org.apache.zookeeper.server.q

Re: Observer properties for SASL authentication in 3.4.13 version

Thanks Ram for the interest on this feature. Yes, user can enable SASL for Observer nodes as well. In general, QuorumLearner will send authentication packet to peer QuorumServer. Observer is a learner which follows the same quorum authentication protocol and auth logic will work fine. FYI, hope

Re: Observer properties for SASL authentication in 3.4.13 version

t >>> org.apache.zookeeper.server.quorum.FastLeaderElection.lookForLeader(FastLeaderElection.java:838) >>> at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:957) >>> >>> >>> server.1=zk-server1:2888:3888 >>> server.2=zk-server2

Re: default value for quorum.auth.kerberos.servicePrincipal

Hi Ram, ZooKeeper Quorum authentication support two schemes, Kerberos or DIGEST-MD5. User has to configure either Kerb or digest configuration values. Both together not required. I'd recommend you to go through Kerberos, digest simulation unit test cases where we have valid and invalid

Re: default value for quorum.auth.kerberos.servicePrincipal

ed this > property? i remember seeing i don't set that property it was using the > default value "zkquorum/localhost". > > Thanks, > Ram > > On Thu, Dec 12, 2019 at 11:06 PM Rakesh Radhakrishnan > wrote: > > > Hi Ram, > > > > ZooKeeper Quorum

Re: default value for quorum.auth.kerberos.servicePrincipal

sed if you configure/enable digest-md5. Thanks, Rakesh On Mon, Dec 16, 2019 at 7:14 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > "quorum.auth.kerberos.servicePrincipal" this one > > On Sun, Dec 15, 2019, 9:33 PM Rakesh Radhakrishnan > wrote: > > &g

Re: Enabling Auth between Zookeeper Servers

>java.io.IOException: No JAAS configuration section named 'Server' I could see you have enabled client-server authentication as well. It looks to me that the error is coming from that. Please share the complete error logs to trace it. Have you configured "*Server*" section along with the

Re: [VOTE] Taking Bookkeeper Subproject to a Top Level Project

+1, Great! Best Regards, Rakesh On Fri, Oct 17, 2014 at 11:58 PM, Michi Mutsuzaki mi...@cs.stanford.edu wrote: +1 On Fri, Oct 17, 2014 at 8:55 AM, Greg Asta greg.a...@omnigon.com wrote: +1. -Greg -Original Message- From: Flavio Junqueira

Re: BookKeeper vs. Bookkeeper

+1 for BookKeeper :) HDFS has a contrib module named BKJM (BookKeeperJournalManager), I think bunch of people already familiar with BK acronym. -Rakesh On Thu, Oct 23, 2014 at 10:17 PM, Flavio Junqueira fpjunque...@yahoo.com wrote: +1 for BookKeeper. I like it because it makes clear where the