Re: zk_outstanding_requests acceptable threshold limit

2016-07-13 Thread rammohan ganapavarapu
gt; On Tue, Jul 12, 2016 at 12:28 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Any help? > > On Jul 11, 2016 9:20 AM, "rammohan ganapavarapu" < > rammohanga...@gmail.com> > > wrote: > > > > > Hi, > &g

Re: Server not running error in log but server actually running

2016-07-15 Thread rammohan ganapavarapu
finished starting up, so the network layer drops the > incoming connections until the rest of Zookeeper is up and able to handle > them. > > Dan > > On Fri, Jul 15, 2016 at 12:47 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > >

Server not running error in log but server actually running

2016-07-15 Thread rammohan ganapavarapu
Hi, I see below message in zookeeper.log file but when i check process zk process is running and i can telnet to 2181 port, why am i getting this message and how to avoid this? 2016-07-15 19:22:14,222 - WARN [NIOServerCxn.Factory: 0.0.0.0/0.0.0.0:2181:NIOServerCnxn@354] - Exception causing

Re: zk_outstanding_requests acceptable threshold limit

2016-07-12 Thread rammohan ganapavarapu
Any help? On Jul 11, 2016 9:20 AM, "rammohan ganapavarapu" <rammohanga...@gmail.com> wrote: > Hi, > > I am trying to setup monitoring for my zk cluster and trying to understand > what would be the better threshold limit for "zk_outstanding_requests" ? > > Thanks, > Ram >

Re: zk_outstanding_requests acceptable threshold limit

2016-07-11 Thread rammohan ganapavarapu
Hi, I am trying to setup monitoring for my zk cluster and trying to understand what would be the better threshold limit for "zk_outstanding_requests" ? Thanks, Ram

Re: zk metrics units

2016-08-23 Thread rammohan ganapavarapu
Thank you Rakesh On Tue, Aug 23, 2016 at 9:09 PM, Rakesh Radhakrishnan <rake...@apache.org> wrote: > Hi Ram, > > Latency measures in milliseconds. > > zk_approximate_data_size measures in bytes. > > Regards, > Rakesh > > On Wed, Aug 24, 2016 at 9:07 AM,

zk metrics units

2016-08-23 Thread rammohan ganapavarapu
Hi, I am trying to find the units for the following zookeeper metrics, can some one please share? zk_avg_latency ---> s,ms,us ? zk_max_latency ---> s,ms,us ? zk_min_latency ---> s,ms,us ? zk_approximate_data_size --->bits,bytes,kb,mb ..etc? Thanks, Ram

shutdown Observer

2017-03-09 Thread rammohan ganapavarapu
Hi, We have a multi data-center zk cluster with all the followers are in one data-center and observers in other data-centers, for some reason observers are going down with the following exception and i am not sure what could be the reason and how to avoid this issue, any thoughts? Ram

Re: Observers taking long time to serve requests

2017-05-17 Thread rammohan ganapavarapu
16, 2017 at 1:04 PM, Ben Sherman <bensher...@gmail.com> wrote: > > > With latency that high, I'd expect the thruput to be low, is 30m in line > > with what it takes to transfer a gig of data across that pipe? > > > > On Mon, May 15, 2017 at 4:19 PM, rammohan ganapavara

Observers taking long time to serve requests

2017-05-15 Thread rammohan ganapavarapu
Hi, We have a zookeeper cluster in multi region, we have leader in US EAST and observers in US WEST, our data size is 1.3GB,network latency between leader and observers is around 250ms, upon observer restart it is taking like close to 30m for observer to serve traffic. Not sure why it's taking

outstanding requests

2017-11-17 Thread rammohan ganapavarapu
Hi, In zookeeper what will happened if outstanding requests are high? we have default global limit to 1000, what will happened if the outstanding requests go beyond global limit with is 1000? if we see huge outstanding requests are there any actions to bring the count down? Thanks, Ram

Re: outstanding requests

2017-11-17 Thread rammohan ganapavarapu
=X= > 0ahUKEwjsxb6grsbXAhVjyFQKHdztCOwQ6AEISDAD#v=onepage=% > 22globalOutstandingLimit%22%20zookeeper=false > > I don't think there is any general answer to how to bring the count > down, as the answer is totally related to your usage of ZooKeeper. > > Thanks, > Ab

Kernel tuning for zookeeper

2017-11-10 Thread rammohan ganapavarapu
Are there any kernel tunings recommended for zookeeper? Thanks, Ram

local call latency

2017-10-25 Thread rammohan ganapavarapu
Hi, We have a multi region zk cluster, we are observing latency for just local zk 'ls' command intermittently nothing in logs dont know how to find reason for latency, any one have any thoughts? zkCli.sh ls /node1 real 0m13.089s --When latency real 0m0.689s -- No latency Thanks, Ram

Re: local call latency

2017-10-25 Thread rammohan ganapavarapu
atter if the node you are > reading from has many children? > > Thanks, > Abe > > On Wed, Oct 25, 2017, at 09:18, rammohan ganapavarapu wrote: > > Hi, > > > > We have a multi region zk cluster, we are observing latency for just > > local > > zk 'ls' com

Observer went down with Read timed out exception

2018-07-02 Thread rammohan ganapavarapu
All, I have multi data-center ldap cluster setup with other data-center with all observers all of sudden all the observer threads went down with the following message, any idea why they went down? We don't see any network related issues between data-centers. 2018-06-29 05:32:59,036 [myid:222] -

Re: local call latency

2017-10-26 Thread rammohan ganapavarapu
elGC)" os_prio=0 tid=0x7efc6c01e000 > nid=0x1a37a runnable > "GC task thread#1 (ParallelGC)" os_prio=0 tid=0x7efc6c01f800 > nid=0x1a37b runnable > "GC task thread#2 (ParallelGC)" os_prio=0 tid=0x7efc6c021800 > nid=0x1a37c runnable >

Re: local call latency

2017-10-26 Thread rammohan ganapavarapu
Hmm, it is attached in my sent mail but any way i am attaching again. On Thu, Oct 26, 2017 at 8:58 AM, Abraham Fine <af...@apache.org> wrote: > Hi Ram- > > I don't see any jstack output attached to the email. > > Thanks, > Abe > > > On Wed, Oct 25, 2017, at 1

Re: local call latency

2017-10-26 Thread rammohan ganapavarapu
rmine if the latency > is network related or more tied to zookeeper internals. > > Abe > > On Thu, Oct 26, 2017, at 10:57, rammohan ganapavarapu wrote: > > Abe, > > > > It is just 20kb file, not sure why its not able to deliver. I am just > > copying the jstack he

Re: local call latency

2017-10-26 Thread rammohan ganapavarapu
gt; On Thu, Oct 26, 2017, at 13:57, rammohan ganapavarapu wrote: > > I was running ls command with in zkCli console from the same box. > > > > zkCli.sh --server localhost ls /node1, so no network involved. > > > > On Oct 26, 2017 12:37 PM, "Abraham Fine"

Re: Observer went down with Read timed out exception

2018-07-03 Thread rammohan ganapavarapu
ooKeeper for this reason > actually). > > Regards, > Norbert > > On Mon, Jul 2, 2018 at 9:13 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > All, > > > > I have multi data-center ldap cluster setup with other data-center w

Understanding zookeeper quorum

2018-08-02 Thread rammohan ganapavarapu
Hi, Lets say i have 5 node zk cluster and if one node went down then how does quorum work as i have only 4 nodes now and it may run into split-brain scenario right? Thanks, Ram

Re: Understanding zookeeper quorum

2018-08-16 Thread rammohan ganapavarapu
Thank you On Thu, Aug 2, 2018 at 10:50 AM John Sirois wrote: > The full ensemble size is still known (5); so operations still take 3 > successful node writes to work. > > On Thu, Aug 2, 2018, 11:46 AM rammohan ganapavarapu < > rammohanga...@gmail.com> > wrote: > >

How to use these system properties

2018-09-10 Thread rammohan ganapavarapu
Hi, I am trying to use the new properties available in 3.4.13 version but i couldn't find any examples, can some one help me on how to set those properties. *zookeeper.ipReachableTimeout* *zookeeper.tcpKeepAlive* *zookeeper.observer.syncEnabled* Do i ned to set them in zoo.conf or should i

Re: How to use these system properties

2018-09-10 Thread rammohan ganapavarapu
NVM, i think i got it. Thanks, Ram On Mon, Sep 10, 2018 at 3:35 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi, > > I am trying to use the new properties available in 3.4.13 version but i > couldn't find any examples, can some one help me on how to set

Re: Observer went down with Read timed out exception

2018-07-03 Thread rammohan ganapavarapu
ge between the affected data centers? > > Regards, > Andor > > > > > On Tue, Jul 3, 2018 at 2:56 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Yes I am sure there is no network issues, if leader is busy in GC > followers > > on th

Have smaller server identifier, so dropping the connection

2018-09-11 Thread rammohan ganapavarapu
Is this issue got fixed in 3.4.13 ? i thought it got fixed but i am still seeing this when leader nodes is with lower myid and reboot a follower with higher myid. Have smaller server identifier, so dropping the connection: (3, 2) Thanks, Ram

Upgrade from 3.4.5 to 3.4.13

2018-09-11 Thread rammohan ganapavarapu
I have zk cluster with 3.4.5 version and planing to upgrade to 3.4.13 version, can some one point me to a upgrade steps? When i copy snapshot from 3.4.5 node to 3.4.13 node it seems to be working but not sure what is the proper way of upgrading existing cluster. Thanks, Ram

How to find the actual size of zk data

2018-03-15 Thread rammohan ganapavarapu
Hi, How to find actual size of zookeeper data since it store and operate from in-memory? and snapshot may not give me actual size? I used zkteeUtils to dump the data is it the actual size ? One more question, since its a in-memory datastore, what if my zk data grows beyond available RAM? does

Re: How to find the actual size of zk data

2018-03-15 Thread rammohan ganapavarapu
le RAM? does it swap? > > No. ZooKeeper does not swap. You will get OutOfMemory exceptions if store > too much data. The ZooKeeper database is always limited by memory. > > -JZ > > > On Mar 15, 2018, at 5:57 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote

zktreeutils compilation error

2018-03-17 Thread rammohan ganapavarapu
Hi, I am getting below error when i try to compile the zktreeutils, any idea what could be the issue? make all-recursive make[1]: Entering directory `/home/rganapavarapu/zookeeper/src/contrib/zktreeutil' Making all in src make[2]: Entering directory

Re: How to find the actual size of zk data

2018-03-19 Thread rammohan ganapavarapu
and the zktreeutil dump file is > different, they will have different sizes. Does zktreeutil export the zk > data in XML format? > > Mark > > > On Fri, Mar 16, 2018 at 2:58 AM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> Jordan, >> >&g

Re: How to find the actual size of zk data

2018-03-20 Thread rammohan ganapavarapu
file can cause file size differences. Or perhaps the ZK server itself could > publish online statistics about node count and average node size via JMX - > I'll check if this is already implemented or not. > > Mark > > On Mon, Mar 19, 2018 at 4:05 PM, rammohan ganapavarapu < > ram

Re: zktreeutils compilation error

2018-03-18 Thread rammohan ganapavarapu
Yes, i followed the read me. On Sun, Mar 18, 2018, 2:11 AM Flavio Junqueira <f...@apache.org> wrote: > Hi Ram, > > Just so that I understand the steps you have followed. Did you follow the > instructions in the README file? > > -Flavio > > > On 17 Mar 2018

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-29 Thread rammohan ganapavarapu
localhost localhost.localdomain localhost6 > localhost6.localdomain6 > > http://ccl.cse.nd.edu/operations/condor/hostname.shtml > > On Fri, Sep 28, 2018 at 10:25 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Any thoughts on what could be the rea

Re: Kerberos based authentication

2018-09-24 Thread rammohan ganapavarapu
e end, I think it comes down to preference. > > Regards, > Norbert > > On Sat, Sep 22, 2018 at 1:40 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > > > To configure "Kerberos based authentication" on zookeep

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-24 Thread rammohan ganapavarapu
Any thoughts? On Sun, Sep 23, 2018 at 8:00 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi, > > Do we need to configure any thing on observer nodes for SASL > authentication? > > tcpKeepAlive=true ( this is not for sasl but just asking ) > &g

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-24 Thread rammohan ganapavarapu
basically is that > they are non-voters. Everything else works the same. Clients connect and > can send read / write commands. So it would be a huge security hole if an > observer is not configured as well. > > Regards, > Norbert > > On Mon, Sep 24, 2018 at 10:59 AM rammohan ganapav

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-25 Thread rammohan ganapavarapu
And observer never joining the cluster its keep saying "Cannot open channel to" in the logs. On Tue, Sep 25, 2018 at 8:25 AM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Rakesh, > > Thank you, i have 3 floower and 3 observers in two different DC's

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-25 Thread rammohan ganapavarapu
uthorization/ > > Please let us know if you are facing any issues. > > Thanks, > Rakesh > > On Mon, Sep 24, 2018 at 8:31 AM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> Hi, >> >> Do we need to configure any thing on observer nodes for

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-25 Thread rammohan ganapavarapu
Any help? On Tue, Sep 25, 2018 at 2:20 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > And observer never joining the cluster its keep saying "Cannot open > channel to" in the logs. > > On Tue, Sep 25, 2018 at 8:25 AM rammohan ganapavarapu < &

Observer properties for SASL authentication in 3.4.13 version

2018-09-23 Thread rammohan ganapavarapu
Hi, Do we need to configure any thing on observer nodes for SASL authentication? tcpKeepAlive=true ( this is not for sasl but just asking ) quorum.auth.enableSasl=true quorum.auth.learnerRequireSasl=true quorum.auth.serverRequireSasl=true What will happen if i set these properties on observers

Re: Observer properties for SASL authentication in 3.4.13 version

2018-09-28 Thread rammohan ganapavarapu
Any thoughts on what could be the reason for observers not able to connect to followers/leader? Ram On Thu, Sep 27, 2018 at 1:00 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Incase if you have not received my previous logs files. > > On Tue, Sep 25, 2018 at 8

Re: Zookeeper 3.5.X beta to stable versoin

2018-11-20 Thread rammohan ganapavarapu
I think lot of people wait for 3.5 as me :) Ram On Tue, Nov 20, 2018 at 6:22 AM Norbert Kalmar wrote: > Hi Gopi, > > I (and pretty much everyone) can only give you estimates, unfortunately. > So, my guess: January. > But I am not the release manager, nor a "binding voter". > I'm just also

Re: Have smaller server identifier, so dropping the connection

2018-09-14 Thread rammohan ganapavarapu
t; > > > > On 2018. Sep 12., at 3:20, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > > Is this issue got fixed in 3.4.13 ? i thought it got fixed but i am still > > seeing this when leader nodes is with lower myid and reboot a follower >

Re: Upgrade from 3.4.5 to 3.4.13

2018-09-12 Thread rammohan ganapavarapu
per-user.578899.n2.nabble.com/How-to-upgrade-zookeeper-from-3-4-8-to-3-4-13-td7583831.html > > If you just replace the jar, you don't even have to copy anything else. > > > Regards, > Norbert > > On Wed, Sep 12, 2018 at 12:29 AM rammohan ganapavarapu < > rammoha

Re: How to use these system properties

2018-09-11 Thread rammohan ganapavarapu
dly post the solution for others to not have to re-invent the wheel. > > > +1.314.452.2896 (Tel/SMS) > > On Mon, Sep 10, 2018 at 11:18 PM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > NVM, i think i got it. > > > > Thanks, > >

Re: Upgrade from 3.4.5 to 3.4.13

2018-09-13 Thread rammohan ganapavarapu
full restart this > way. You will have no downtime. > > Regards, > Norbert > > On Wed, Sep 12, 2018 at 3:05 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Norbert, > > > > Thank you, do we need to restart process after jar replacement? >

SASL configuration

2019-03-06 Thread rammohan ganapavarapu
Hi, I have a question regarding enabling server-server and client-server SASL using DIGEST-MD5, from the zk wiki i see below for server-server authentication QuorumServer { org.apache.zookeeper.server.auth.DigestLoginModule required user_test="test"; }; QuorumLearner {

RR DNS name instead of list of server

2019-02-08 Thread rammohan ganapavarapu
Hi, Does zookeper support RR DNS name in the config instead of giving each server name/ip like what consul does to join the cluster? server.1=server1 server.2=server2 server.3=server3 vs server=example.com where example.com is RR of server1, server2 and server3 And does any one know if zk

Enable authentication per client

2019-02-08 Thread rammohan ganapavarapu
Hi, Is it possible to enable authentication for specific clients in zookeeper? Thanks, Ram

Re: RR DNS name instead of list of server

2019-02-12 Thread rammohan ganapavarapu
ra. > > Cool stuff. > > Regards, > Andor > > > > > > On Mon, Feb 11, 2019 at 5:48 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Jürgen, > > > > I have zk clusters in dynamic environment like Autoscalling groups and as

Re: Enable authentication per client

2019-02-09 Thread rammohan ganapavarapu
> Hi Ram, > > > > ZooKeeper only knows IP addresses. You either require authentication from > > all clients, or turn it off completely. > > At least I couldn't think up anything that would achieve what you want. > > > > Regards, > > Norbert > > &

Re: Enable authentication per client

2019-02-09 Thread rammohan ganapavarapu
ompletely. > > At least I couldn't think up anything that would achieve what you want. > > > > Regards, > > Norbert > > > > On Sat, Feb 9, 2019 at 12:52 AM rammohan ganapavarapu < > > rammohanga...@gmail.com> wrote: > > > > > Hi, > > > > > > Is it possible to enable authentication for specific clients in > > zookeeper? > > > > > > Thanks, > > > Ram > > > > > >

Re: RR DNS name instead of list of server

2019-02-12 Thread rammohan ganapavarapu
ok, got it thank you! On Tue, Feb 12, 2019 at 8:49 AM Andor Molnar wrote: > Not sure what do you mean by 'static'? > ZK instance cannot change myid, it's tight to the database. > > Andor > > > On Tue, Feb 12, 2019 at 5:18 PM rammohan ganapavarapu < > rammohanga...@gm

Re: RR DNS name instead of list of server

2019-02-11 Thread rammohan ganapavarapu
vant component and you don't really want ANY new Zk server > > out there to be able to join your precious cluster - only the ones you > > know about already. > > > > The fact that Consul may support something like it, doesn't mean it also > > makes sense for Zookeeper. Consul a

Re: RR DNS name instead of list of server

2019-02-10 Thread rammohan ganapavarapu
lans. > > You can create a jira for it if you'd like, but I can't tell you when > that > > would make it into a release. > > > > Regards, > > Norbert > > > > On Fri, Feb 8, 2019 at 11:53 PM rammohan ganapavarapu < > > rammohanga...@gmail.com>

Re: RR DNS name instead of list of server

2019-02-10 Thread rammohan ganapavarapu
munity Hashicorp has built > something similar: https://github.com/hashicorp/go-discover -- this > problem > set itself probably warrants a multilingual Apache project to help drive > some standards and interoperability. > > Alan > > On Sun, Feb 10, 2019, 5:42 PM rammohan ganapavara

Re: Observer properties for SASL authentication in 3.4.13 version

2019-02-01 Thread rammohan ganapavarapu
Hi, After a long time i have tried this again, i have removed the observer type but still failing. Ram On Sat, Sep 29, 2018 at 11:50 AM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > I will try number 1 and yes there is no such entry in host file. > > On Sat, Sep 29,

Re: Admin Server Authentication/SSL

2019-05-28 Thread rammohan ganapavarapu
ing system not explicitly mentioned as supported in the > matrix, components may or may not work. The ZooKeeper community will fix > obvious bugs that are reported for other platforms, but there is no full > support. > zookeeper.apache.org > > ? > > ___

Re: ACL implimentation

2019-06-07 Thread rammohan ganapavarapu
edure in a staging environment before doing in in production > > Enrico > > Il gio 6 giu 2019, 23:56 rammohan ganapavarapu > ha > scritto: > > > Hi, > > > > Is there any recommendations or best practices on implementing ACL on > > existing zookeeper cluster with production data with out downtime? > > > > Thanks, > > Ram > > >

Zookeeper client connection

2019-06-07 Thread rammohan ganapavarapu
Hi, Since with 3.5.5 version clients can watch on zoookeeper/confg znode for the active zk servers, do we still need to give all the IPs of zk servers to client? or can i give one IP or rr dns name to a client and client can get server's list from the config znode to balance the connections?

Re: Zookeeper client connection

2019-06-07 Thread rammohan ganapavarapu
All i want to do is avoid static IP as we have zk cluster in autoscalling environment and IP is ephemeral there. On Fri, Jun 7, 2019, 2:38 PM Enrico Olivelli wrote: > A round robin DNS name should work > > > Enrico > > Il ven 7 giu 2019, 22:39 rammohan ganapavarapu > h

ACL implimentation

2019-06-06 Thread rammohan ganapavarapu
Hi, Is there any recommendations or best practices on implementing ACL on existing zookeeper cluster with production data with out downtime? Thanks, Ram

Dynamic Config

2019-05-30 Thread rammohan ganapavarapu
Hi, I have few questions regarding dynamic reconfig feature, 1. this feature can only reconfigure the properties or configuration defined in dynamic configuration file and not the configs in static default zoo.cfg file? 2. What is the criteria to create version extension for dynamic config

Re: Dynamic Config

2019-05-30 Thread rammohan ganapavarapu
, 2019 at 9:59 AM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi, > > I have few questions regarding dynamic reconfig feature, > > 1. this feature can only reconfigure the properties or configuration > defined in dynamic configuration file and not the c

Re: Dynamic Config

2019-05-30 Thread rammohan ganapavarapu
meters in the static file. > > Please see details in the manual: > https://zookeeper.apache.org/doc/r3.5.5/zookeeperReconfig.html > > Thanks, > Alex > > On Thu, May 30, 2019 at 10:49 AM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, >

Admin Server Authentication/SSL

2019-05-28 Thread rammohan ganapavarapu
Hi, Does zk AdminServer in 3.5 support authentication and SSL? Thanks, Ram

Re: ACL implimentation

2019-06-10 Thread rammohan ganapavarapu
ning the shell > > commands and config necessary to exercise the patches. This would be a > > great area for contributions. > > > > Patrick > > > > On Fri, Jun 7, 2019 at 8:04 AM rammohan ganapavarapu < > > rammohanga...@gmail.com> wrote: > > &g

Updated SSL guide fro 3.5.5

2019-05-22 Thread rammohan ganapavarapu
Hi, Since 3.5.5 is out is there any updated guide to configure SSL both for server-server and client-server? Thanks, Ram

Re: [ANNOUNCE] Apache ZooKeeper 3.5.5

2019-05-21 Thread rammohan ganapavarapu
zes wrote: > Congratulations! > > We waited for this release for a really long time. I'm looking forward to > use it. > ZooKeeper arrived to a new Era. > > Regards, Tamaas > > On Tue, May 21, 2019 at 4:18 AM Zili Chen wrote: > > > Congratulations! > &g

Re: Zookeeper latency calculation

2019-07-18 Thread rammohan ganapavarapu
at 8:43 PM Michael Han wrote: > > > >> always give avg_latency "0" > > > > The latency metrics depends on workloads. > > > > On Wed, Jul 17, 2019 at 1:34 AM Enrico Olivelli > > wrote: > > > >> Il mar 16 lug 2019, 19:05 rammohan

Re: Is there any tool to verify zookeeper snapshot file?

2019-10-31 Thread rammohan ganapavarapu
ify snapshot files > similar to TxnLogToolkit. > > Andor > > > > > On 2019. Oct 30., at 23:48, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > > There are cases where zk will fail to start with invalid snapshot if > > snapshot

Re: Is there any tool to verify zookeeper snapshot file?

2019-10-30 Thread rammohan ganapavarapu
There are cases where zk will fail to start with invalid snapshot if snapshot file is corrupt or incomplete, i wanted to verify if the snapshot is not corrupt or complete before restore. Ram On Wed, Oct 30, 2019 at 2:25 PM Enrico Olivelli wrote: > Ram > > Il mer 30 ott 2019, 21:23

Is there any tool to verify zookeeper snapshot file?

2019-10-30 Thread rammohan ganapavarapu
Hi, I am trying to see is there any tool available to verify the zk snapshot file, any such thing exist? Thanks, Ram

Re: default value for quorum.auth.kerberos.servicePrincipal

2019-12-13 Thread rammohan ganapavarapu
in setting up quorum auth, > if any. > > Thanks, > Rakesh > > On Fri, Dec 13, 2019 at 3:49 AM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > > > Even if i enable sasl but md5-diget what should be this property set to, >

Re: quorum.cnxn.threads.size

2019-12-12 Thread rammohan ganapavarapu
Any idea? On Wed, Dec 11, 2019, 2:23 PM rammohan ganapavarapu wrote: > And to add more on the same property, the description says > > > > > > *"For example, consider a 3-node cluster,# during quorum formation at > least 3 outgoing connection requests and 3

Re: quorum.cnxn.threads.size

2019-12-12 Thread rammohan ganapavarapu
ections for leader election, and > observers do not participate in the election. > > -Flavio > > > On 12 Dec 2019, at 14:41, rammohan ganapavarapu > wrote: > > > > Any idea? > > > > On Wed, Dec 11, 2019, 2:23 PM rammohan ganapavarapu < > ram

Re: quorum.cnxn.threads.size

2019-12-12 Thread rammohan ganapavarapu
sabled. > > -Flavio > > > On 12 Dec 2019, at 16:01, rammohan ganapavarapu > wrote: > > > > Flavio, > > > > Thanks for clarification, I have a cluster with sasl disabled but in > start > > up log I still see number of threads set to default 20. > &g

Re: Notification messages in log

2019-12-12 Thread rammohan ganapavarapu
Any thoughts? On Wed, Dec 11, 2019 at 7:48 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Hi Enrico, > > Since i have log rotation, i am not worried about size but i see ~14 such > messages for a second which seems unusual for me. > > grep "Notificati

Re: quorum.cnxn.threads.size

2019-12-12 Thread rammohan ganapavarapu
gt; If it is just logging the value of the property, then it is fine because > >> the property is set, but it is not used if SASL is disabled. > >> > >> -Flavio > >> > >>> On 12 Dec 2019, at 16:01, rammohan ganapavarapu < > rammohanga...@gmail.c

quorum.cnxn.threads.size

2019-12-11 Thread rammohan ganapavarapu
Is this property only applicable in case of sasl auth enabled? or does it work even when we turn off authentication? *quorum.cnxn.threads.size* Thanks, Ram

Notification messages in log

2019-12-11 Thread rammohan ganapavarapu
After 3.4.14 version upgrade i am seeing continuous messages as bellow in logs, is it normal? 2019-12-11 22:12:44,036 [myid:104] - INFO [WorkerReceiver[myid=104]:FastLeaderElection@595] - Notification: 0 (message format version), 100 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state),

Re: quorum.cnxn.threads.size

2019-12-11 Thread rammohan ganapavarapu
umber of threads for smooth execution, where 'x' represents the cluster size"* Here* cluster size* is number of *followers* right not both followers and observers?? Ram On Wed, Dec 11, 2019 at 2:19 PM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Is this property only

Re: default value for quorum.auth.kerberos.servicePrincipal

2019-12-12 Thread rammohan ganapavarapu
Hi, Even if i enable sasl but md5-diget what should be this property set to, this property only take effect for kerberos or for both? Ram On Fri, Dec 6, 2019 at 7:55 AM rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Mate, > > Thank you, I did search source code found

default value for quorum.auth.kerberos.servicePrincipal

2019-12-05 Thread rammohan ganapavarapu
Hi, What is the default value for this property, if i don't enable sasl and if i don't define what will be the value? quorum.auth.kerberos.servicePrincipal Also what does this means "servicename/_HOST" Thanks, Ram

Re: default value for quorum.auth.kerberos.servicePrincipal

2019-12-06 Thread rammohan ganapavarapu
t; > https://blog.cloudera.com/hardening-apache-zookeeper-security-sasl-quorum-peer-mutual-authentication-and-authorization/ > > Cheers, > Mate > > > On Thu, Dec 5, 2019 at 11:50 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, >

Re: default value for quorum.auth.kerberos.servicePrincipal

2019-12-16 Thread rammohan ganapavarapu
e "QuorumServer", > "QuorumLearner" section. > Usernames are distinguished from other options by prefixing the username > with a "user_" prefix. > > Hope its clear to you. > > Thanks, > Rakesh > > On Fri, Dec 13, 2019 at 9:45 PM rammoh

Re: Notification messages in log

2019-12-11 Thread rammohan ganapavarapu
not scary but they shouldn't be so many. > > Enrico > > > Il mer 11 dic 2019, 23:16 rammohan ganapavarapu > ha scritto: > > > After 3.4.14 version upgrade i am seeing continuous messages as bellow in > > logs, is it normal? > > > > > > 2019-12-11 22:12:44,0

Re: default value for quorum.auth.kerberos.servicePrincipal

2019-12-18 Thread rammohan ganapavarapu
t; Like mentioned earlier, its default value is "zkquorum/localhost" and it > will never be used if you configure/enable digest-md5. > > Thanks, > Rakesh > > On Mon, Dec 16, 2019 at 7:14 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > >

znode count

2020-02-01 Thread rammohan ganapavarapu
Hi, I have restored zk from backup snapshot but i see znode count difference before and after, any idea? Before: zk_version 3.4.5-1392090, built on 09/30/2012 17:52 GMT zk_avg_latency 0 zk_max_latency 49784 zk_min_latency 0 zk_packets_received 106038250008 zk_packets_sent 106061041183

Re: Zookeeper resolving to old host IP addresses

2020-01-24 Thread rammohan ganapavarapu
jdk.java.net/~iris/se/11/latestSpec/api/java.base/java/net/doc-files/net-properties.html > > I don't have personal experience with these settings. > > Andor > > > > > On Wed, 2020-01-22 at 10:37 -0800, rammohan ganapavarapu wrote: > > Hi Andor, > > > >

Re: Zookeeper resolving to old host IP addresses

2020-01-22 Thread rammohan ganapavarapu
mbersome, but maybe more reliable. > > Andor > > > > > > On 2020. Jan 21., at 23:14, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > > But still happening for me, is there any config on zookeeper side to make > > this fix t

Reading snapshot

2020-01-22 Thread rammohan ganapavarapu
Hi, What is the purpose of reading snapshot from disk while zk processes starting up? i have a snapshot of ~2gb and it is taking time to read that snapshot, hence cluster recovery time. Is it to get the last zxid of that server? ```2020-01-21 23:11:24,510 [myid:106] - INFO

Re: Zookeeper resolving to old host IP addresses

2020-01-22 Thread rammohan ganapavarapu
to properly remove old nodes and add new > ones. Sounds like more cumbersome, but maybe more reliable. > > Andor > > > > > > On 2020. Jan 21., at 23:14, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > > But still happening for me, is

Zookeeper resolving to old host IP addresses

2020-01-21 Thread rammohan ganapavarapu
Hi, Does zookeeper cache the host IP? if so how long does it cache? I have a zk cluster in autoscaling groups and when a new node comes up, other nodes still resolving to old IP. Is there any setting to invalidate dns cache for zookeeper? or is it jvm dns cache? until other nodes resolves to new

Re: Zookeeper resolving to old host IP addresses

2020-01-21 Thread rammohan ganapavarapu
Hi Enrico, I see same with both 3.4.5 and 3.4.14 Ram On Tue, Jan 21, 2020 at 1:53 PM Enrico Olivelli wrote: > Hi, > Which version of ZK are you using? > Enrico > > > Il mar 21 gen 2020, 22:51 rammohan ganapavarapu > ha scritto: > > > Hi, > > > > D

Re: [ANNOUNCE] Enrico Olivelli new ZooKeeper PMC Member

2020-01-21 Thread rammohan ganapavarapu
Congratulations Enrico!! On Tue, Jan 21, 2020 at 1:41 PM Flavio Junqueira wrote: > I'm pleased to announce that Enrico Olivelli recently became the newest > ZooKeeper PMC member. Enrico has contributed immensely to this community; > he became a ZooKeeper committer in May 2019 and now he joins

Re: Zookeeper resolving to old host IP addresses

2020-01-21 Thread rammohan ganapavarapu
But still happening for me, is there any config on zookeeper side to make this fix to work? Ram On Tue, Jan 21, 2020 at 2:12 PM Michael Han wrote: > Could be ZOOKEEPER-1506, though this should be fixed already in 3.4.14. > > On Tue, Jan 21, 2020 at 2:01 PM rammohan ganapavarapu <

Re: Zookeeper access logs?

2020-06-24 Thread rammohan ganapavarapu
per-server/org/apache/zookeeper/server/LogFormatter.html > > For read access you may need to enable logging (log4j) or look at the > connection level metrics. > > Patrick > > On Tue, Jun 23, 2020 at 3:32 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > &g

  1   2   >