Re: Kernel tuning for zookeeper

2017-11-14 Thread Andor Molnar
Hi Ram, I can't think of anything specific to Zookeeper, however you can find some generic performance tuning guides for Hadoop distributions: https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_admin_performance.html

Re: how zookeeper promise FIFO client order

2017-11-13 Thread Andor Molnar
t requests. I would take a look at the > > section "Order in the Presence of Connection Loss" in the "ZooKeeper: > > Distributed Process Coordination" book for the best answer to this > > question. > > > > Thanks, > > Abe > > &

Re: how zookeeper promise FIFO client order

2017-11-13 Thread Andor Molnar
Hi baotiao, First, requests are acknowledged back to the client once the leader accepted and written them in its transaction log, which guarantees that in case of a crash, pending transactions can be processed on restart. Transactions IDs (zxid) are incremental and generated by the leader.

Re: Leader elections between 2 nodes.

2018-05-10 Thread Andor Molnar
You cannot read from ZooKeeper if there's no quorum, because it rejects client connections. But when you can, the request doesn't go to the leader, it served directly from the server that client is connected to. As a consequence, you cannot read stale data from ZooKeeper. Andor On Thu, May

Re: Leader elections between 2 nodes.

2018-05-10 Thread Andor Molnar
s in case of network partition ? > > > On Thu, May 10, 2018 at 2:26 PM, Andor Molnar <an...@cloudera.com> wrote: > > > You cannot read from ZooKeeper if there's no quorum, because it rejects > > client connections. > > But when you can, the request doesn't go to the leader,

Re: client cannot connect to zookeeper after node replacement

2018-05-11 Thread Andor Molnar
Hi Jeff, There's another patch which is supposed to be the successor of #151 here: https://github.com/apache/zookeeper/pull/451 Would you please try this one too and make sure it fixes the problem? Thanks, Andor On Fri, May 11, 2018 at 5:13 AM, 徐朝晖 wrote: > Hi

Re: Error Starting 2 Node Cluster on Redhat

2018-05-17 Thread Andor Molnar
Hi, What does it write on the console exactly? "...already running as process...? Check the ZooKeeper PID file for existence. Regards, Andor On Thu, May 17, 2018 at 11:14 AM, THADC wrote: > Hi, I have a very simple setup (borrowed from Solr Ref

Re: Kafka Failing to start due to existing ID

2018-06-13 Thread Andor Molnar
Hi Harish, I see 2 things which need to be clarified here: 1. ZooKeeper session dies in 2 cases only: when client explicitly closes the session (which is *not* equivalent to disconnection) or session timeout expires, 2. If quorum is not present, there'll be no updates committed and clients are

Re: IllegalStateException in performBackgroundOperation during close

2018-05-30 Thread Andor Molnar
Hi Meron, I've seen this issue intermittently when testing the leader election recipe in Sentry. Unfortunately I'm not sure about how to fix this or close the handles properly, however it seemed to me that it didn't cause any issue. To be honest it's a Curator question anyway, so I think you'll

Re: 3.4.6 to 3.4.12 weird issue

2018-07-01 Thread Andor Molnar
Hi Dan, Your issue is probably not related to the dataLogDir issue that you referenced. "-Dzookeeper.log.dir=/var/log/zookeeper" is the folder where ZooKeeper log files will be stored, but dataLogDir is for *transaction *log files. (and dataDir is for snapshots) Anyway, I'd like to know how

Re: Error starting zookeeper using bash on Windows 10

2018-05-02 Thread Andor Molnar
Hi THADC, Is this a Windows 10 linux subsystem session? Andor On Tue, May 1, 2018 at 12:45 AM, Norbert Kalmar wrote: > Hi, > > The zkServer.sh sets the classpath itself (with -cp, but including > CLASSPATH variable). You don't need to set it manually. > But if that

Re: Configuring SolrCloud with Redundancy on Two Physical Frames

2018-05-02 Thread Andor Molnar
Hi Adam, Zk uses quorum to get agreement between voting servers (leader and followers). Quorum is calculated by majority of servers: N / 2 + 1, where N is the number of servers. When you only have 2 Zk servers running, the quorum equals 2 which means you need to have both servers up and running

Re: behavior of ephemeral nodes

2018-05-02 Thread Andor Molnar
Hi Pramod, I think you should be able to delete znode /a once both B and C sessions are closed/expired and childrens are removed. Would you please post relevant code snippets of your processes to get some insight on what's happening? Regards, Andor On Wed, May 2, 2018 at 7:11 PM Pramod

Re: Confluence wiki contribution.. how?

2018-05-04 Thread Andor Molnar
Hi Alberto, Your contribution is much appreciated (...at least your intention). Confluence pages are not generated from source, they can be edited directly, so you're right that you need write permissions which unfortunately I don't know how to get. More senior people can advise here I believe.

Re: Unable to connect node to ensemble after restart of node zookeeper 3.4.6

2018-01-10 Thread Andor Molnar
​It's very likely related to this: https://issues.apache.org/jira/browse/ZOOKEEPER-2938 ​ On Wed, Jan 10, 2018 at 11:52 AM, Andor Molnar <an...@cloudera.com> wrote: > [WorkerSender[myid=2]:QuorumCnxManager@193] - *Have smaller server > **identifier, > so dropping the co

Re: Unable to connect node to ensemble after restart of node zookeeper 3.4.6

2018-01-10 Thread Andor Molnar
Hi hkwan, java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:197) at java.net.SocketInputStream.read(SocketInputStream.java:122) at java.net.SocketInputStream.read(SocketInputStream.java:211) at

Re: Unable to connect node to ensemble after restart of node zookeeper 3.4.6

2018-01-10 Thread Andor Molnar
[WorkerSender[myid=2]:QuorumCnxManager@193] - *Have smaller server **identifier, so dropping the connection: (3, 2)* Sorry, the peer explicitly drops the connection during leader election for some weird reason. The error message indicates that it believes that another connection is already

Re: transaction log directory on VM

2018-01-25 Thread Andor Molnar
Hi Kathryn, The only benefit I can think of is that transaction logs cannot steal space from other parts of the system. e.g. root filesystem Other than that it should be on a physically different drive for performance gain. Andor On Thu, Jan 25, 2018 at 3:57 PM, Page, Jeremy

Re: Zookeeper -java.net.SocketException: Socket closed

2018-01-25 Thread Andor Molnar
; > those components if there is network latency then there should be socket > > error in other components as data is being processed every sec. > > > > Lets hear from zookeeper dev team , hope they will respond > > > > On Thu, Jan 25, 2018 at 6:39 AM, Andor Mol

Re: Observers: a link to message bus?

2018-01-25 Thread Andor Molnar
to the same zk node (otherwise the client might miss some updates). > So I'll have to find a way to "timeout" and remove those nodes at some > point. Does that sound correct? > Regards, > > Bruno. > > -Message d'origine- > De : Andor Molnar [mailto:an...@c

Re: Zookeeper -java.net.SocketException: Socket closed

2018-01-25 Thread Andor Molnar
clientPortAddress= > > # The number of snapshots to retain in dataDir > autopurge.snapRetainCount=3 > > # Purge task interval in hours > # Set to "0" to disable auto purge feature > autopurge.purgeInterval=1 > > > On Wed, Jan 24, 2018 at 4:51 AM, Andor Moln

Re: zookeeper.allowSaslFailedClients property

2018-02-02 Thread Andor Molnar
Hi Dominique, Would you please check your ZooKeeper logs, because whenever Zk closes a client connection due to SASL authentication failure, it adds the following message to the logs: LOG.warn("Closing client connection due to SASL authentication failure."); On the other hand, if the connection

Re: Timeouts on lock

2018-02-02 Thread Andor Molnar
Hi Alexei, I think this is more of a Kazoo lock recipe question and not ZooKeeper specific, but I did some research for you: It seems that Kazoo locks are based on the path parameter that you specify when creating a new lock object and _not_ the identifier (name in your case). So basically

ZooKeeper 3.4.11 bug: dataDir and dataLogDir swapped

2018-02-02 Thread Andor Molnar
Hi all, Please be aware that 3.4.11 has a quite unfortunate bug which causes ZooKeeper to swap dataDir and dataLogDir parameters. If you configured ZK to use separate txn and snapshot folders in these two options and plan to upgrade, you'll experience that ZK is trying to load transaction logs

Re: zookeeper 3.5.3-beta reconf without admin client

2018-02-12 Thread Andor Molnar
Hi Ansel, I don't think you can do this easily. Processing of the reconfig() command is wired into PrepRequestProcessor.pRequest2Txn(), you can find it if you look for the case OpCode.reconfig in the switch block. There's a whole bunch of stuff and maintenance is going on when reconfig is being

Re: is zookeeper client 3.4.10 compatible with zookeeper server 3.4.6 ?

2018-02-12 Thread Andor Molnar
Hi alex1, I'm not aware of any braking changes in the client between 3.4.6 and 3.4.10. Minor version upgrades should be entirely backward compatible. It's always recommended to run throughout smoke testing before going production with a new version, but you shouldn't face any blockers with this

Re: SASL jaas.conf principal="*" problem

2018-02-13 Thread Andor Molnar
zookeeper. > sasl.client.username", "zookeeper"); > if(principalUserName!=null) zooKeeperSaslClient = > new ZooKeeperSaslClient( > principalUserName+"/"+addr. > getHostString(

Re: SASL jaas.conf principal="*" problem

2018-02-07 Thread Andor Molnar
Hi Botond, I believe the guy who originally implemented this (Rakesh) can give some color to your question, but until that you could dig the original Jira: https://issues.apache.org/jira/browse/ZOOKEEPER-1045 for more information. Other than that, if you believe that you can either fix the issue

Re: WARN [QuorumPeer[myid=1]/0.0.0.0:2181:Follower@90] - Exception when following the leader java.net.SocketTimeoutException: Read timed out

2018-02-21 Thread Andor Molnar
Hi svanschalkwyk, I'm not really sure. It could be a network issue or a slow leader which is not able to answer follower request in a timely fashion. Does it happen on all followers or only one? Regards, Andor On Tue, Feb 20, 2018 at 6:31 PM, svanschalkwyk wrote: >

Re: Verify zookeeper cluster consistency

2018-07-27 Thread Andor Molnar
Hi Klearchos, Some tool which is constantly querying the znode tree on each of every participant and tolerates some latency between the inconsistencies, but reports everything above the threshold could do the trick. Personally I'm not aware of anything existing, but feel free to dig github or

Re: Compatibility query

2018-08-09 Thread Andor Molnar
Hi, Upgrade path is supported between minor versions. In other words you can safely upgrade to 3.4.13. Regards, Andor On Thu, Aug 9, 2018 at 5:52 AM, nagarjun arjun wrote: > Hi All, > > I have plans of upgrading zookeeper from version 3.4.9 to 3.4.13. I did not > find any documentation which

Re: Leader election failing

2018-08-08 Thread Andor Molnar
Some kind of a network split? It looks like 1-2 and 3-4 were able to communicate each other, but connection timed out between these 2 splits. When 5 came back online it started with supporters of (1,2) and later 3 and 4 also joined. There was no such issue the day after. Which version of

Re: Leader election failing

2018-08-13 Thread Andor Molnar
er how many leader shutdowns i throw at > it. > > > > On 8 August 2018 5:05:34 pm Andor Molnar > > wrote: > > > > > Some kind of a network split? > > > > > > It looks like 1-2 and 3-4 were able to communicate each other, but > > >

Re: Permission denied as zookeeper user

2018-07-17 Thread Andor Molnar
Hi Adrian, Check the ‘dataDir’ and ‘dataLogDir’ (might be the same) directory permissions. Zookeeper running user must have write permissions to them. Regards, Andor > On 2018. Jul 17., at 18:39, adrien ruffie wrote: > > Hello everyone, > > > I have a little problem when I try to launch

Re: Port :3888 Bind failure

2018-07-23 Thread Andor Molnar
Hi, Is the IP address valid that you're trying to bind the server? Please tell me some info about your environment: cloud? docker? kubernetes? ZooKeeper config files would also be beneficial to take a look. Regards, Andor On Mon, Jul 23, 2018 at 5:02 PM, harish lohar wrote: > Hi , > > I am

Re: zookeeper build issue in AIX Machine

2018-07-23 Thread Andor Molnar
Hi Kiran, As far as I'm concerned none of the maintainers have access to an AIX machine, so we're unable to support the platform. You're more than welcome to file Jira and submit Github pull request if you're willing to contribute. Regards, Andor On Fri, Jul 20, 2018 at 5:55 PM, Bob Sheehan

Re: Is there any white-list-like feature in zookeeper?

2018-07-23 Thread Andor Molnar
Hi Zephyr, There's no such feature in ZooKeeper currently as far as I know. I think you can achieve similar behaviour by setting up client authentication and ACLs. Regards, Andor On Thu, Jul 19, 2018 at 5:03 AM, Zephyr Guo wrote: > I want to allow some special hosts to write zookeeper.

Re: Port :3888 Bind failure

2018-07-24 Thread Andor Molnar
roblem with the > interface or they are infinite ?? > > > On Mon, Jul 23, 2018 at 2:37 PM harish lohar wrote: > > > Thanks Andor, > > We found some issue with our interface configuration and correcting same > > has solved the issue. > > > > Thanks > > Har

Re: Observer went down with Read timed out exception

2018-07-04 Thread Andor Molnar
; Ram > > > On Tue, Jul 3, 2018 at 6:29 AM Andor Molnar > wrote: > > > Hi Rammohan, > > > > Would you please elaborate on the details of your cluster setup? > > Which ZooKeeper version do you use? > > Do you use authentication / encryption? > > Would

Re: Zookeeper -java.net.SocketException: Socket closed

2018-01-24 Thread Andor Molnar
Hi Upendar, Thanks for reporting the issue. I've a gut feeling which existing bug you've run into, but would you please share some more detail (version of ZK, log context, config files, etc.) to get confidence? Thanks, Andor On Wed, Jan 17, 2018 at 4:36 PM, upendar devu

Re: Observers: a link to message bus?

2018-01-24 Thread Andor Molnar
Hi Bruno, Unfortunately I have no idea what plugin system does the author of this doc refer to, but I can think of the following 2 solutions: 1) Fire up some observers in ZK cluster and connect to them via some standard client. Create a zk node and create a watch for its children. Producer can

Re: Zookeeper general log or “monitor” command

2018-02-28 Thread Andor Molnar
Hi Zod, I think there's no such thing in ZooKeeper currently other than debug logs. You might want to attach some processing engine to the debug log feed and parse and output data which is important for you into MySQL or Redis database. The downside of this approach is debug logging has

Re: Upgrade required Java version to 1.8 on 3.5+

2018-03-08 Thread Andor Molnar
Hi Shawn, Thanks for the feedback and thanks for everybody else too. The short term plan is to introduce Java 8 in next upcoming stable release, 3.5. Jumping 2 Java versions seems to be too much for me too. ZK master branch is going to be 3.6 release in which we can talk about upgrading to Java

Re: Zookeeper general log or “monitor” command

2018-03-07 Thread Andor Molnar
github.com/alenca/zklogtool. It's feature packed. The >only downside is that it won't record the read queries. > > > - > zodvik > > On Mon, Mar 5, 2018 at 5:42 PM, Andor Molnar <an...@cloudera.com> wrote: > > > Hi Zod, > > > > Have you checke

Upgrade required Java version to 1.8 on 3.5+

2018-03-07 Thread Andor Molnar
Hi ZooKeeper users, There's an ongoing discussion on the dev list about upgrading the required Java version to 1.8 on trunk and 3.5 branches. We'd like to get some feedback from a bigger audience if anybody or any other component that is dependent on ZooKeeper has any concerns or objections

Re: [3.4.6] Ephemeral node not deleted after session is gone

2018-04-03 Thread Andor Molnar
? 3) the znode exists on all 4 servers, is that right? Would also be useful to attach server logs related to the session expiration as well as LogFormatter output of txn log files about the nodes. Regards, Andor On Tue, Apr 3, 2018 at 10:34 AM, Andor Molnar <an...@cloudera.com> wrote: >

Re: stable 3.5 release

2018-04-10 Thread Andor Molnar
Hi Remi / Ansel, We have a quite impressive list of blockers to get out of the way: https://issues.apache.org/jira/browse/ZOOKEEPER-1549?filter=12343244 Additionally we have to get the following PRs merged: https://github.com/apache/zookeeper/pull/377

Re: Is the current max packet length available via the API?

2018-04-05 Thread Andor Molnar
Hi Shawn, You can get the current jute.maxbuffer setting from a running ZooKeeper instance by querying ZooKeeperServerBean via JMX. Currently there're 2 usage of the setting in ZK: 1) server-client communication which is by default 4MB, 2) server-server communication which is by default 1MB.

Re: zookeeper node can't join the cluster

2018-04-05 Thread Andor Molnar
Hi, Could it be something to do with Proxmox containers? Which ZooKeeper version are u running? Looks like you restarted zk01 and it was trying to connect to itself. (zk001/172.31.254.56:3888) Would you please attach your Zk config files too? Regards, Andor On Wed, Apr 4, 2018 at 10:51 PM,

Re: stable 3.5 release

2018-04-11 Thread Andor Molnar
> > -----Message d'origine- > De : Andor Molnar [mailto:an...@cloudera.com] > Envoyé : Tuesday, April 10, 2018 17:35 > À : user@zookeeper.apache.org > Objet : Re: stable 3.5 release > > Hi Remi / Ansel, > > We have a quite impressive list of blockers to get out of the wa

Re: Is the current max packet length available via the API?

2018-04-09 Thread Andor Molnar
If the ZK client is part of your application, you can probably read the jute.maxbuffer setting. However on the server side - as you mentioned - the setting should be consistent with the client. I believe it would make sense to expose the effective jute maxbuffer size via the "conf" 4lw command if

Re: Is the current max packet length available via the API?

2018-04-06 Thread Andor Molnar
t; wrote: > On 4/5/2018 3:44 AM, Andor Molnar wrote: > >> You can get the current jute.maxbuffer setting from a running ZooKeeper >> instance by querying ZooKeeperServerBean via JMX. >> > > I'm not sure how I would do that in a client program. It might be > tr

Re: [3.4.6] Ephemeral node not deleted after session is gone

2018-04-03 Thread Andor Molnar
Hi Daniel, Thanks for the bugreport. Interesting that this issue should have been fixed already by ages: https://issues.apache.org/jira/browse/ZOOKEEPER-1208 Regards, Andor On Tue, Apr 3, 2018 at 3:22 AM, Daniel Chan wrote: > We have a live Zookeeper environment

Re: srst keyword

2018-03-30 Thread Andor Molnar
Hi Joshua, Only on the server. There's not cluster-wide metrics collected in ZooKeeper currently. Regards, Andor On Fri, Mar 30, 2018 at 5:38 PM, Joshua Dotson (josdotso) < josdo...@cisco.com> wrote: > Hi. > > I’m wondering if the :srst” “four letter word” resets stats cluster-wide, > or only

Re: Zookeeper general log or “monitor” command

2018-03-05 Thread Andor Molnar
now > > 1. Modify of org.apache.zookeeper.server.LogFormatter to support > "tailing". > 2. Use ngrep on my local to monitor the network traffic to remote ZK host & > port 2181 > > ​Will get back with what works better.​ > > - > zodvik > > On Thu, Mar 1, 2018 at 1:22

Re: Digest auth with classic TCP transport

2018-09-27 Thread Andor Molnar
https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide SSL (client-server) has been added in 3.5.1 SSL server-server support is being reviewed on GitHub. Regards, Andor On Thu, Sep 27, 2018 at 3:46 PM, Jan Høydahl wrote: > Hi, > > > if you're prevented from

Re: Digest auth with classic TCP transport

2018-09-27 Thread Andor Molnar
ically do to mitigate this? Other than restricting > who has access to this network? > > -- > Jan Høydahl, search solution architect > Cominvent AS - www.cominvent.com > > > 27. sep. 2018 kl. 17:10 skrev Andor Molnar : > > > > Right. It's plaintext. > > &

Maven migration - main src dir moved

2018-10-05 Thread Andor Molnar
Hi, Please be aware that the patch which moved ZooKeeper server’s src folder to the new location has been merged. You probably need to rebase your PRs and resolve conflicts to get them merged. Sorry for the inconvenience. Regards, Andor

Re: Leader election failing

2018-09-03 Thread Andor Molnar
ted the patch and let it run 6 days. It did not help, result is > still the same. (remaining ZKs form islands based on datacenter they are > in). > > I have mitigated it by doing a daily rolling restart. > > Regards, > Chris > > On Mon, Aug 13, 2018 at 2:06 PM Andor M

Re: Change zookeeper digest password

2018-09-03 Thread Andor Molnar
Hi Anthony, First of all, ACLs relate to the data nodes and are part of the data tree, so they're replicated across the cluster, so you don't have to set them on each of every ZK server. Second, there's no "user database" with digest auth method, so authentication info is attached to the node if

Re: zookeeper watcher infinite calling process() since zookkeeper is down.

2019-01-02 Thread Andor Molnar
Hi Devendra, You need to explicitly call the close() method of ZooKeeper client object to stop it trying to connect and properly shut down before creating a new client. Regards, Andor > On 2018. Dec 20., at 17:19, Devendra Jain wrote: > > Hi, > > I am facing one issue in my project when

Re: can not know the process name from zk log

2018-09-14 Thread Andor Molnar
Hi, What info exactly would you like to see about the client? What do you mean by ‘process info’? Process name? That’s ‘java’ in 90% of cases and probably not enough to fully identify the process. Process ID? This information currently not available in ZK, because the client doesn’t send it

Re: Have smaller server identifier, so dropping the connection

2018-09-14 Thread Andor Molnar
Hi Ram, I might be missing something from your explanation, but that error message alone is not an issue. All ZK nodes open connection to each other, but having 2 connections between the same nodes is redundant and one of them has to be closed. To decide which one to close ZK use the server

Re: acceptedEpoch and currentEpoch values not matching exception message

2019-01-22 Thread Andor Molnar
Hi, Looks there’re a couple of overlapping Jiras around this issue like this: https://issues.apache.org/jira/browse/ZOOKEEPER-1621 Mohammad Arshad has provided a patch for ZK-2307 and promised to create a rebased PR. Maybe you should ping

[ANNOUNCE] Apache ZooKeeper 3.4.14

2019-04-02 Thread Andor Molnar
The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.4.14 ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

Re: TLS/SSL support to encrypt traffic between zookeeper nodes

2019-03-19 Thread Andor Molnar
Hi Kaushal, Yes, it will be released in 3.5.5 soon. Andor On Tue, Mar 19, 2019 at 10:40 AM Kaushal Shriyan wrote: > Hi, > > Is there a TLS/SSL support to encrypt traffic between zookeeper nodes > (internode communication)? > > Thanks in Advance and i look forward to hearing from you. > >

Re: TLS/SSL support to encrypt traffic between zookeeper nodes

2019-03-20 Thread Andor Molnar
We're in the middle of creating a maintenance release 3.4.14. Once it's ready, I'll cut 3.5.5. Hopefully in the next few weeks. Andor On Wed, Mar 20, 2019 at 7:32 AM Kaushal Shriyan wrote: > Hi Andor, > > Thanks Andor for the email. Any dates planned to release 3.5.5 version? I > do not see

Re: RR DNS name instead of list of server

2019-02-12 Thread Andor Molnar
; > Ram > > On Tue, Feb 12, 2019 at 3:44 AM Andor Molnar > wrote: > > > Hi Ram / Alan, > > > > I quite like the idea of implementing some kind of autoconfiguration for > > ZooKeeper, because currently it's entirely based on static config files &

Re: RR DNS name instead of list of server

2019-02-10 Thread Andor Molnar
Hi Ram! What exactly do you mean by "auto-discovery on cloud instance tags"? Is there a standard way of doing that? Regards, Andor On Sat, Feb 9, 2019 at 4:07 PM Norbert Kalmar wrote: > Hi Ram, > > Unfortunately ZK does not support RR DNS name. > As for plans on discovery based on cloud

Re: [**SPAM**] RE: ZK Server does not join quorum after restart

2019-01-25 Thread Andor Molnar
Hi Ian, Would you please attach logs from all participants of the ensemble or try to find an exception from when the follower is trying to join? Regards, Andor On Fri, Jan 25, 2019 at 1:37 AM Ian Spence wrote: > Hi Daniel, > > Thanks for the quick reply. We use static IP addresses on all of

Re: Deprecated CSVInputArchive and XMLInputArchive

2019-05-09 Thread Andor Molnar
Hi Zili, I'm surely not the best person to talk about ZooKeeper history, but as far as I know these 2 input archives are not actively maintained and I've never seen them used in production. We probably don't have test coverage for them either, so keeping them in the codebase could be

Re: Why does ZooKeeper follower shutdown itself when it can not read from leader

2019-05-22 Thread Andor Molnar
Hi Qian, Which version of ZooKeeper are you using? Would you please share the config files and leader logs too? Also looks like you're trying to connect with an older client: >>> Connection request from old client /10.249.255.10:42306; will be dropped if server is in r-o mode Andor On Wed,

Re: Updated SSL guide fro 3.5.5

2019-05-22 Thread Andor Molnar
Hi Ram, We have a ZooKeeper SSL User Guide on the wiki which contains the client-server howto currently. I need to update it with quorum TLS, but that would be probably just copying over the admin guide.

[ANNOUNCE] Apache ZooKeeper 3.5.5

2019-05-20 Thread Andor Molnar
The Apache ZooKeeper team is proud to announce Apache ZooKeeper version 3.5.5 ZooKeeper is a high-performance coordination service for distributed applications. It exposes common services - such as naming, configuration management, synchronization, and group services - in a simple interface so

[CVE-2019-0201] Information disclosure vulnerability in Apache ZooKeeper

2019-05-20 Thread Andor Molnar
CVE-2019-0201: Information disclosure vulnerability in Apache ZooKeeper Severity: Critical Vendor: The Apache Software Foundation Versions Affected: ZooKeeper prior to 3.4.14, ZooKeeper 3.5.0-alpha through 3.5.4-beta. The unsupported ZooKeeper 1.x through 3.3.x versions may be also

Re: ZK 3.5.5 : SecureClientPort and Server Specs

2019-07-01 Thread Andor Molnar
Hi Fred, I don’t think this server spec is accurate. clientPort and clientPortAddress as well as secureClientPort and secureClientPortAddress are defined in the main section of config file, not within Cluster Options: https://zookeeper.apache.org/doc/r3.5.5/zookeeperAdmin.html#sc_configuration

Re: client session expired after timeout after errors and warning logs in zk server logs

2019-07-01 Thread Andor Molnar
Hi Prashant, It’s quite difficult to track what could have happened from your log file snippet. Look’s like there’re multiple things going on at the same time: dynamic reconfig, leader election, network issues? However you’re using an early alpha version of ZooKeeper which is not recommended

Re: Reconfigure SSLQuorum

2019-07-01 Thread Andor Molnar
Hi Tyler, Sorry, looks like we missed to add this feature to the documentation. It should be supported from 3.5.5 according to this PR: https://github.com/apache/zookeeper/pull/737 You can find some useful information in the description. Please

Re: ZK 3.5.5 : SecureClientPort and Server Specs

2019-07-02 Thread Andor Molnar
the dynamic configuration (yet ?), so unlike other > parameters, they are static. > Fred, perhaps you could open a Jira to ask for this feature ? > > Thanks, > Alex > > On Mon, Jul 1, 2019 at 2:58 PM Andor Molnar wrote: > >> Hi Fred, >> >> I d

Re: Issue migrating from Zookeeper 3.4.14 to 3.5.5

2019-08-14 Thread Andor Molnar
Hi Jorn, Thanks for reaching out to us, this is a very important exercise to make sure the upgrade path works as expected. - Please do an `ls -al` in your data dir to make sure you have valid snapshot files. - It would be also useful to expose the Admin port (8080/tcp by default) and check

Re: jute.maxbuffer ignored for Client ssl connections ?

2019-08-16 Thread Andor Molnar
Hi, It shouldn’t make any difference. Are u using NIO for non-ssl port communication? SSL is only supported in Netty, so that could be a difference. What’s the number after “Len error” and what’s your server-side jute.maxbuffer setting? Andor > On 2019. Aug 1., at 18:30, Jörn Franke

Re: Issues with using ZooKeeper 3.5.5 together with Solr 8.2.0

2019-08-15 Thread Andor Molnar
https://issues.apache.org/jira/browse/ZOOKEEPER-3511 Andor -Original Message-From: Patrick Hunt Reply- To: user@zookeeper.apache.orgTo: UserZooKeeper < user@zookeeper.apache.org>Subject: Re: Issues with using ZooKeeper 3.5.5 together with Solr 8.2.0Date: Mon, 5 Aug 2019 09:04:44 -0700 It

Re: Issue migrating from Zookeeper 3.4.14 to 3.5.5

2019-08-14 Thread Andor Molnar
his can be combined with the above step if you like) Would you please give it a try? Andor > On 2019. Aug 14., at 10:44, Andor Molnar wrote: > > Hi Jorn, > > Thanks for reaching out to us, this is a very important exercise to make sure > the upgrade path works as expected

Re: Clarification: SSL Client: Need of keystore?

2019-08-14 Thread Andor Molnar
Hi Jorn, I cannot test this unfortunately, because I don’t have a working Kerberos environment at the moment. If you comment out keystore.location, ZooKeeper won’t start, because it’s unable to build the TrustManager. Would you please try to create a fake (possibly empty) truststore and see

Re: create or setData in transaction?

2019-08-14 Thread Andor Molnar
Hi Zili, There’s no such functionality in ZooKeeper as far as I’m concerned. I think your multi example (zk.multi(Op.check(path), Op.setData(path, data))) is already a usage pattern which multi is not designed to support. Why do you need to do this in “transactions” (there’s no transaction in

Re: create or setData in transaction?

2019-08-14 Thread Andor Molnar
. In > other > words, I want to tell ZooKeeper that the check and setData should be > successful > committed or fail to be committed atomically. > > Best, > tison. > > > Andor Molnar 于2019年8月14日周三 下午11:12写道: > >> Hi Zili, >> >> There’s no such

ZooKeeper swag on RedBubble available

2019-09-03 Thread Andor Molnar
Hi ZooKeeper fans, Get your favourite ZooKeeper swag today! :) https://www.redbubble.com/people/comdev/works/40935715-apache-zookeeper?asc=u Best, Andor

Re: The current epoch, 7, is older than the last zxid, 8589935882

2019-08-26 Thread Andor Molnar
Hi Debraj, The fix should be in all 3.4 versions from 3.4.6 onward, including 3.4.13. Can you see ‘updatingEpoch’ file in /var/lib/zookeeper/version-2 ? Also what is ‘currentEpoch.tmp’ ? I’m not sure if it relates to ZooKeeper. Would you please share full startup logs of the failing node?

Re: The current epoch, 7, is older than the last zxid, 8589935882

2019-08-26 Thread Andor Molnar
r/version-2$ sudo cat currentEpoch.tmp > 8support@platform2 > > Starting zookeeper logs are rolled over as the issue was there for some > time. Will the current log with the node in this state help? Btw why do you > think this issue may not be related to zookeeper? > > > > On

Re: Migrate from 3.4.x to 3.5.5

2019-08-26 Thread Andor Molnar
Hi Zili, There’s no migration guide available for 3.5, because it shouldn’t break any existing functionality and no need to upgrade the database either. I’ve created a wiki page to collect upgrade experiences from users which could give you some hint if you’re facing problems:

Re: The current epoch, 7, is older than the last zxid, 8589935882

2019-08-28 Thread Andor Molnar
D > > The content of zookeeper.log is placed in the below gist after the start > > https://gist.github.com/debraj-manna/9800c5bef32837c62bdfb324c0589ad6 > > Let me know if you need any more logs. > > On Mon, Aug 26, 2019 at 9:21 PM Andor Molnar wrote: > >> I confirm

Re: Migrate from 3.4.x to 3.5.5

2019-09-04 Thread Andor Molnar
Hi Zili, "If so, it seems upgrade client side force user to upgrade server side also.” Yes, if client is upgraded _and_ user wants to use a new feature in 3.5, then server side has to be upgraded too. ;) Andor > On 2019. Sep 3., at 13:20, Zili Chen wrote: > > If so, it seems upgrade

Re: Migrate from 3.4.x to 3.5.5

2019-09-04 Thread Andor Molnar
# clients using ZookeeperNetEx which hasn't released a 3.5 version yet. Will 3.4 clients work with 3.5 servers? --Kathryn HoggSenior Technology Architect -Original Message-From: Andor Molnar [mailto:an...@apache.org] Sent: Wednesday, September 4, 2019 9:52 AMTo: user@zookeeper.apache.org

Re: Migrate from 3.4.x to 3.5.5

2019-09-07 Thread Andor Molnar
Message-From: Andor Molnar [mailto:an...@apache.org] Sent: Thursday, September 5, 2019 12:42 AMTo: user@zookeeper.apache.org Subject: Re: Migrate from 3.4.x to 3.5.5 {External email message: This email is from an external source. Please exercise caution prior to opening attachments, clicking

Re: Zookeeper latency calculation

2019-07-17 Thread Andor Molnar
If I recall correctly avg_latency is an int, not float.I remember someone wanted to replace it with a float sometime recently. Correct me if I'm wrong. Andor -Original Message-From: Norbert Kalmar < nkal...@cloudera.com.INVALID>Reply-To: user@zookeeper.apache.orgTo:

Re: ZK 3.5.5 : SecureClientPort and Server Specs

2019-07-10 Thread Andor Molnar
Marked the more recent ticket as duplicate. Thanks Fred. Andor > On 2019. Jul 9., at 16:22, Fred Eisele wrote: > > There is already an issue . > https://issues.apache.org/jira/browse/ZOOKEEPER-3166

Removing Netty support from branch-3.4

2019-10-04 Thread Andor Molnar
Hi ZK users / devs, ZooKeeper branch-3.4 is still on Netty 3 which is not maintained by the Netty team anymore. There’s no intention of updating it on our side, hence we’re planning to remove it from the codebase completely and ask existing users to upgrade to 3.5, if they still want to use

Re: Failing C API tests on Linux

2019-11-02 Thread Andor Molnar
Hi deepak, It’s a single test failure originally, not a build error. Removing TestClient.cc will cause all kinds of problems, because I believe most tests are dependent on it. You can try to run the tests multiple times and if it still fails may try debugging it. What system are you running

Re: Failing C API tests on Linux

2019-11-08 Thread Andor Molnar
s base_dir to be set. So I had to set it manually from the command line (just like how it's set in the maven project's "test" phase). -- Deepak On Sat, Nov 2, 2019 at 3:13 AM Andor Molnar wrote: > Hi deepak, > > It’s a single test failure originally, not a build error. > R

Re: Zookeeper 3.5 SSL and Kerberos authentication

2019-11-08 Thread Andor Molnar
Hi Jörn! Thanks for reporting the problem, I answered the Jira. I'll set up a small test environment soon, but we need more specifics on how you set up your environment and what is the failure exactly. Regards, Andor -Original Message- From: Jörn Franke Reply-To:

  1   2   >