Re: upgrade from 3.4.5 to 3.5.6
Hi, I appreciate if I will get a response as soon as possible, as I am stuck at this point. Thanks, - Kuldeep Singh Budania Software Architect On Wed, Jun 24, 2020 at 10:47 PM kuldeep singh wrote: > Hi, > > I got below error while setting SSL properties in zkEnv.sh > > > > > == > > 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] - Reading > configuration from: /etc/zookeeper/zoo.cfg > > 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] - > clientPortAddress is 0.0.0.0/0.0.0.0:10181 > > 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] - > secureClientPortAddress is 0.0.0.0/0.0.0.0:2281 > > 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D > jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated > TLS renegotiation > > 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] - > autopurge.snapRetainCount set to 3 > > 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] - > autopurge.purgeInterval set to 1 > > 2020-06-24 15:49:35,898 - INFO [ > PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started. > > 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j found with > jmx enabled. > > 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] - > zookeeper.snapshot.trust.empty : false > > 2020-06-24 15:49:35,910 - INFO [ > PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed. > > 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] - Starting > quorum peer > > 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] - Using > org.apache.zookeeper.server.NIOServerCnxnFactory as server connection > factory > > 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] - > Configuring NIO connection handler with 10s sessionless connection timeout, > 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. > > 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] - binding > to port 0.0.0.0/0.0.0.0:10181 > > 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] - Using > org.apache.zookeeper.server.NIOServerCnxnFactory as server connection > factory > > 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] - Unexpected > exception, exiting abnormally > > java.lang.UnsupportedOperationException: SSL isn't supported in > NIOServerCnxn > > at > org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644) > > at > org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155) > > at > org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123) > > at > org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82) > > > > > > I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh file : > "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory > -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12 > -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456 > -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks > -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456" > > Thanks, > - > Kuldeep Singh Budania > > > > On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman < > jor...@jordanzimmerman.com> wrote: > >> It's the same as the normal ZooKeeper client: >> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions >> < >> https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions >> > >> >> -Jordan >> >> > On Jun 22, 2020, at 5:50 AM, kuldeep singh >> wrote: >> > >> > Hi Team, >> > How we will do secure communication between the Curator framework and >> > zookeeper 3.5.6 ? >> > I didn't get any solution right now. >> > I appreciate it if someone could help me with the same. >> > >> > Thanks, >> > - >> > Kuldeep Singh Budania >> > Software Architect >> > >> > >> > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté < >> szalay.beko.m...@gmail.com> >> > wrote: >> > >> >> Hello Kuldeep, >> >> >> >> did you download the source from the ZooKeeper webpage, or checked out >> from >> >> git? >> >> Anyway, the following commands should work: >> >> >> >> wget >> >> >> >> >> https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz >> >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz >> >> cd apache-zookeeper-3.5.7 >> >> mvn clean install -DskipTests >> >> >> >> I tested it with OpenJDK 8u424 and maven 3.6.0. >> >> >> >> Kind regards, >> >> Mate >> >> >> >> >> >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh < >> kuldeep.sing...@gmail.com> >> >> wrote: >> >> >> >>> Hi All, >> >>> >> >>> I have download the zookeeper source code and run the mvn command for >> >>> packaging but get problem on "zookeeper-server"
Re: upgrade from 3.4.5 to 3.5.6
Hi, I got below error while setting SSL properties in zkEnv.sh == 2020-06-24 15:49:35,864 - INFO [main:QuorumPeerConfig@133] - Reading configuration from: /etc/zookeeper/zoo.cfg 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@385] - clientPortAddress is 0.0.0.0/0.0.0.0:10181 2020-06-24 15:49:35,874 - INFO [main:QuorumPeerConfig@399] - secureClientPortAddress is 0.0.0.0/0.0.0.0:2281 2020-06-24 15:49:35,878 - INFO [main:X509Util@79] - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3 2020-06-24 15:49:35,897 - INFO [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 1 2020-06-24 15:49:35,898 - INFO [ PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started. 2020-06-24 15:49:35,899 - INFO [main:ManagedUtil@46] - Log4j found with jmx enabled. 2020-06-24 15:49:35,903 - INFO [PurgeTask:FileTxnSnapLog@103] - zookeeper.snapshot.trust.empty : false 2020-06-24 15:49:35,910 - INFO [ PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed. 2020-06-24 15:49:35,975 - INFO [main:QuorumPeerMain@141] - Starting quorum peer 2020-06-24 15:49:35,983 - INFO [main:ServerCnxnFactory@135] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2020-06-24 15:49:35,986 - INFO [main:NIOServerCnxnFactory@673] - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. 2020-06-24 15:49:35,992 - INFO [main:NIOServerCnxnFactory@686] - binding to port 0.0.0.0/0.0.0.0:10181 2020-06-24 15:49:35,994 - INFO [main:ServerCnxnFactory@135] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory 2020-06-24 15:49:35,995 - ERROR [main:QuorumPeerMain@101] - Unexpected exception, exiting abnormally java.lang.UnsupportedOperationException: SSL isn't supported in NIOServerCnxn at org.apache.zookeeper.server.NIOServerCnxnFactory.configure(NIOServerCnxnFactory.java:644) at org.apache.zookeeper.server.quorum.QuorumPeerMain.runFromConfig(QuorumPeerMain.java:155) at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:123) at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:82) I have set the following properties in SERVER_JVMFLAGS in zkEnv.sh file : "-Dzookeeper.serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory -Dzookeeper.ssl.keyStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkkeystore.p12 -Dzookeeper.ssl.keyStore.password=EvaiKiO1@123456 -Dzookeeper.ssl.trustStore.location=/var/opt/vs/SecureInterface/keystore/CassSpkTrustStore.jks -Dzookeeper.ssl.trustStore.password=EvaiKiO1@123456" Thanks, - Kuldeep Singh Budania On Mon, Jun 22, 2020 at 8:08 PM Jordan Zimmerman wrote: > It's the same as the normal ZooKeeper client: > https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions > < > https://zookeeper.apache.org/doc/r3.6.1/zookeeperAdmin.html#sc_authOptions > > > > -Jordan > > > On Jun 22, 2020, at 5:50 AM, kuldeep singh > wrote: > > > > Hi Team, > > How we will do secure communication between the Curator framework and > > zookeeper 3.5.6 ? > > I didn't get any solution right now. > > I appreciate it if someone could help me with the same. > > > > Thanks, > > - > > Kuldeep Singh Budania > > Software Architect > > > > > > On Fri, Apr 17, 2020 at 4:53 PM Szalay-Bekő Máté < > szalay.beko.m...@gmail.com> > > wrote: > > > >> Hello Kuldeep, > >> > >> did you download the source from the ZooKeeper webpage, or checked out > from > >> git? > >> Anyway, the following commands should work: > >> > >> wget > >> > >> > https://downloads.apache.org/zookeeper/zookeeper-3.5.7/apache-zookeeper-3.5.7.tar.gz > >> tar xzvf ./apache-zookeeper-3.5.7.tar.gz > >> cd apache-zookeeper-3.5.7 > >> mvn clean install -DskipTests > >> > >> I tested it with OpenJDK 8u424 and maven 3.6.0. > >> > >> Kind regards, > >> Mate > >> > >> > >> On Fri, Apr 17, 2020 at 12:51 PM kuldeep singh < > kuldeep.sing...@gmail.com> > >> wrote: > >> > >>> Hi All, > >>> > >>> I have download the zookeeper source code and run the mvn command for > >>> packaging but get problem on "zookeeper-server" directory. > >>> > >>> *command :- mvn clean package* > >>> > >>> [ERROR] Failed to execute goal > >>> org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile > >>> (default-compile) on project zookeeper: Fatal error compiling: > >>> java.lang.NullPointerException -> [Help 1] > >>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to > execute > >>> goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile > >>> (default-compile) on project
Re: Zookeeper access logs?
Partrick, Thanks for the references, so what loglevel i should be setting to log read access? I can't rely on connections as the client may be using a pool and it doesn't translate well with number of reads and writes by a client right? Ram On Tue, Jun 23, 2020 at 3:55 PM Patrick Hunt wrote: > There is audit capability in newer versions: > https://zookeeper.apache.org/doc/r3.6.1/zookeeperAuditLogs.html > > Earlier versions include support for dumping the transaction log (which > goes back a long way): > > https://zookeeper.apache.org/doc/r3.6.0/apidocs/zookeeper-server/org/apache/zookeeper/server/LogFormatter.html > > For read access you may need to enable logging (log4j) or look at the > connection level metrics. > > Patrick > > On Tue, Jun 23, 2020 at 3:32 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > > > Does the zookeeper have access logs, i wanted to see client reads and > > writes information. Recently we had an incident where some of the clients > > started pounding zk with a lot of reads and it was hard to find which > > client was doing that. > > > > Ram > > >
