I am having trouble starting zookeeper, I am wondering if someone could help me figure out what I am doing wrong. When I start the hbase region server, I am getting a connection refused. I am not sure how to tell if this is a Zookeeper problem or an hbase problem.
One of my servers (dn3) seems to be the problem (I think) mostly because it is outputting a lot more noise, but I am not sure why. here is my zoo.conf tickTime=2000 dataDir=/hadoop/data/zookeeper clientPort=2181 initLimit=10 syncLimit=5 server.1=dn1:2888:3888 server.2=dn2:2888:3888 server.3=dn3:2888:3888 This command gives me (startup seem to be spamming the last line) bin/zkCli.sh -waitforconnection -timeout 3000 -server dn3:2181 16:25:23.384 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=dn3:2181 sessionTimeout=3000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@17c68925 16:25:23.387 [main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 16:25:23.444 [main] INFO org.apache.zookeeper.common.X509Util - Default TLS protocol is TLSv1.3, supported TLS protocols are [TLSv1.3, TLSv1.2, TLSv1.1, TLSv1, SSLv3, SSLv2Hello] 16:25:23.447 [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 1048575 Bytes 16:25:23.450 [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=false 16:25:23.451 [main-SendThread(dn3:2181)] DEBUG org.apache.zookeeper.SaslServerPrincipal - Canonicalized address to dn3 16:25:23.451 [main-SendThread(dn3:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server dn3/ 192.168.1.108:2181. 16:25:23.451 [main-SendThread(dn3:2181)] INFO org.apache.zookeeper.ClientCnxn - SASL config status: Will not attempt to authenticate using SASL (unknown error) 16:25:23.453 [main-SendThread(dn3:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /192.168.1.108:60686, server: dn3/192.168.1.108:2181 16:25:23.453 [main-SendThread(dn3:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Session establishment request sent on dn3/ 192.168.1.108:2181 16:25:23.458 [main-SendThread(dn3:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server dn3/192.168.1.108:2181, session id = 0x300001b87e00003, negotiated timeout = 4000 WATCHER:: WatchedEvent state:SyncConnected type:None path:null zxid: -1 Welcome to ZooKeeper! JLine support is enabled [zk: dn3:2181(CONNECTED) 0] 16:25:24.795 [main-SendThread(dn3:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for session id: 0x300001b87e00003 after 6ms. 16:25:26.129 [main-SendThread(dn3:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for session id: 0x300001b87e00003 after 3ms. 16:25:27.464 [main-SendThread(dn3:2181)] DEBUG org.apache.zookeeper.ClientCnxn - Got ping response for session id: 0x300001b87e00003 after 3ms. I also see this in the logfile 16:31:08.875 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.SessionTrackerImpl - Checking session 0x300002093eb0004 16:31:08.876 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.quorum.CommitProcessor - Processing request:: sessionid:0x300002093eb0004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:08.876 [CommitProcWorkThread-5] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - Processing request:: sessionid:0x300002093eb0004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:08.876 [CommitProcWorkThread-5] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - sessionid:0x300002093eb0004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:08.998 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.SessionTrackerImpl - Checking session 0x300002093eb0003 16:31:08.998 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.quorum.CommitProcessor - Processing request:: sessionid:0x300002093eb0003 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:08.998 [CommitProcWorkThread-4] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - Processing request:: sessionid:0x300002093eb0003 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:08.998 [CommitProcWorkThread-4] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - sessionid:0x300002093eb0003 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:09.191 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.SessionTrackerImpl - Checking session 0x300001b87e00004 16:31:09.191 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.quorum.CommitProcessor - Processing request:: sessionid:0x300001b87e00004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:09.191 [CommitProcWorkThread-13] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - Processing request:: sessionid:0x300001b87e00004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:09.191 [CommitProcWorkThread-13] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - sessionid:0x300001b87e00004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:10.526 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.SessionTrackerImpl - Checking session 0x300001b87e00004 16:31:10.526 [ProcessThread(sid:3 cport:-1):] DEBUG org.apache.zookeeper.server.quorum.CommitProcessor - Processing request:: sessionid:0x300001b87e00004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:10.526 [CommitProcWorkThread-13] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - Processing request:: sessionid:0x300001b87e00004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 16:31:10.526 [CommitProcWorkThread-13] DEBUG org.apache.zookeeper.server.FinalRequestProcessor - sessionid:0x300001b87e00004 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a