I am using 3 zookeeper node cluster. In our application we are getting Connection loss exception frequently even though application doesn't do any thing special. Now even though if I assume that due to network fluctuations it might get disconnected and try to connect again , but what I am seeing is even though application gets connected to one node for some reason it gets disconnected again tries to connect in another node in ensemble.
2014-04-16 20:02:05,902 | INFO | updating on zookeeper: updateBroker | com.gopal.app.yam.plugin.ZookeeperBroker | Broker zookeeper heartbeat Timer: 562294690 2014-04-16 20:02:11,401 | INFO | Client session timed out, have not heard from server in 3333ms for sessionid 0x24564f590580063, closing socket connection and attempting reconnect | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.01.56:2181) 2014-04-16 20:02:11,504 | WARN | Exception during updateQueue to zookeeper: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /queue/broker/hello.springjms3.test | com.gopal.app.yam.plugin.ZookeeperBroker | Broker zookeeper heartbeat Timer: 562294690 2014-04-16 20:02:11,505 | INFO | updating on zookeeper: updateBroker | com.gopal.app.yam.plugin.ZookeeperBroker | Broker zookeeper heartbeat Timer: 562294690 2014-04-16 20:02:11,588 | INFO | Opening socket connection to server 10.57.00.212/10.57.00.212:2181. Will not attempt to authenticate using SASL (unknown error) | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.83.212:2181) New connection established 2014-04-16 20:02:11,589 | INFO | Socket connection established to 10.57.83.212/10.57.83.212:2181, initiating session | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.83.212:2181) New session established 2014-04-16 20:02:11,594 | INFO | Session establishment complete on server 10.57.83.212/10.57.83.212:2181, sessionid = 0x24564f590580063, negotiated timeout = 5000 | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.00.212:2181) 2014-04-16 20:02:14,928 | INFO | Client session timed out, have not heard from server in 3333ms for sessionid 0x24564f590580063, closing socket connection and attempting reconnect | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.00.212:2181) 2014-04-16 20:02:15,030 | WARN | Exception during updateBroker to zookeeper: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /broker/broker/stageasda | com.gopal.app.yam.plugin.ZookeeperBroker | Broker zookeeper heartbeat Timer: 562294690 2014-04-16 20:02:15,974 | INFO | Opening socket connection to server 10.00.126.67/10.00.126.67:2181. Will not attempt to authenticate using SASL (unknown error) | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.126.67:2181) New connection established 2014-04-16 20:02:15,975 | INFO | Socket connection established to 10.57.126.67/10.57.126.67:2181, initiating session | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.126.67:2181) New session established 2014-04-16 20:02:15,982 | INFO | Session establishment complete on server 10.57.126.67/10.57.126.67:2181, sessionid = 0x24564f590580063, negotiated timeout = 5000 | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.126.67:2181) 2014-04-16 20:02:19,315 | INFO | Client session timed out, have not heard from server in 3333ms for sessionid 0x24564f590580063, closing socket connection and attempting reconnect | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.126.67:2181) 2014-04-16 20:02:19,418 | WARN | Exception during updateResourceUsage to zookeeper: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /running/broekr/_msgstore_leveldb_level1 | com.gopal.app.yam.plugin.ZookeeperBroker | Broker zookeeper heartbeat Timer: 562294690 2014-04-16 20:02:19,845 | INFO | Opening socket connection to server 10.57.01.56/10.57.01.56:2181. Will not attempt to authenticate using SASL (unknown error) | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.134.56:2181) New connection established 2014-04-16 20:02:19,846 | INFO | Socket connection established to 10.57.134.56/10.57.134.56:2181, initiating session | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.134.56:2181) New session established 2014-04-16 20:02:19,847 | INFO | Session establishment complete on server 10.57.134.56/10.57.134.56:2181, sessionid = 0x24564f590580063, negotiated timeout = 5000 | org.apache.zookeeper.ClientCnxn | main-SendThread(10.57.134.56:2181) 2014-04-16 20:02:28,469 | INFO | updating on zookeeper: updateBroker | -- View this message in context: http://zookeeper-user.578899.n2.nabble.com/Frequent-zookeeper-connection-loss-exception-tp7579799.html Sent from the zookeeper-user mailing list archive at Nabble.com.
