Hi,
I am using HBase 0.90 and our job fails consistently with the following
exception:
Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException:
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:147)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1035)
... 19 more
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase
at org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:608)
at
org.apache.hadoop.hbase.zookeeper.ZKUtil.createAndFailSilent(ZKUtil.java:902)
at
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:133)
... 20 more
Zookeeper quorum runs on the same node as NameNode. HMaster is on another
node. Hadoop is cdh3b2.
In zookeeper log, I see (10.202.50.79 is the same node where the exception
above happened):
2011-01-04 18:47:40,633 WARN org.apache.zookeeper.server.NIOServerCnxn: Too
many connections from /10.202.50.79 - max is 30
2011-01-04 18:47:41,187 WARN org.apache.zookeeper.server.NIOServerCnxn: Too
many connections from /10.202.50.79 - max is 30
2011-01-04 18:47:42,375 WARN org.apache.zookeeper.server.NIOServerCnxn: Too
many connections from /10.202.50.79 - max is 30
2011-01-04 18:47:42,447 WARN org.apache.zookeeper.server.NIOServerCnxn: Too
many connections from /10.202.50.79 - max is 30
2011-01-04 18:47:43,113 WARN org.apache.zookeeper.server.NIOServerCnxn:
EndOfStreamException: Unable to read additional data from client sessionid
0x12d5220eb970025, likely client has closed socket
2011-01-04 18:47:43,113 INFO org.apache.zookeeper.server.NIOServerCnxn:
Closed socket connection for client /10.202.50.79:37845 which had sessionid
0x12d5220eb970025
2011-01-04 18:47:43,113 WARN org.apache.zookeeper.server.NIOServerCnxn:
EndOfStreamException: Unable to read additional data from client sessionid
0x12d5220eb970087, likely client has closed socket
Please advise what parameter I should tune.
Thanks
