Sounds like 2047 is not enough. Up it again. 4k? St.Ack
2010/9/1 xiujin yang <[email protected]>: > > Thank you J-D. > > > I've checked two datanode log and found the same error. "exceeds the limit > of concurrent xcievers 2047" > > > [2010-08-31 > 10:43:26][error][org.apache.hadoop.hdfs.server.datanode.dataxcei...@5a809419][org.apache.hadoop.hdfs.server.datanode.dataxceiver.run(DataXceiver.java:131)] > DatanodeRegistration(192.168.158.172:50010, > storageID=DS-1961101492-192.168.158.172-50010-1273570850144, infoPort=50075, > ipcPort=50020):DataXceiver > java.io.IOException: xceiverCount 2048 exceeds the limit of concurrent > xcievers 2047 > at > org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:88) > at java.lang.Thread.run(Thread.java:619) > > > > 172: > http://pastebin.com/cdw2svHT > > 177: > http://pastebin.com/iA3jxfuq > > Our cluster 4CPU & 6G RAM. is as following: > HBase region server node don't have HDFS. Is this related with the error? Do > I need to increase the xcievers from 2047 --> XX? > > Hadoop > 192.168.158.176 Master > > > 192.168.158.171 Slave > 192.168.158.172 Slave > > 192.168.158.174 Slave > > 192.168.158.177 Slave & SNN > > 192.168.158.180 Slave > > 192.168.158.186 Slave > > > HBase Only > 192.168.158.179 HMaster & RS & ZK > > > 192.168.158.187 RS & ZK > > > 192.168.158.188 RS & ZK > > > > > Thank you in advance. > > -- Xiujin Yang. > ----------------------------------------------------------------- > My linkedin: http://cn.linkedin.com/in/xiujinyang > >> Date: Wed, 1 Sep 2010 10:30:44 -0700 >> Subject: Re: Region servers down... >> From: [email protected] >> To: [email protected] >> >> This is errors coming from HDFS, I would start looking at the datanode >> log on the same machine for any exceptions thrown at the same time. >> Also make sure your cluster is properly configured according to the >> last bullet point in the requirements >> http://hbase.apache.org/docs/r0.20.6/api/overview-summary.html#requirements >> >> J-D >> >> 2010/8/31 xiujin yang <[email protected]>: >> > >> > >> > HBase: 0.20.6 >> > Hadoop: 0.20.2 >> > >> > After I upgrage to 0.20.6, >> > It run no more than one week and one Region server down again. >> > >> > Please check HBase log: >> > >> > >> > http://pastebin.com/J9LugZ17 >> > >> > >> > >> > HBase out : >> > http://pastebin.com/QKbpSMwq >> > >> > >> > Thank you in advance. >> > >> > Best, >> > >> > -- Xiujin Yang. >> > ----------------------------------------------------------------- >> > My linkedin: http://cn.linkedin.com/in/xiujinyang >> > >> > >> > >> > >
