First, thank you for looking at this for me. Second, the network is up. It is dedicated to the cluster and it appears stable.
Third, I haven't modified the zoo.cfg; however, I have put it on pastebin. I made all my zookeeper changes in hbase-site.xml zoo.cfg -- http://pastebin.com/download.php?i=askC9VRG hbase-site.xml -- http://pastebin.com/download.php?i=DkLGr57G HMASTER LOG -- http://pastebin.com/download.php?i=i4U52cWf ZK (devrackA-03) -- http://pastebin.com/download.php?i=CRyQFKFF ZK (devrackA-04) -- http://pastebin.com/download.php?i=WAqAhjdh ZK (devrackA-05) -- http://pastebin.com/download.php?i=cS1Gm19x RS (devrackA-06) -- http://pastebin.com/download.php?i=XayB2HeX RS (devrackB-07) -- http://pastebin.com/download.php?i=RQZ45a8j RS (devrackB-08) -- http://pastebin.com/download.php?i=ZDZD0z7B --- Jay Wilson On 7/3/2012 5:23 PM, Amandeep Khurana wrote: > Can you put your zoo.cfg and hbase-site.xml on pastebin and put the links > here? Have you verified that your network is fine? > Also, can you put up your RS and ZK logs too? > > > > On Tuesday, July 3, 2012 at 5:19 PM, Jay Wilson wrote: > >> I have reread the sections in the O'Reilly HBase book on cluster >> configuration and troubleshooting and I am still getting "session >> expired" after X number of minutes. X being anywhere from 15 to 20 minutes. >> >> There is 0 load on the cluster and it's using a dedicated isolated >> network. No jobs running just the Hadoop/Hbase java processes. >> >> I have separated the Hadoop and HBase processes as follows: >> >> devrackA-00 (NameNode) >> devrackA-01 (SecondaryNameNode) >> devrackA-03 (HQuorumPeer + HMaster) >> devrackA-04 (HQuorumPeer) >> devrackA-05 (HQuorumPeer) >> devrackA-06 (HRegionServer) >> devrackA-07 >> to (DataNode) >> devrackA-20 >> devrackB-00 >> to (DataNode) >> devrackB-06 >> devrackB-07 (HRegionServer) >> devrackB-08 (HRegionServer) >> devrackB-09 >> to (DataNode) >> devrackB-20 >> >> I did have DataNode on my HQuorumPeers and HRegionServers, but I have >> excluded them and verified they are excluded: >> >> Name: devrackA-03 >> Decommission Status : Normal >> Configured Capacity: 0 (0 KB) >> DFS Used: 0 (0 KB) >> Non DFS Used: 0 (0 KB) >> DFS Remaining: 0(0 KB) >> DFS Used%: 100% >> DFS Remaining%: 0% >> Last contact: Wed Dec 31 16:00:00 PST 1969 >> >> >> Name: devrackA-04 >> Decommission Status : Normal >> Configured Capacity: 0 (0 KB) >> DFS Used: 0 (0 KB) >> Non DFS Used: 0 (0 KB) >> DFS Remaining: 0(0 KB) >> DFS Used%: 100% >> DFS Remaining%: 0% >> Last contact: Wed Dec 31 16:00:00 PST 1969 >> >> >> Name: devrackA-05 >> Decommission Status : Normal >> Configured Capacity: 0 (0 KB) >> DFS Used: 0 (0 KB) >> Non DFS Used: 0 (0 KB) >> DFS Remaining: 0(0 KB) >> DFS Used%: 100% >> DFS Remaining%: 0% >> Last contact: Wed Dec 31 16:00:00 PST 1969 >> >> Name: devrackA-06 >> Decommission Status : Normal >> Configured Capacity: 0 (0 KB) >> DFS Used: 0 (0 KB) >> Non DFS Used: 0 (0 KB) >> DFS Remaining: 0(0 KB) >> DFS Used%: 100% >> DFS Remaining%: 0% >> Last contact: Wed Dec 31 16:00:00 PST 1969 >> >> >> Name: devrackB-07 >> Decommission Status : Normal >> Configured Capacity: 0 (0 KB) >> DFS Used: 0 (0 KB) >> Non DFS Used: 0 (0 KB) >> DFS Remaining: 0(0 KB) >> DFS Used%: 100% >> DFS Remaining%: 0% >> Last contact: Wed Dec 31 16:00:00 PST 1969 >> >> >> Name: devrackB-08 >> Decommission Status : Normal >> Configured Capacity: 0 (0 KB) >> DFS Used: 0 (0 KB) >> Non DFS Used: 0 (0 KB) >> DFS Remaining: 0(0 KB) >> DFS Used%: 100% >> DFS Remaining%: 0% >> Last contact: Wed Dec 31 16:00:00 PST 1969 >> >> I must be missing a fundamental setting. Thoughts? >> >> Thank You >> --- >> Jay Wilson >> >> > > >
