I have reread the sections in the O'Reilly HBase book on cluster configuration and troubleshooting and I am still getting "session expired" after X number of minutes. X being anywhere from 15 to 20 minutes.
There is 0 load on the cluster and it's using a dedicated isolated network. No jobs running just the Hadoop/Hbase java processes. I have separated the Hadoop and HBase processes as follows: devrackA-00 (NameNode) devrackA-01 (SecondaryNameNode) devrackA-03 (HQuorumPeer + HMaster) devrackA-04 (HQuorumPeer) devrackA-05 (HQuorumPeer) devrackA-06 (HRegionServer) devrackA-07 to (DataNode) devrackA-20 devrackB-00 to (DataNode) devrackB-06 devrackB-07 (HRegionServer) devrackB-08 (HRegionServer) devrackB-09 to (DataNode) devrackB-20 I did have DataNode on my HQuorumPeers and HRegionServers, but I have excluded them and verified they are excluded: Name: devrackA-03 Decommission Status : Normal Configured Capacity: 0 (0 KB) DFS Used: 0 (0 KB) Non DFS Used: 0 (0 KB) DFS Remaining: 0(0 KB) DFS Used%: 100% DFS Remaining%: 0% Last contact: Wed Dec 31 16:00:00 PST 1969 Name: devrackA-04 Decommission Status : Normal Configured Capacity: 0 (0 KB) DFS Used: 0 (0 KB) Non DFS Used: 0 (0 KB) DFS Remaining: 0(0 KB) DFS Used%: 100% DFS Remaining%: 0% Last contact: Wed Dec 31 16:00:00 PST 1969 Name: devrackA-05 Decommission Status : Normal Configured Capacity: 0 (0 KB) DFS Used: 0 (0 KB) Non DFS Used: 0 (0 KB) DFS Remaining: 0(0 KB) DFS Used%: 100% DFS Remaining%: 0% Last contact: Wed Dec 31 16:00:00 PST 1969 Name: devrackA-06 Decommission Status : Normal Configured Capacity: 0 (0 KB) DFS Used: 0 (0 KB) Non DFS Used: 0 (0 KB) DFS Remaining: 0(0 KB) DFS Used%: 100% DFS Remaining%: 0% Last contact: Wed Dec 31 16:00:00 PST 1969 Name: devrackB-07 Decommission Status : Normal Configured Capacity: 0 (0 KB) DFS Used: 0 (0 KB) Non DFS Used: 0 (0 KB) DFS Remaining: 0(0 KB) DFS Used%: 100% DFS Remaining%: 0% Last contact: Wed Dec 31 16:00:00 PST 1969 Name: devrackB-08 Decommission Status : Normal Configured Capacity: 0 (0 KB) DFS Used: 0 (0 KB) Non DFS Used: 0 (0 KB) DFS Remaining: 0(0 KB) DFS Used%: 100% DFS Remaining%: 0% Last contact: Wed Dec 31 16:00:00 PST 1969 I must be missing a fundamental setting. Thoughts? Thank You --- Jay Wilson
