Those logs show the end result, but not the cause. Digging in those logs before 18:29 you need to look for the reason why the master didn't see the region server shutting down.
J-D On Wed, Aug 3, 2011 at 6:07 AM, shanmuganathan.r <[email protected]> wrote: > Hi All, > > > I have a problem in HBase fully distributed mode with four node cluster. > My Hadoop and zookeeper are working properly. The HBase also starting and > running properly but it is not stopped when I give the stop-hbase.sh command. > > > > -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > The log in my master is > > > 2011-08-03 18:29:20,156 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:21,156 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:22,156 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:23,157 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:24,157 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:25,157 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:26,158 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:27,158 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:28,158 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:29,158 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:30,159 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:31,159 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:32,160 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:33,160 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:34,160 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:35,161 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:36,161 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:37,161 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > 2011-08-03 18:29:38,162 INFO org.apache.hadoop.hbase.master.ServerManager: > Waiting on regionserver(s) to go down > mageshv.zohocorpin.com,60020,1312376233494 > > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > > > > The log in my magesh regionserver is > > > > > 2011-08-03 18:28:57,873 INFO > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: > Closed zookeeper sessionid=0x2318fafe4950005 > 2011-08-03 18:28:57,876 INFO org.apache.zookeeper.ZooKeeper: Session: > 0x2318fafe4950005 closed > 2011-08-03 18:28:57,876 INFO org.apache.zookeeper.ClientCnxn: EventThread > shut down > 2011-08-03 18:28:57,880 INFO org.apache.zookeeper.ZooKeeper: Session: > 0x3318faeedc00002 closed > 2011-08-03 18:28:57,880 INFO org.apache.zookeeper.ClientCnxn: EventThread > shut down > 2011-08-03 18:28:57,882 INFO > org.apache.hadoop.hbase.regionserver.HRegionServer: regionserver60020 exiting > 2011-08-03 18:28:57,883 INFO > org.apache.hadoop.hbase.regionserver.ShutdownHook: Shutdown hook starting; > hbase.shutdown.hook=true; fsShutdownHook=Thread[Thread-14,5,main] > 2011-08-03 18:28:57,883 INFO > org.apache.hadoop.hbase.regionserver.HRegionServer: STOPPED: Shutdown hook > 2011-08-03 18:28:57,883 INFO > org.apache.hadoop.hbase.regionserver.ShutdownHook: Starting fs shutdown hook > thread. > 2011-08-03 18:28:57,984 INFO > org.apache.hadoop.hbase.regionserver.ShutdownHook: Shutdown hook finished. > > > > > > -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > > > Thanks in advance.....! > > > Regards, > > Shanmuganathan > > >
