Hi Ram,
I too expected that to happen. But instead of reallocating the regions, the
HMAster loses the regions present in the killed region server.
HMaster log trace:
-01-12 22:19:18,586 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
Handling transition=M_ZK_REGION_OFFLINE, server=Namenode:60000,
region=72901a68e2a989a6eaa84abf3c8d50e9
2012-01-12 22:19:18,586 WARN
org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment of
usertable,user2284740271004412903,1326379492626.72901a68e2a989a6eaa84abf3c8d50e9.
to serverName=killedServer,60020,1326381603926, load=(requests=0, regions=0,
usedHeap=0, maxHeap=0), trying to assign elsewhere instead; retry=0
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:328)
at
org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:883)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:750)
at
org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
at $Proxy6.openRegion(Unknown Source)
at
org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:561)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1043)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:858)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:838)
at
org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:92)
at
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:156)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
2012-01-12 22:19:18,587 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: No previous transition
plan was found (or we are ignoring an existing plan) for
usertable,user2284740271004412903,1326379492626.72901a68e2a989a6eaa84abf3c8d50e9.
so generated a random one;
hri=usertable,user2284740271004412903,1326379492626.72901a68e2a989a6eaa84abf3c8d50e9.,
src=, dest=hdindex005mwh,60020,1326434624928; 5 (online=5,
exclude=serverName=killedServer,60020,1326381603926, load=(requests=0,
regions=0, usedHeap=0, maxHeap=0)) available servers
2012-01-12 22:19:18,587 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x133687c8252017b Creating (or updating) unassigned node for
72901a68e2a989a6eaa84abf3c8d50e9 with OFFLINE state
2012-01-12 22:19:18,591 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=RS_ZK_REGION_OPENING, server=hdindex002mwh,60020,1326381241252,
region=c9ae9fead42096e189a829ad4dfd79c0
2012-01-12 22:19:18,598 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=M_ZK_REGION_OFFLINE, server=Masterserver:60000,
region=57d4bf6d229a431ab09bb485d2837785
2012-01-12 22:19:18,598 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing plan
for region
usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.;
plan=hri=usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.,
src=hdindex002mwh,60020,1326381241252,
dest=hdindex003mwh.io.askjeeves.info,60020,1326381603926
2012-01-12 22:19:18,598 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Assigning region
usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.
to killedServer,60020,1326381603926
2012-01-12 22:19:18,598 WARN
org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment of
usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.
to serverName=killedServer,60020,1326381603926, load=(requests=0, regions=0,
usedHeap=0, maxHeap=0), trying to assign elsewhere instead; retry=0
Hi Sriram
What is the problem that you are getting ? Any exceptions in logs?
Ideally the master will reallocate all the regions belonging to the region
server that
Went down.
Regards
Ram
--
View this message in context:
http://old.nabble.com/HMaster-region-not-reallocated-in-HBase-0.90.4-tp33132952p33134124.html
Sent from the HBase User mailing list archive at Nabble.com.
