[
https://issues.apache.org/jira/browse/HBASE-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165828#comment-13165828
]
stack commented on HBASE-4352:
------------------------------
Here is a 0.90.5 master trying to reload a regionserver that has been restarted
as a 0.90.5 (it had been a 0.90.4):
{code}
2011-12-08 22:56:53,807 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
Assigning region
TestTable,0013681953,1323325588029.5d0a564b65a53b1c86f7c02407c82231. to
sv4r9s38,7003,1323384867368
2011-12-08 22:56:53,809 WARN org.apache.hadoop.ipc.HBaseClient: Unexpected
exception receiving call responses
java.lang.NullPointerException
2011-12-08 22:56:53,810 WARN org.apache.hadoop.hbase.master.AssignmentManager:
Failed assignment of
TestTable,0013681953,1323325588029.5d0a564b65a53b1c86f7c02407c82231. to
serverName=sv4r9s38,7003,1323384867368, load=(requests=0, regions=0,
usedHeap=23, maxHeap=493), trying to assign elsewhere instead; retry=0
java.io.IOException: Call to /10.4.9.38:7003 failed on local exception:
java.io.IOException: Unexpected exception receiving call responses
at
org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:806)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:775)
at
org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
at $Proxy7.openRegion(Unknown Source)
at
org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:561)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1043)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:858)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:838)
at
org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:92)
at
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:156)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Unexpected exception receiving call responses
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:481)
Caused by: java.lang.NullPointerException
{code}
It looks like call is null as per another issue that just got committed.
Shouldn't be.
Was getting bunches of this on regionserver side, though it don't seem directly
related:
{code}
2011-12-08 22:56:53,809 DEBUG
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Processing open
of TestTable,0013681953,1323325588029.5d0a564b65a53b1c86f7c02407c82231.
2011-12-08 22:56:53,810 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
regionserver:7003-0x1341fa8d95400cc Attempting to transition node
5d0a564b65a53b1c86f7c02407c82231 from M_ZK_REGION_OFFLINE to
RS_ZK_REGION_OPENING
2011-12-08 22:56:53,811 WARN org.apache.hadoop.hbase.zookeeper.ZKAssign:
regionserver:7003-0x1341fa8d95400cc Attempt to transition the unassigned node
for 5d0a564b65a53b1c86f7c02407c82231 from M_ZK_REGION_OFFLINE to
RS_ZK_REGION_OPENING failed, the node existed but was version 2 not the
expected version -1
2011-12-08 22:56:53,811 WARN
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed
transition from OFFLINE to OPENING for region=5d0a564b65a53b1c86f7c02407c82231
2011-12-08 22:56:53,811 WARN
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Region was
hijacked? It no longer exists, encodedName=5d0a564b65a53b1c86f7c02407c82231
{code}
I was hoping to put up a 0.90.5RC. If you want me to hold a while, I can.
Else, I'll go ahead and cut an RC w/o this.
> Apply version of hbase-4015 to branch
> -------------------------------------
>
> Key: HBASE-4352
> URL: https://issues.apache.org/jira/browse/HBASE-4352
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: ramkrishna.s.vasudevan
> Priority: Blocker
> Attachments: HBASE-4352_0.90.patch, HBASE-4352_0.90_1.patch
>
>
> Consider adding a version of hbase-4015 to 0.90. It changes HRegionInterface
> so would need move change to end of the Interface and then test that it
> doesn't break rolling restart.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
