[
https://issues.apache.org/jira/browse/HBASE-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927128#action_12927128
]
Jonathan Gray commented on HBASE-3182:
--------------------------------------
Tripped over this again but didn't even seem to relate to META. Just got this
uncaught exception that killed my shutdown handler.
> If server hosting META dies or is stopping while processing another server
> shutdown, IOE accessing META stop shutdown handler from finishing
> --------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-3182
> URL: https://issues.apache.org/jira/browse/HBASE-3182
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.0
> Reporter: Jonathan Gray
> Priority: Critical
> Fix For: 0.90.0
>
>
> In TestRollingRestart, there is a test which kills server hosting ROOT then
> immediately kills server hosting META. In a recent run this turned up a
> small race condition if the server hosting META is closing while we process
> shutdown of server hosting ROOT.
> {noformat}
> 2010-10-31 20:41:34,621 ERROR
> [MASTER_META_SERVER_OPERATIONS-dev692.sf2p.facebook.com:54989-0]
> executor.EventHandler(154): Caught throwable while processing event
> M_META_SERVER_SHUTDOWN
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: Server not running
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.checkOpen(HRegionServer.java:2216)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1652)
> at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:561)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1025)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:749)
> at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:255)
> at $Proxy8.openScanner(Unknown Source)
> at
> org.apache.hadoop.hbase.catalog.MetaReader.getServerUserRegions(MetaReader.java:495)
> at
> org.apache.hadoop.hbase.master.handler.ServerShutdownHandler.process(ServerShutdownHandler.java:125)
> at
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:151)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> at java.lang.Thread.run(Thread.java:619)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.