[ 
https://issues.apache.org/jira/browse/HBASE-13935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592276#comment-14592276
 ] 

Matteo Bertozzi commented on HBASE-13935:
-----------------------------------------

that unit test is ok, but does seems to be the real case. 
if the znode is marked ENABLED we should already have dirs on the fs,
what happens at that point with create? it fails, it will just have regions on 
the fs that are not present in meta and hbck will complain about it?

did you check what was the state of the znode on failure? was it ENABLED or 
something else? was there stuff on the fs? 

> Orphaned namespace table ZK node should not prevent master to start
> -------------------------------------------------------------------
>
>                 Key: HBASE-13935
>                 URL: https://issues.apache.org/jira/browse/HBASE-13935
>             Project: HBase
>          Issue Type: Bug
>          Components: master
>    Affects Versions: 1.0.0, 0.98.13
>            Reporter: Stephen Yuan Jiang
>            Assignee: Stephen Yuan Jiang
>         Attachments: HBASE-13935.v1-0.98.patch
>
>
> Before we have the state-of-art Procedure V2 feature (HBASE 1.0 release or 
> older), we frequently see the following issue (orphaned ZK node) that prevent 
> master to start (at least in testing):
> {noformat}
> 2015-06-16 17:54:36,472 FATAL [master:10.0.0.99:60000] master.HMaster: 
> Unhandled exception. Starting shutdown.
> org.apache.hadoop.hbase.TableExistsException: hbase:namespace
>       at 
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:137)
>       at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232)
>       at 
> org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86)
>       at 
> org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1123)
>       at 
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:947)
>       at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:618)
>       at java.lang.Thread.run(Thread.java:745)
> 2015-06-16 17:54:36,472 INFO  [master:10.0.0.99:60000] master.HMaster: 
> Aborting
> {noformat}
> The above call trace is from a 0.98.x test run.  We saw similar issue in 
> 1.0.x run, too.  
> The proposed fix is to ignore the zk node and force namespace table creation 
> to be complete so that master can start successfully.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to