There's a quick work-around.

All regions get stuck when trying assigning themselves to host 'dtla1apps21' 
(from log message). It indicates the RS on that host how some becomes 
problematic.

In this case, you can stop the RS on that host which will trigger all STUCK 
regions to assign themselves to other RSs. 


--------------------------

Best regards,
R.C




________________________________________
From: 青椒肉丝 <1336318...@qq.com>
Sent: 11 October 2019 15:24
To: busbey; user
Subject: Re:  Hbase errors for " ERROR: 
org.apache.hadoop.hbase.PleaseHoldException:Master is initializing"

hi Sean,
    My hbase version is  hbase2.1.0+cdh6.1.0 ,  And I've seen the logs of HBase 
master, but there are only some RIT status logs , which are as follows


“  2019-10-11 15:12:00,696 WARN org.apache.hadoop.hbase.master.CatalogJanitor: 
CatalogJanitor is disabled! Enabled=true, maintenanceMode=false, 
am=org.apache.hadoop.hbase.master.assignment.AssignmentManager@60c2bb1b, 
metaLoaded=true, hasRIT=true clusterShutDown=false
2019-10-11 15:12:42,597 INFO SecurityLogger.org.apache.hadoop.hbase.Server: 
Connection from X.X.X.X:59064, version=2.1.0-cdh6.2.0, sasl=false, ugi=hbase 
(auth:SIMPLE), service=MasterService
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_CGMROZNC85, region=8f4bd153aba8f5c727a9de409cff6136
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_NYBD0OX5WG, region=b07600e84a852938d9dd2ec323246ac6
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_B3XSLI6DBK, region=49beda7ec05ffec6d238ebbf568a8c6c
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_5QDDBMS68Q, region=f711df5144d4b706ecd2af9fabc2eba7
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_B3XSLI6DBK, region=0e23a092963bdebd4bbf92ed0a25ad40
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_CGMROZNC85, region=f96d2c76ec9b31bbb166305507807af4
2019-10-11 15:13:00,293 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_KVR1JIOD9F, region=835dfd5d87640f0bed48f605cfa6c39c
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_2ZJ8M4PT96, region=eb35edb36de7f0866af45a5921584197
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_B3XSLI6DBK, region=bf040047d1d1db74cb92bd05ac75376b
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_2ZJ8M4PT96, region=d8a94206df91132d28548b3ea48bcc57
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_NYBD0OX5WG, region=5aa573da499a2b7a6a3b1b7b534d01e1
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_KVR1JIOD9F, region=97b2010687b632449e1682b2d6030028
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_B3XSLI6DBK, region=6103048c6aef0816ee69a20d294c6d19
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_3L8MX901Y2, region=c67f935d8ce72ed3ea505b507968d93e
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_2ZJ8M4PT96, region=e3a8eba16110f5a7f1e7ad20fbe45634
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_2ZJ8M4PT96, region=1a3f6b1f03c417bc04234bcdc97146c6
2019-10-11 15:13:00,294 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: STUCK 
Region-In-Transition rit=OPENING, location=dtla1apps21,16020,1566557484692, 
table=KYLIN_CGMROZNC85, region=f46ca8c4f65a7c99ccd0dab22e4b83dd
 ........”


Actually, now I can see from the HBase page which regions are in the opening 
state. And the regions of these openinng states can now be queried, but I don't 
know how to deal with this error of    " 
ERROR:org.apache.hadoop.hbase.PleaseHoldException: Master is initializing"




DavidShao




------------------ Original ------------------
From:  "Sean Busbey";<bus...@apache.org>;
Send time: Friday, Oct 11, 2019 2:16 PM
To: "Hbase-User"<user@hbase.apache.org>;

Subject:  Re: Hbase errors for " ERROR: 
org.apache.hadoop.hbase.PleaseHoldException:Master is initializing"



what version of hbase are you using?

If master is still initializing, then probably one of the regions in
transition is the region for meta, or a region for a system table (e.g.
hbase:namespace). You should check the master logs to figure out which one
and what their state is.

On Fri, Oct 11, 2019 at 1:09 AM 青椒肉丝 <1336318...@qq.com> wrote:

> hi ,guys:
>    My HBase made the following mistakes when creating a build table or
> disable table
>     " ERROR: org.apache.hadoop.hbase.PleaseHoldException: Master is
> initializing
>         at
> org.apache.hadoop.hbase.master.HMaster.checkInitialized(HMaster.java:2998)
>         at
> org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1968)
>         at
> org.apache.hadoop.hbase.master.MasterRpcServices.createTable(MasterRpcServices.java:624)
>         at
> org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java)
>         at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
>         at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
>         at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
>         at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) "
>
>
> And the HBase rit state is abnormal,HBase page display "41 region(s) in
> transition for more than 60000 milliseconds.",  Now you can't see any user
> tables from the HBase page, but you can see the list command in the HBase
> shell, If any friend has ever met this kind of problem, please help to
> answer it. Thank you.
>
>
>
>
> DavidShao

Reply via email to