What is the jstack result for HMaster while hanging? Wait on the namespace table online or meta table online?
Udo Offermann <udo.offerm...@zfabrik.de> 于2024年4月20日周六 19:43写道: > > Hello everyone, > > We are upgrading our Hadoop/HBase cluster from Hadoop 2.8.5 & HBase 2.2.5 > to Hadoop 3.3.6 & HBase 2.5.7 > > The Hadoop upgrade worked well, but unfortunately we have problems with the > Hbase upgrade, because the master hangs on startup inside the „Starting > assignment manger“ task. > > After 15 minutes the following message appears in the log file: > > Master failed to complete initialization after 900000ms. Please > consider submitting a bug report including a thread dump of this > process. > > > We face the same problem as Adam a couple of weeks ago: "Rolling upgrade > from HBase 2.2.2 to 2.5.8 [typo corrected]: There are 2336 corrupted > procedures“ and we fixed it in the same way by deleting the > MasterProcWALs-folder > in HDFS. > > I can provide HMaster dump and a dump of one data nodes! > > How can we proceed with the upgrade? > > Thanks and best regards > Udo