[jira] [Comment Edited] (HBASE-27251) Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to `File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo`
[
https://issues.apache.org/jira/browse/HBASE-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572163#comment-17572163
]
Huaxiang Sun edited comment on HBASE-27251 at 7/27/22 11:44 PM:
[~apurtell], let me create one backport Jira. Not sure if skipping these
.tabledesc and .initialized directories are enough. I left one comment in
HBASE-26640 to get Duo's input. Let me fix the "fix version" for HBASE-26640 as
well as it is marked as 2.6.0.
was (Author: huaxiangsun):
[~apurtell], let me create one backport Jira. Not sure if ignore these
.tabledesc and .initialized directories are enough. I left one comment in
HBASE-26640 to get Duo's input. Let me fix the "fix version" for HBASE-26640 as
well as it is marked as 2.6.0.
> Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to `File does not exist:
> /hbase/MasterData/data/master/store/.initialized/.regioninfo`
> ---
>
> Key: HBASE-27251
> URL: https://issues.apache.org/jira/browse/HBASE-27251
> Project: HBase
> Issue Type: Bug
> Components: master
>Affects Versions: 2.5.0
>Reporter: Nick Dimiduk
>Priority: Critical
> Fix For: 2.4.14
>
>
> I was doing some perf testing with builds of 2.5.0. I rolled back to 2.4.13
> and the master won't start. Stack trace ends in,
> {noformat}
> java.io.FileNotFoundException: File does not exist:
> /hbase/MasterData/data/master/store/.initialized/.regioninfo
>
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
>
>at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getBlockLocations(FSDirStatAndListingOp.java:156)
>
>at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2089)
>
>
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:762)
>
>
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:458)
>
> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:604)
>
>
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:572)
>
>
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:556)
>
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1093)
>
>
> at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1043)
>
>
> at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:971)
> at
> java.base/java.security.AccessController.doPrivileged(AccessController.java:712)
>
>
> at java.base/javax.security.auth.Subject.doAs(Subject.java:439)
>
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
>
>
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2976)
> {noformat}
> When I examine the on-disk
[jira] [Comment Edited] (HBASE-27251) Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to `File does not exist: /hbase/MasterData/data/master/store/.initialized/.regioninfo`
[
https://issues.apache.org/jira/browse/HBASE-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572154#comment-17572154
]
Andrew Kyle Purtell edited comment on HBASE-27251 at 7/27/22 11:14 PM:
---
[~huaxiangsun] That code snippet is so close to a PR, I wonder can you file one
please?
I set the fix version to 2.4.14 with the understanding the proposal is to fix
the downgrade on the downgrade side. Can add a release note to both 2.4.14 and
2.5.0 that upgrade to 2.5.0 from 2.4.14 or later is recommended. Is this
sufficient?
was (Author: apurtell):
[~huaxiangsun] That code snippet is so close to a PR, I wonder can you file one
please?
> Rolling back from 2.5.0-SNAPSHOT to 2.4.13 fails due to `File does not exist:
> /hbase/MasterData/data/master/store/.initialized/.regioninfo`
> ---
>
> Key: HBASE-27251
> URL: https://issues.apache.org/jira/browse/HBASE-27251
> Project: HBase
> Issue Type: Bug
> Components: master
>Affects Versions: 2.5.0
>Reporter: Nick Dimiduk
>Priority: Critical
> Fix For: 2.4.14
>
>
> I was doing some perf testing with builds of 2.5.0. I rolled back to 2.4.13
> and the master won't start. Stack trace ends in,
> {noformat}
> java.io.FileNotFoundException: File does not exist:
> /hbase/MasterData/data/master/store/.initialized/.regioninfo
>
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:86)
>
>at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:76)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getBlockLocations(FSDirStatAndListingOp.java:156)
>
>at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2089)
>
>
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:762)
>
>
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:458)
>
> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:604)
>
>
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:572)
>
>
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine2$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine2.java:556)
>
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1093)
>
>
> at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:1043)
>
>
> at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:971)
> at
> java.base/java.security.AccessController.doPrivileged(AccessController.java:712)
>
>
> at java.base/javax.security.auth.Subject.doAs(Subject.java:439)
>
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
>
>
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2976)
> {noformat}
> When I examine the on-disk file system, I see,
> {noformat}
> nonroot@namenode-0:~$ hdfs dfs -ls
