Rushabh S Shah created HDFS-11617:
-------------------------------------
Summary: Datanode should delete the block from rbw direcotry when
it finds duplicate in finalized directory.
Key: HDFS-11617
URL: https://issues.apache.org/jira/browse/HDFS-11617
Project: Hadoop HDFS
Issue Type: Bug
Components: datanode
Affects Versions: 2.7.3
Reporter: Rushabh S Shah
Recently we had power failure event and we hit HDFS-5042.
There were missing blocks but datanode had the copy of the block (and meta
file) in rbw directory.
I manually copied the block and meta file to finalized directory and restarted
the datanode.
But after restart, the block somehow got deleted from the finalized directory.
So I think the datanode tried to resolve duplicate replicas and in process of
resolving it deleted the replica from finalized directory.
In my opinion, if we have to choose between rbw replica and finalized replica
(assuming size and genstamp are same), we should delete rbw replica, not
finalized replica.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
