Append may race with datanode block scanner, causing replica to be incorrectly
marked corrupt
---------------------------------------------------------------------------------------------
Key: HDFS-2798
URL: https://issues.apache.org/jira/browse/HDFS-2798
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node
Affects Versions: 0.23.0, 0.22.0
Reporter: Todd Lipcon
Priority: Critical
When a pipeline is setup for append, the block's metadata file is renamed
before the block is removed from the datanode block scanner queues. This can
cause a race condition where the block scanner incorrectly marks the block as
corrupt, since it tries to scan the file corresponding to the old genstamp.
This causes TestFileAppend2 to time out in extremely rare circumstances - the
corrupt replica prevents the writer thread from completing the file.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
