Provide a stronger data guarantee in the write pipeline
-------------------------------------------------------
Key: HDFS-1606
URL: https://issues.apache.org/jira/browse/HDFS-1606
Project: Hadoop HDFS
Issue Type: New Feature
Components: data-node, hdfs client
Reporter: Tsz Wo (Nicholas), SZE
In the current design, if there is a datanode/network failures in the write
pipeline, DFSClient will try to remove the failed datanode from the pipeline
and then continue writing with the remaining datanodes. As a result, the
number of datanodes in the pipeline is decreased. Unfortunately, it is
possible that DFSClient may incorrectly remove a healthy datanode but leave the
failed datanode in the pipeline because failure detection may not be accurate
under erroneous conditions.
We propose to add a new mechanism for adding new datanodes to the pipeline in
order to provide a stronger data guarantee.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
