Haohui Mai created HDFS-7270:
--------------------------------

             Summary: Implementing congestion control in writing pipeline
                 Key: HDFS-7270
                 URL: https://issues.apache.org/jira/browse/HDFS-7270
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Haohui Mai
            Assignee: Haohui Mai


When a client writes to HDFS faster than the disk bandwidth of the DNs, it  
saturates the disk bandwidth and put the DNs unresponsive. The client only 
backs off by aborting / recovering the pipeline, which leads to failed writes 
and unnecessary pipeline recovery.

This jira proposes to add explicit congestion control mechanisms in the writing 
pipeline. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to