[jira] [Commented] (HDFS-16127) Improper pipeline close recovery causes a permanent write failure or data loss.

[ https://issues.apache.org/jira/browse/HDFS-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382288#comment-17382288 ] Daryn Sharp commented on HDFS-16127: +1 this has become a source of very nasty problems. > Improper

[jira] [Commented] (HDFS-16127) Improper pipeline close recovery causes a permanent write failure or data loss.

[ https://issues.apache.org/jira/browse/HDFS-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380634#comment-17380634 ] Kihwal Lee commented on HDFS-16127: --- There is no unit test in the patch. It isn't easy to instrument

[jira] [Commented] (HDFS-16127) Improper pipeline close recovery causes a permanent write failure or data loss.

[ https://issues.apache.org/jira/browse/HDFS-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380477#comment-17380477 ] Hadoop QA commented on HDFS-16127: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-16127) Improper pipeline close recovery causes a permanent write failure or data loss.

[ https://issues.apache.org/jira/browse/HDFS-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379964#comment-17379964 ] Kihwal Lee commented on HDFS-16127: --- The proposed solution is to check the size of {{ackQueue}} when

[jira] [Commented] (HDFS-16127) Improper pipeline close recovery causes a permanent write failure or data loss.

[ https://issues.apache.org/jira/browse/HDFS-16127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17379961#comment-17379961 ] Kihwal Lee commented on HDFS-16127: --- *How the bug manifests* In DataStreamer thread's main loop, it