[
https://issues.apache.org/jira/browse/HDFS-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18042731#comment-18042731
]
ASF GitHub Bot commented on HDFS-17808:
---------------------------------------
hfutatzhanghb commented on PR #7810:
URL: https://github.com/apache/hadoop/pull/7810#issuecomment-3611064603
Hi, @Hexiaoqiao @zhangshuyan0 @haiyang1987 ~ This pr has run in our
production envirnment for more than two months, and works well. The rolling
restart of datanodes is no longer affecting long-term running tasks. Could
you please help review this pr when you have free time? I think this PR is
useful. Thanks a lot!
> EC: End block group in advance to prevent write failure for long-time running
> OutputStream
> ------------------------------------------------------------------------------------------
>
> Key: HDFS-17808
> URL: https://issues.apache.org/jira/browse/HDFS-17808
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: ec, erasure-coding
> Reporter: farmmamba
> Assignee: farmmamba
> Priority: Major
> Labels: pull-request-available
>
> Recently, we met an EC problem in our production.
> User creates an output stream to write ec files. That output stream writes
> some bytes and will be idle for a long time until data is ready. If we
> restart our cluster's datanodes to version up, those applications will
> finally fail due to not have enough healthy streamers.
>
> This Jira try to solve above problem by end block group in advance when we
> already have failed streamers but less than parity number.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
