[
https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14901197#comment-14901197
]
Jing Zhao commented on HDFS-9040:
---------------------------------
bq. In short, bumpGS is useful for choosing working set(healthy replicas). It's
not useful for calculating safe length with given working set. (I think Jing
Zhao just said that if I understand correctly.)
bq. I agree we should bump GS when handling DN failures in write pipeline.
Cool, if we all agree bump GS is still useful, my current proposal is to add
the logic "flushing data before bumping GS for failure recovery" for the patch.
I will upload a new patch today or tomorrow.
bq. We can discuss lease recovery at another jira.
Agree. Lease recovery is tricky and we can start from some design doc first
maybe.
> Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests
> to Coordinator)
> -------------------------------------------------------------------------------------------
>
> Key: HDFS-9040
> URL: https://issues.apache.org/jira/browse/HDFS-9040
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Walter Su
> Attachments: HDFS-9040-HDFS-7285.002.patch,
> HDFS-9040-HDFS-7285.003.patch, HDFS-9040.00.patch, HDFS-9040.001.wip.patch,
> HDFS-9040.02.bgstreamer.patch
>
>
> The general idea is to simplify error handling logic.
> Proposal 1:
> A BlockGroupDataStreamer to communicate with NN to allocate/update block, and
> StripedDataStreamer s only have to stream blocks to DNs.
> Proposal 2:
> See below the
> [comment|https://issues.apache.org/jira/browse/HDFS-9040?focusedCommentId=14741388&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14741388]
> from [~jingzhao].
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)