[
https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103171#comment-14103171
]
Colin Patrick McCabe commented on HDFS-6867:
--------------------------------------------
We don't support variable size blocks in HDFS now. That would be a big project
in and of itself.
I think the first step here is a design doc spelling out the approach. Also,
we might want to consider doing the async recovery only when the sync recovery
fails, since that would provide the greatest protection.
> For DFSOutputStream, do pipeline recovery for a single block in the background
> ------------------------------------------------------------------------------
>
> Key: HDFS-6867
> URL: https://issues.apache.org/jira/browse/HDFS-6867
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs-client
> Affects Versions: 2.0.0-alpha
> Reporter: Colin Patrick McCabe
>
> For DFSOutputStream, we should be able to do pipeline recovery in the
> background, while the user is continuing to write to the file. This is
> especially useful for long-lived clients that write to an HDFS file slowly.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
