[ 
https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14383233#comment-14383233
 ] 

Kai Zheng commented on HDFS-7717:
---------------------------------

I see. As related discussion when considering NN to distribute the convertion 
tasks, we might wish NN to have some post processes to handling some failures 
in DNs, where the EC encoding task is done but failed to write the result 
parities to targets. In such cases there's a consideration we can have NN to 
schedule some follow up tasks to move those parity blocks to targets. In this 
tool approach, we may lose such options or it would be too complex, so DNs 
would have to complete the whole task successfully or fail at all to ease the 
tool implementation.

> Erasure Coding: provide a tool for convert files between replication and 
> erasure coding
> ---------------------------------------------------------------------------------------
>
>                 Key: HDFS-7717
>                 URL: https://issues.apache.org/jira/browse/HDFS-7717
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Jing Zhao
>            Assignee: Kai Sasaki
>
> We need a tool to do offline conversion between replication and erasure 
> coding. The tool itself can either utilize MR just like the current distcp, 
> or act like the balancer/mover. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to