[ 
https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kai Zheng updated HDFS-7679:
----------------------------
    Description: Based on the work done, we will have similar constructs like 
ECEncoder/Decoder, local/remote block reader/writer in both client and DataNode 
side, so it's possible to refactor the codes further and unify these constructs 
to eliminate possible duplicate codes.  (was: EC tasks such as client striping 
write, encode replicated file to EC style,  transform block layout from 
contiguous to striping, reconstruct some corrupt blocks, etc, have similar 
behavior. They all read data from client/BlockGroup, encode/decode them, and 
write the results to some datanodes. So we can use a unified framework to 
handle all these tasks. We can use different BlockGroupReader, 
Coder(ECEncoder/ECDecoder) and BlockWriter to handle different EC tasks.)

> Unifying erasure coder work, block reader and block writer across client and 
> DataNode
> -------------------------------------------------------------------------------------
>
>                 Key: HDFS-7679
>                 URL: https://issues.apache.org/jira/browse/HDFS-7679
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: ECEncodeDecodeFramework.patch
>
>
> Based on the work done, we will have similar constructs like 
> ECEncoder/Decoder, local/remote block reader/writer in both client and 
> DataNode side, so it's possible to refactor the codes further and unify these 
> constructs to eliminate possible duplicate codes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to