[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127187#comment-15127187 ]
Kai Zheng commented on HDFS-9719: --------------------------------- When HADOOP-12744 is resolved and this is rebased, the patch here should be smaller. Will refine the codes given some feedbacks. > Refactoring ErasureCodingWorker into smaller reusable constructs > ---------------------------------------------------------------- > > Key: HDFS-9719 > URL: https://issues.apache.org/jira/browse/HDFS-9719 > Project: Hadoop HDFS > Issue Type: Sub-task > Reporter: Kai Zheng > Assignee: Kai Zheng > Attachments: HDFS-9719-v1.patch, HDFS-9719-v2.patch > > > This would suggest and refactor {{ErasureCodingWorker}} into smaller > constructs to be reused in other places like block group checksum computing > in datanode side. As discussed in HDFS-8430 and implemented in HDFS-9694 > patch, checksum computing for striped block groups would be distributed to > datanode in the group, where data block data should be able to be > reconstructed when missed/corrupted to recompute the block checksum. The most > needed codes are in the current ErasureCodingWorker and could be reused in > order to avoid duplication. Fortunately, we have very good and complete > tests, which would make the refactoring much easier. The refactoring will > also help a lot for subsequent tasks in phase II for non-striping erasure > coded files and blocks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)