[
https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Zheng updated HDFS-9719:
----------------------------
Attachment: HDFS-9719-v7.patch
Updated the patch to:
1. Refined some variables, such as toRecoverLen => toReconstructLen;
2. Renamed: StripedReader/Writer => StripedBlockReader/Writer;
StripedReaders/Writers => StripedReader/Writer. Here in
StripedBlockReader/Writer I used the word {{Block}} instead because either
{{chunk}} or {{cell}} may not be true as the reading/writing strategy can be
essentially quite different, and it does serve to read or write block data.
3. Some minors.
[~umamaheswararao], would you help let me know if this works for you or not. I
also wonder if any better names to reflect all the truth exactly. Thanks.
> Refactoring ErasureCodingWorker into smaller reusable constructs
> ----------------------------------------------------------------
>
> Key: HDFS-9719
> URL: https://issues.apache.org/jira/browse/HDFS-9719
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Kai Zheng
> Assignee: Kai Zheng
> Attachments: HDFS-9719-v1.patch, HDFS-9719-v2.patch,
> HDFS-9719-v3.patch, HDFS-9719-v4.patch, HDFS-9719-v5.patch,
> HDFS-9719-v6.patch, HDFS-9719-v7.patch
>
>
> This would suggest and refactor {{ErasureCodingWorker}} into smaller
> constructs to be reused in other places like block group checksum computing
> in datanode side. As discussed in HDFS-8430 and implemented in HDFS-9694
> patch, checksum computing for striped block groups would be distributed to
> datanode in the group, where data block data should be able to be
> reconstructed when missed/corrupted to recompute the block checksum. The most
> needed codes are in the current ErasureCodingWorker and could be reused in
> order to avoid duplication. Fortunately, we have very good and complete
> tests, which would make the refactoring much easier. The refactoring will
> also help a lot for subsequent tasks in phase II for non-striping erasure
> coded files and blocks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
