[
https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386731#comment-14386731
]
Kai Zheng commented on HDFS-7344:
---------------------------------
Having looked at all the related discussions, and also talked with
[~libo-intel], I made the breakdown and have all the related tasks as linked to
this. As we don't have full thoughts for this part, particularly for converting
between replica and stripping or non-stripping, every sub-task is definitely
subject to further discussion. As many of these tasks are challenging, and
would not be easy for any party, please apologize me for that I distribute them
to guys that would possibly like to help with, but if not, please feel free to
mark them unassigned so for others to consider.
It would be great if we could have more thoughts and discussions on these
aspects and tasks. I will track them down and assemble into the design docs
finally.
> Erasure Coding worker and support in DataNode
> ---------------------------------------------
>
> Key: HDFS-7344
> URL: https://issues.apache.org/jira/browse/HDFS-7344
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode
> Reporter: Kai Zheng
> Assignee: Li Bo
> Attachments: HDFS ECWorker Design.pdf, hdfs-ec-datanode.0108.zip,
> hdfs-ec-datanode.0108.zip
>
>
> According to HDFS-7285 and the design, this handles DataNode side extension
> and related support for Erasure Coding, and implements ECWorker. The handled
> use cases:
> * Converting replica blocks into stripping erasure coding blocks;
> * Converting replica blocks into non-stripping erasure coding blocks;
> * Recovering erased stripping erasure coding blocks;
> * Recovering erased non-stripping erasure coding blocks;
> * On-demand recovering serving client request for erased non-stripping
> erasure coding blocks.
> It generally needs to restore BlockGroup and schema information from coding
> commands from NameNode or other entities, and construct specific coding work
> to execute. The required block reader, writer, either local or remote,
> encoder and decoder, will be implemented separately as sub-tasks.
> This JIRA will track all the linked sub-tasks, and is responsible for general
> discussions and integration for ECWorker. It won't resolve until all the
> related tasks are done.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
