[
https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381229#comment-14381229
]
Kai Zheng commented on HDFS-7715:
---------------------------------
Thanks [~rashmikv] for your clarifying !
bq.it will be an easy change to make it configurable and flexible to work with
any other parameters.
It's great ! So that means for all the three modes/versions of the algorithm,
we can have flexible parameters rather than hard-coded values, right.
bq.Making the parameters flexible and configurable is not related to reusing
(or not) of existing raw coders.
Sounds good. I agree. What I meant was reusing existing raw coders may help a
little bit for Jack since he may save some trouble for the aspect (like sorting
out the parameters and matrix).
> Implement the Hitchhiker erasure coding algorithm
> -------------------------------------------------
>
> Key: HDFS-7715
> URL: https://issues.apache.org/jira/browse/HDFS-7715
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Zhe Zhang
> Assignee: jack liuquan
> Attachments: HDFS-7715-hhxor-decoder.patch,
> HDFS-7715-hhxor-encoder.patch
>
>
> [Hitchhiker |
> http://www.eecs.berkeley.edu/~nihar/publications/Hitchhiker_SIGCOMM14.pdf] is
> a new erasure coding algorithm developed as a research project at UC
> Berkeley. It has been shown to reduce network traffic and disk I/O by 25%-45%
> during data reconstruction. This JIRA aims to introduce Hitchhiker to the
> HDFS-EC framework, as one of the pluggable codec algorithms.
> The existing implementation is based on HDFS-RAID.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
