[
https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Zheng updated HDFS-7337:
----------------------------
Attachment: HDFS-7337-prototype-v2.zip
Updated the prototype codes listed as follows.
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/ec:
./ECSchema.java
./BlockGroup.java
./ECBlock.java
./ECChunk.java
./ECConfiguration.java
./SchemaLoader.java
./SubBlockGroup.java
./grouper/BlockGrouper.java
./grouper/LRCBlockGrouper.java
./grouper/RSBlockGrouper.java
./codec/ErasureCodec.java
./codec/IsaLRCErasureCodec.java
./codec/IsaRSErasureCodec.java
./codec/JavaRSErasureCodec.java
./codec/JerasureRSErasureCodec.java
./codec/LRCErasureCodec.java
./codec/RSErasureCodec.java
./coder/AbstractErasureCoder.java
./coder/ErasureCoder.java
./coder/IsaLRCErasureCoder.java
./coder/IsaRSErasureCoder.java
./coder/JavaRSErasureCoder.java
./coder/JerasureRSErasureCoder.java
./coder/LRCErasureCoder.java
./coder/RSErasureCoder.java
./coder/util/GaloisField.java
./rawcoder/AbstractRawErasureCoder.java
./rawcoder/impl/IsaReedSolomonDecoder.java
./rawcoder/impl/IsaReedSolomonEncoder.java
./rawcoder/IsaRSRawErasureCoder.java
./rawcoder/JavaRSRawErasureCoder.java
./rawcoder/JavaXORRawErasureCoder.java
./rawcoder/RawErasureCoder.java
> Configurable and pluggable Erasure Codec and schema
> ---------------------------------------------------
>
> Key: HDFS-7337
> URL: https://issues.apache.org/jira/browse/HDFS-7337
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Zhe Zhang
> Assignee: Kai Zheng
> Attachments: HDFS-7337-prototype-v1.patch,
> HDFS-7337-prototype-v2.zip, PluggableErasureCodec.pdf
>
>
> According to HDFS-7285 and the design, this considers to support multiple
> Erasure Codecs via pluggable approach. It allows to define and configure
> multiple codec schemas with different coding algorithms and parameters. The
> resultant codec schemas can be utilized and specified via command tool for
> different file folders. While design and implement such pluggable framework,
> it’s also to implement a concrete codec by default (Reed Solomon) to prove
> the framework is useful and workable. Separate JIRA could be opened for the
> RS codec implementation.
> Note HDFS-7353 will focus on the very low level codec API and implementation
> to make concrete vendor libraries transparent to the upper layer. This JIRA
> focuses on high level stuffs that interact with configuration, schema and etc.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
