[ 
https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15149672#comment-15149672
 ] 

Jing Zhao commented on HDFS-9603:
---------------------------------

Thanks for volunteering on the hflush/hsync work, [~lewuathe]! So far we have a 
in-progress design doc posted in HDFS-7661, and I know [~liuml07] is also 
working on another design and may post it very soon. We can keep using the same 
jira for further discussion on the design.

I totally agree hflush/hsync should have higher priority. Without it we cannot 
support use cases like hbase/hive and a lot of other mapreduce jobs. But I 
think hflush/hsync is complicated (especially when recovery is also involved) 
and I guess we may need several jiras to do the work. So far we still have a 
lot of missing pieces in the design, then we can have a more clear plan about 
its implementation.

> Erasure Coding: Use ErasureCoder to encode/decode a block group
> ---------------------------------------------------------------
>
>                 Key: HDFS-9603
>                 URL: https://issues.apache.org/jira/browse/HDFS-9603
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HDFS-9603.1.patch, HDFS-9603.2.patch, HDFS-9603.3.patch
>
>
> According to design, {{ErasureCoder}} is responsible to encode/decode a block 
> group. Currently however, we directly use {{RawErasureCoder}} to do the work, 
> e.g. in {{DFSStripedOutputStream}}. This task attempts to encapsulate 
> {{RawErasureCoder}} to comply with the design.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to