[
https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HDFS-7661:
--------------------------------
Attachment: HDFS-EC-file-flush-sync-design-version2.1.pdf
Attached the v2.1 design doc, based on the offline discussion with [~jingzhao]
and [~szetszwo]. The main changes are:
* Besides the current design, we also save the last cell data in undo log
before overwriting. This way we can tolerate overwriting failures and
reconstruct the block group by the last flushed length.
* Rewrite the Challenges section for elaborating the details that motivated our
design.
I'm updating the demo patch (writer client and DN) according to the revised
design and will post it in 1~2 weeks. Code for read and reconstruction work
will be dealt with collaboratively and be tracked separately.
Feel free to send feedback, and thanks for the review.
> Erasure coding: support hflush and hsync
> ----------------------------------------
>
> Key: HDFS-7661
> URL: https://issues.apache.org/jira/browse/HDFS-7661
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Tsz Wo Nicholas Sze
> Assignee: GAO Rui
> Attachments: EC-file-flush-and-sync-steps-plan-2015-12-01.png,
> HDFS-7661-unitTest-wip-trunk.patch, HDFS-7661-wip.01.patch,
> HDFS-EC-file-flush-sync-design-version1.1.pdf,
> HDFS-EC-file-flush-sync-design-version2.0.pdf,
> HDFS-EC-file-flush-sync-design-version2.1.pdf
>
>
> We also need to support hflush/hsync and visible length.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
