[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-9079:
--
Labels: hdfs-ec-3.0-nice-to-have (was: )
> Erasure coding: preallocate multiple generation stamps and se
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-9079:
--
Issue Type: Improvement (was: Sub-task)
Parent: (was: HDFS-8031)
> Erasure coding: prealloca
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.15.patch
Updating the patch to harden the handling of expired tokens.
> Erasure coding
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.14.patch
Updating patch to fix a trivial NPE bug and the block token test failure.
So
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.13.patch
The new patch passes all {{TestDFSStripedOutputStreamWithFailurexxx}} tests
l
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.12.patch
Updating the patch to address the NPE error in some unit tests.
{{TestDFSStri
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.11.patch
Updating the patch to fix the scenario where a streamer ends its block before
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.10.patch
Minor fix for test failures.
> Erasure coding: preallocate multiple generatio
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.09.patch
Fixed test failures from last Jenkins run, by addressing the following corner
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.08.patch
The new patch fixed a few bugs:
# DN failures can happen in 2 cases: i) while
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.07.patch
v06 patch miscalculates the size of the finally committed block: if a data
bl
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.06.patch
Updating the patch with more Javadoc and addressing the test failures. In 05
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Description:
A non-striped DataStreamer goes through the following steps in error handling:
{code}
1) Finds e
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.05.patch
Many thanks for Walter's review! Attaching new patch to address the comments.
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.04.patch
The only locally reproducible failure is {{testDatanodeFailureRandomLength}}.
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.03.patch
Updating the patch to fix all reported test failures. Main change is to add
l
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.02.patch
Updating the patch to fix a few bugs:
# {{DataStreamer#shouldStop}} should che
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.01.patch
Rebased the patch on top of HDFS-9040 and made it more complete. It's still a
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Component/s: erasure-coding
> Erasure coding: preallocate multiple generation stamps and serialize updates
>
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079-HDFS-7285.00.patch
[~walter.k.su] I named the patch wrongly. It is based on HDFS-7285 b
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: (was: HDFS-9079.00.patch)
> Erasure coding: preallocate multiple generation stamps and serial
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Attachment: HDFS-9079.00.patch
This is a wip patch to explore the idea of serializing *different types* of
u
[
https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9079:
Summary: Erasure coding: preallocate multiple generation stamps and
serialize updates from data streamers (w
23 matches
Mail list logo
