[
https://issues.apache.org/jira/browse/HDFS-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu reassigned HDFS-7345:
Assignee: Yi Liu
Local Repairable Codes (LRC)
Key:
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547432#comment-14547432
]
Yi Liu commented on HDFS-8412:
--
+1, thanks Uma.
Fix the test failures in HTTPFS
[
https://issues.apache.org/jira/browse/HDFS-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8379:
-
Resolution: Duplicate
Status: Resolved (was: Patch Available)
Fix issues like NPE in
[
https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547493#comment-14547493
]
Yi Liu commented on HDFS-8399:
--
Please check the latest branch after merge, it should not
Yi Liu created HDFS-8418:
Summary: Fix the isNeededReplication calculation for Striped block
in NN
Key: HDFS-8418
URL: https://issues.apache.org/jira/browse/HDFS-8418
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8418:
-
Description:
Currently when calculating {{isNeededReplication}} for striped block, we use
[
https://issues.apache.org/jira/browse/HDFS-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547551#comment-14547551
]
Yi Liu commented on HDFS-8418:
--
It will cause some unexpected behavior, for example: schedule
[
https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543190#comment-14543190
]
Yi Liu commented on HDFS-8391:
--
Uma, yes, I think we should increase xmitsInProgress value for
[
https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543190#comment-14543190
]
Yi Liu edited comment on HDFS-8391 at 5/14/15 5:00 AM:
---
Uma, yes, I
[
https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543237#comment-14543237
]
Yi Liu commented on HDFS-8391:
--
+1, thanks Uma.
NN should consider current EC tasks handling
[
https://issues.apache.org/jira/browse/HDFS-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8398:
-
Description:
Currently in DFSStripedInputStream, for continuous block, if it's under
construction, we need to
Yi Liu created HDFS-8398:
Summary: Erasure Coding: Correctly calculate last striped block
length if it's under construction.
Key: HDFS-8398
URL: https://issues.apache.org/jira/browse/HDFS-8398
Project:
[
https://issues.apache.org/jira/browse/HDFS-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8398:
-
Summary: Erasure Coding: Correctly calculate last striped block length in
DFSStripedInputStream if it's under
[
https://issues.apache.org/jira/browse/HDFS-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8398:
-
Parent Issue: HDFS-8031 (was: HDFS-7285)
Erasure Coding: Correctly calculate last striped block length in
[
https://issues.apache.org/jira/browse/HDFS-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543240#comment-14543240
]
Yi Liu commented on HDFS-8398:
--
Sure, let's move it to HDFS-8031, and maybe this JIRA is
[
https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8376:
-
Summary: Erasure Coding: Update last cellsize calculation according to
whether the erasure codec is linear (was:
Yi Liu created HDFS-8376:
Summary: Erasure Coding: Update last cellsize calculation
according to whether the erasure codec is liner
Key: HDFS-8376
URL: https://issues.apache.org/jira/browse/HDFS-8376
[
https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8376:
-
Description:
Current calculation for last cell size is as following. For parity cell, the
last cell size is the
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539446#comment-14539446
]
Yi Liu commented on HDFS-8347:
--
yes, the {{chunkSize}} is hardcode in future, and for
[
https://issues.apache.org/jira/browse/HDFS-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8363.
--
Resolution: Fixed
Hadoop Flags: Reviewed
Thanks Uma for review, commit to branch.
Erasure Coding:
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539446#comment-14539446
]
Yi Liu edited comment on HDFS-8347 at 5/12/15 12:17 PM:
yes, the
[
https://issues.apache.org/jira/browse/HDFS-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539764#comment-14539764
]
Yi Liu commented on HDFS-8379:
--
I think this fix is included in HDFS-8372.
Fix issues like
[
https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8376:
-
Description:
Current calculation for last cell size is as following. For parity cell, the
last cell size is the
[
https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8376:
-
Parent Issue: HDFS-8031 (was: HDFS-7285)
Erasure Coding: Update last cellsize calculation according to whether
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539446#comment-14539446
]
Yi Liu edited comment on HDFS-8347 at 5/12/15 12:18 PM:
yes, the
[
https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8255:
-
Resolution: Fixed
Fix Version/s: 2.8.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch
[
https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539070#comment-14539070
]
Yi Liu commented on HDFS-8255:
--
Thanks Zhe for the patch, it looks good to me. +1.
Also thanks
[
https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539259#comment-14539259
]
Yi Liu commented on HDFS-8255:
--
Thanks Zhe for rebase, I will commit after passing a fresh
[
https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539083#comment-14539083
]
Yi Liu commented on HDFS-8255:
--
Zhe, found conflict when committing, do you mind to rebase?
Yi Liu created HDFS-8363:
Summary: Erasure Coding: DFSStripedInputStream#seekToNewSource
Key: HDFS-8363
URL: https://issues.apache.org/jira/browse/HDFS-8363
Project: Hadoop HDFS
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HDFS-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8363:
-
Attachment: HDFS-8363.001.patch
Erasure Coding: DFSStripedInputStream#seekToNewSource
[
https://issues.apache.org/jira/browse/HDFS-8363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-8363 started by Yi Liu.
Erasure Coding: DFSStripedInputStream#seekToNewSource
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537472#comment-14537472
]
Yi Liu commented on HDFS-8203:
--
Jing, I just found we should also override
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533951#comment-14533951
]
Yi Liu commented on HDFS-8347:
--
About whether to set buffersize as cellsize (encode cellsize),
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8347:
-
Summary: Erasure Coding: whether to use chunkSize as the to decode
buffersize for Datanode striped block
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8347:
-
Description: Currently decode buffersize for Datanode striped block
reconstruction is configurable and can be less
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533932#comment-14533932
]
Yi Liu commented on HDFS-8347:
--
Kai, the test failure in the JIRA and HADOOP-11938 are broke
[
https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8347:
-
Summary: Whether to use chunkSize as the to decode buffersize for Datanode
block reconstruction. (was: Using
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8203:
-
Attachment: HDFS-8203.003.patch
Thanks Jing for the review! I update the patch to address all your comments
and
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8203:
-
Attachment: (was: HDFS-8203.003.patch)
Erasure Coding: Seek and other Ops in DFSStripedInputStream.
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8203:
-
Attachment: HDFS-8203.003.patch
Erasure Coding: Seek and other Ops in DFSStripedInputStream.
[
https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-8329 started by Yi Liu.
Erasure coding: Rename Striped block recovery to reconstruction to eliminate
confusion.
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533688#comment-14533688
]
Yi Liu commented on HDFS-8203:
--
Thanks a lot for the review and commit, Jing! :)
Erasure
[
https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8329.
--
Resolution: Duplicate
Erasure coding: Rename Striped block recovery to reconstruction to eliminate
confusion.
[
https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532537#comment-14532537
]
Yi Liu commented on HDFS-8329:
--
Just found this was duplicated with HDFS-7955.
Erasure
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528406#comment-14528406
]
Yi Liu commented on HDFS-8203:
--
Thanks Jing for the comment, you are right, it will be more
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529745#comment-14529745
]
Yi Liu commented on HDFS-7348:
--
Thanks Zhe for the review and commit!
Erasure Coding:
Yi Liu created HDFS-8328:
Summary: Follow-on to update decode for DataNode striped blocks
reconstruction
Key: HDFS-8328
URL: https://issues.apache.org/jira/browse/HDFS-8328
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8203:
-
Attachment: HDFS-8203.002.patch
Update the patch.
Current we have the {{curStripedBuf}}, so {{seek}} could be
Yi Liu created HDFS-8329:
Summary: Erasure coding: Rename Striped block recovery to
reconstruction to eliminate confusion.
Key: HDFS-8329
URL: https://issues.apache.org/jira/browse/HDFS-8329
Project: Hadoop
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529735#comment-14529735
]
Yi Liu edited comment on HDFS-8203 at 5/6/15 1:47 AM:
--
Update the
[
https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu reassigned HDFS-8329:
Assignee: Yi Liu
Erasure coding: Rename Striped block recovery to reconstruction to eliminate
confusion.
[
https://issues.apache.org/jira/browse/HDFS-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8329:
-
Description:
Both in NN and DN, we use striped block recovery and sometime use
reconstruction.
The striped block
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7348:
-
Attachment: HDFS-7348.003.patch
Update the patch for Zhe's comments.
I also remove the hardcode of (dataBlkNum,
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8203:
-
Attachment: HDFS-8203.001.patch
Will add some test for the seek tomorrow.
Erasure Coding: Seek and other Ops in
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527730#comment-14527730
]
Yi Liu commented on HDFS-7348:
--
Thanks Zhe for the review, I will update the patch according
[
https://issues.apache.org/jira/browse/HDFS-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8313:
-
Assignee: Li Bo (was: Yi Liu)
Erasure Coding: DFSStripedOutputStream#close throws NullPointerException
[
https://issues.apache.org/jira/browse/HDFS-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526194#comment-14526194
]
Yi Liu commented on HDFS-8313:
--
Yes, bo, you can work on it.
Erasure Coding:
Yi Liu created HDFS-8313:
Summary: Erasure Coding: DFSStripedOutputStream#close throws
NullPointerException exception in some cases
Key: HDFS-8313
URL: https://issues.apache.org/jira/browse/HDFS-8313
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7348:
-
Attachment: HDFS-7348.002.patch
Thanks Zhe for the good comment.
I update the patch according to our discussion
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524425#comment-14524425
]
Yi Liu commented on HDFS-7348:
--
Thanks Zhe for the review and good comments!
I am updating the
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521026#comment-14521026
]
Yi Liu edited comment on HDFS-7348 at 4/30/15 7:06 AM:
---
Thanks Zhe
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521026#comment-14521026
]
Yi Liu commented on HDFS-7348:
--
Thanks Zhe and Bo for further discussion.
I will rebase the
[
https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520989#comment-14520989
]
Yi Liu commented on HDFS-8282:
--
yes, +1
Erasure coding: move striped reading logic to
[
https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518982#comment-14518982
]
Yi Liu edited comment on HDFS-8272 at 4/29/15 10:15 AM:
Thanks Jing
[
https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518982#comment-14518982
]
Yi Liu commented on HDFS-8272:
--
Thanks Jing for the work and Zhe for the review !
{quote}
-
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520686#comment-14520686
]
Yi Liu commented on HDFS-7348:
--
Thanks Bo and Zhe, for the discussion.
{quote}
On the write
[
https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520640#comment-14520640
]
Yi Liu commented on HDFS-8282:
--
+1, thanks Zhe.
Erasure coding: move striped reading logic
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517080#comment-14517080
]
Yi Liu edited comment on HDFS-7348 at 4/28/15 2:20 PM:
---
{noformat}
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7348:
-
Description: This JIRA is to recover one or more missed striped block in
the striped block group. (was: This
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517087#comment-14517087
]
Yi Liu commented on HDFS-7348:
--
{{testFileBlocksRecovery}} is to test the file blocks
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7348:
-
Summary: Erasure Coding: striped block recovery (was: Erasure Coding:
perform stripping erasure decoding/recovery
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517080#comment-14517080
]
Yi Liu commented on HDFS-7348:
--
{noformat}
DataRecoveryAndTransfer recover one or more missed
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-7348:
-
Attachment: HDFS-7348.001.patch
Erasure Coding: perform stripping erasure decoding/recovery work given block
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518630#comment-14518630
]
Yi Liu commented on HDFS-7348:
--
Thanks [~zhz] for the review! The comments are helpful.
[
https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518648#comment-14518648
]
Yi Liu commented on HDFS-3107:
--
Hi Neeta, please checkout the latest trunk or if you get
[
https://issues.apache.org/jira/browse/HDFS-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu resolved HDFS-8275.
--
Resolution: Duplicate
Hi Rakesh, this JIRA is duplicated with HDFS-8087.
Erasure Coding: Implement batched
[
https://issues.apache.org/jira/browse/HDFS-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513594#comment-14513594
]
Yi Liu commented on HDFS-8015:
--
Hi Bo, for the striped block recovery in HDFS-7348, we don't
[
https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510565#comment-14510565
]
Yi Liu commented on HDFS-8223:
--
Thanks Jing for review/rebase/commit !
Should calculate
[
https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510667#comment-14510667
]
Yi Liu commented on HDFS-8014:
--
Hi Zhe, thanks for the discussion, as we discussed, I thought
[
https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-8223:
-
Attachment: HDFS-8223.001.patch
Upload the patch.
The idea is to calculate the checksums for a parity cell once,
[
https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-8203 started by Yi Liu.
Erasure Coding: Seek and other Ops in DFSStripedInputStream.
[
https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507141#comment-14507141
]
Yi Liu commented on HDFS-8024:
--
Yes, I will add it in my patch, thanks.
Erasure Coding:
[
https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-8223 started by Yi Liu.
Should calculate checksum for parity blocks in DFSStripedOutputStream
Yi Liu created HDFS-8223:
Summary: Should calculate checksum for parity blocks in
DFSStripedOutputStream
Key: HDFS-8223
URL: https://issues.apache.org/jira/browse/HDFS-8223
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507099#comment-14507099
]
Yi Liu commented on HDFS-8024:
--
+1, thanks Uma
Erasure Coding: ECworker frame, basics,
[
https://issues.apache.org/jira/browse/HDFS-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507153#comment-14507153
]
Yi Liu commented on HDFS-8223:
--
Will update the patch later.
Should calculate checksum for
[
https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506985#comment-14506985
]
Yi Liu commented on HDFS-8024:
--
The patch is good to me, the {{ErasureCodingWorker}} contains
[
https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504428#comment-14504428
]
Yi Liu commented on HDFS-8033:
--
Thanks [~zhz] for working on this. The patch is good, my
[
https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504485#comment-14504485
]
Yi Liu commented on HDFS-8033:
--
BTW, I find we also need to handle {{seek}}, zerocopy read for
[
https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504428#comment-14504428
]
Yi Liu edited comment on HDFS-8033 at 4/21/15 6:25 AM:
---
Thanks [~zhz]
Yi Liu created HDFS-8203:
Summary: Erasure Coding: Seek and other Ops in
DFSStripedInputStream.
Key: HDFS-8203
URL: https://issues.apache.org/jira/browse/HDFS-8203
Project: Hadoop HDFS
Issue Type:
[
https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504428#comment-14504428
]
Yi Liu edited comment on HDFS-8033 at 4/21/15 6:33 AM:
---
Thanks [~zhz]
[
https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506131#comment-14506131
]
Yi Liu commented on HDFS-8033:
--
Thanks Zhe for the response, and also thanks Jing for the
[
https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506131#comment-14506131
]
Yi Liu edited comment on HDFS-8033 at 4/22/15 12:42 AM:
Thanks Zhe
[
https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506143#comment-14506143
]
Yi Liu commented on HDFS-8212:
--
+1
DistributedFileSystem.createErasureCodingZone should pass
[
https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506152#comment-14506152
]
Yi Liu commented on HDFS-8216:
--
+1
TestDFSStripedOutputStream should use BlockReaderTestUtil
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HDFS-7348 started by Yi Liu.
Erasure Coding: perform stripping erasure decoding/recovery work given block
reader and writer
[
https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502186#comment-14502186
]
Yi Liu commented on HDFS-7348:
--
Yes, Nicholas, I'm working on this and will upload the patch
[
https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487376#comment-14487376
]
Yi Liu commented on HDFS-8088:
--
The patch needs to be rebased.
I agree that we don't need to
501 - 600 of 1473 matches
Mail list logo
