[jira] [Created] (HDFS-12449) TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

2017-09-14 Thread SammiChen (JIRA)
SammiChen created HDFS-12449: Summary: TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s Key: HDFS-12449 URL: https://issues.apache.org/jira/browse/HDFS-12449 Project:

[jira] [Updated] (HDFS-12448) Make sure user defined erasure coding policy ID will not overflow

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12448: - Summary: Make sure user defined erasure coding policy ID will not overflow (was: Make sure user customize

[jira] [Assigned] (HDFS-12448) Make sure user defined erasure coding policy ID will not overflow

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12448: Assignee: Huafeng Wang > Make sure user defined erasure coding policy ID will not overflow > --

[jira] [Created] (HDFS-12448) Make sure user customized erasure coding policy ID will not overflow

2017-09-14 Thread SammiChen (JIRA)
SammiChen created HDFS-12448: Summary: Make sure user customized erasure coding policy ID will not overflow Key: HDFS-12448 URL: https://issues.apache.org/jira/browse/HDFS-12448 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11467: - Summary: Support ErasureCoding section in OIV XML/ReverseXML (was: Support ErasureCodingPolicyManager sec

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11467: - Description: As discussed in HDFS-7859, after ErasureCoding section is added into fsimage, we would like

[jira] [Assigned] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12447: Assignee: SammiChen > Refactor addErasureCodingPolicy > --- > >

[jira] [Created] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-14 Thread SammiChen (JIRA)
SammiChen created HDFS-12447: Summary: Refactor addErasureCodingPolicy Key: HDFS-12447 URL: https://issues.apache.org/jira/browse/HDFS-12447 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165932#comment-16165932 ] SammiChen commented on HDFS-11467: -- new edit log ops support in OEV tool is handled in HD

[jira] [Updated] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11467: - Description: As discussed in HDFS-7859, after ErasureCodingPolicyManager section is added into fsimage, w

[jira] [Updated] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11467: - Summary: Support ErasureCodingPolicyManager section in OIV XML/ReverseXML (was: Support ErasureCodingPoli

[jira] [Commented] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165928#comment-16165928 ] SammiChen commented on HDFS-12414: -- Thanks [~drankye], [~HuafengWang] and [~eddyxu] for y

[jira] [Comment Edited] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165918#comment-16165918 ] SammiChen edited comment on HDFS-12444 at 9/14/17 8:01 AM: --- Hi [

[jira] [Comment Edited] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165918#comment-16165918 ] SammiChen edited comment on HDFS-12444 at 9/14/17 7:56 AM: --- Hi [

[jira] [Commented] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165918#comment-16165918 ] SammiChen commented on HDFS-12444: -- Hi [~andrew.wang], the patch looks overall great to m

[jira] [Assigned] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12437: Assignee: (was: SammiChen) > TestLeaseRecoveryStriped fails in trunk >

[jira] [Assigned] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12437: Assignee: SammiChen (was: Andrew Wang) > TestLeaseRecoveryStriped fails in trunk > ---

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.019.patch Upload 019.patch after offline discussion with Kai > Erasure Coding: Persist

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.004.patch 1. fix style issues 2. uncomment the piece of code Another note is the u

[jira] [Updated] (HDFS-10701) TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10701: - Attachment: HDFS-10701.001.patch 1. change the timeout from 3s to 6s 2. remove the assume in testBlockToke

[jira] [Commented] (HDFS-10701) TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165725#comment-16165725 ] SammiChen commented on HDFS-10701: -- 3s runs well on my local machine. But I guess its tak

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.018.patch Rebase the patch. > Erasure Coding: Persist erasure coding policies in NameN

[jira] [Comment Edited] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165615#comment-16165615 ] SammiChen edited comment on HDFS-12395 at 9/14/17 1:56 AM: --- Than

[jira] [Comment Edited] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165615#comment-16165615 ] SammiChen edited comment on HDFS-12395 at 9/14/17 1:56 AM: --- Than

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165615#comment-16165615 ] SammiChen commented on HDFS-12395: -- Thanks [~eddyxu] and [~drankye]! OEV is already been

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.017.patch 1. fix style issues 2. change section name to ErasureCodingSection 3. remove

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164534#comment-16164534 ] SammiChen commented on HDFS-7859: - Thanks [~eddyxu] for the comments! If a policy is disab

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.005.patch > Ensure to use CLI command to enable/disable erasure coding policy > ---

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164482#comment-16164482 ] SammiChen commented on HDFS-12395: -- Thanks [~drankye] & [~rakeshr] reviewing the patch!

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.003.patch > Support erasure coding policy operations in namenode edit log > ---

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: editsStored new editsStored raw file > Support erasure coding policy operations in namenode e

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: (was: editsStored) > Support erasure coding policy operations in namenode edit log > -

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.004.patch rebase the patch > Ensure to use CLI command to enable/disable erasure c

[jira] [Comment Edited] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-13 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164351#comment-16164351 ] SammiChen edited comment on HDFS-12414 at 9/13/17 9:03 AM: --- Than

[jira] [Commented] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164183#comment-16164183 ] SammiChen commented on HDFS-12414: -- 1. Double checked failed units, not relevant. 2. che

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.003.patch Refine the HDFSErasureCoding.md to try to fix the mvnsite issue > Ensure

[jira] [Updated] (HDFS-10701) TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails

2017-09-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10701: - Attachment: HDFS-10701.000.patch > TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionall

[jira] [Updated] (HDFS-10701) TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails

2017-09-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10701: - Status: Patch Available (was: Open) > TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasio

[jira] [Commented] (HDFS-10701) TestDFSStripedOutputStreamWithFailure#testBlockTokenExpired occasionally fails

2017-09-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162792#comment-16162792 ] SammiChen commented on HDFS-10701: -- I have noticed 2 frequently happened {{testBlockToken

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Patch Available (was: Open) > Ensure to use CLI command to enable/disable erasure coding policy >

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Open (was: Patch Available) > Ensure to use CLI command to enable/disable erasure coding policy >

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.002.patch > Ensure to use CLI command to enable/disable erasure coding policy > ---

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: (was: HDFS-12414.002.patch) > Ensure to use CLI command to enable/disable erasure coding p

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.002.patch 1. fix style issues 2. fix failed unit tests > Ensure to use CLI command

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Patch Available (was: Open) > Ensure to use CLI command to enable/disable erasure coding policy >

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.001.patch Initial patch > Ensure to use CLI command to enable/disable erasure codi

[jira] [Created] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-10 Thread SammiChen (JIRA)
SammiChen created HDFS-12414: Summary: Ensure to use CLI command to enable/disable erasure coding policy Key: HDFS-12414 URL: https://issues.apache.org/jira/browse/HDFS-12414 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.016.patch > Erasure Coding: Persist erasure coding policies in NameNode > -

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158252#comment-16158252 ] SammiChen commented on HDFS-7859: - Thanks [~eddyxu] and [~drankye] for review the patch and

[jira] [Created] (HDFS-12405) Complete remove "removed" state erasure coding policy during Namenode restart

2017-09-07 Thread SammiChen (JIRA)
SammiChen created HDFS-12405: Summary: Complete remove "removed" state erasure coding policy during Namenode restart Key: HDFS-12405 URL: https://issues.apache.org/jira/browse/HDFS-12405 Project: Hadoop H

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158171#comment-16158171 ] SammiChen commented on HDFS-12395: -- 002.patch uploaded. Here is the change list, 1. fixed

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.002.patch > Support erasure coding policy operations in namenode edit log > ---

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: (was: HDFS-12395.002.patch) > Support erasure coding policy operations in namenode edit lo

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: editsStored > Support erasure coding policy operations in namenode edit log >

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.002.patch > Support erasure coding policy operations in namenode edit log > ---

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Attachment: HDFS-12402.002.patch Patch refined. > Refactor ErasureCodingPolicyManager > -

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Description: 1. Correct message string grammar error 2. Use HadoopIllegalArgumentException instead of Ill

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Description: 1. Correct message string grammar error 2. Use HadoopIllegalArgumentException instead of Ill

[jira] [Commented] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156486#comment-16156486 ] SammiChen commented on HDFS-12402: -- Yes, [~rakeshr], thanks for the reminder. I will uplo

[jira] [Updated] (HDFS-12399) Improve erasure coding codec through add more unit tests

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12399: - Description: Improve erasure coding codec through add more unit tests (was: Handle corner case when eras

[jira] [Updated] (HDFS-12399) Improve erasure coding codec through add more unit tests

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12399: - Summary: Improve erasure coding codec through add more unit tests (was: Handle erasure coding codec chan

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.015.patch Refined the patch after offline discussion with Kai. > Erasure Coding: Pers

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Status: Open (was: Patch Available) > Refactor ErasureCodingPolicyManager > -

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Status: Patch Available (was: Open) > Refactor ErasureCodingPolicyManager > -

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Status: Patch Available (was: Open) > Refactor ErasureCodingPolicyManager > -

[jira] [Updated] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12402: - Attachment: HDFS-12402.001.patch Initial patch > Refactor ErasureCodingPolicyManager > --

[jira] [Created] (HDFS-12402) Refactor ErasureCodingPolicyManager

2017-09-06 Thread SammiChen (JIRA)
SammiChen created HDFS-12402: Summary: Refactor ErasureCodingPolicyManager Key: HDFS-12402 URL: https://issues.apache.org/jira/browse/HDFS-12402 Project: Hadoop HDFS Issue Type: Improvement A

[jira] [Commented] (HDFS-12392) Writing striped file failed due to different cell size

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156360#comment-16156360 ] SammiChen commented on HDFS-12392: -- Thanks [~drankye] for helping review and commit the p

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16155177#comment-16155177 ] SammiChen commented on HDFS-12395: -- Thanks [~rakeshr] for the quick review! bq. I could

[jira] [Updated] (HDFS-12399) Handle erasure coding codec change after name node restart

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12399: - Description: Handle corner case when erasure coding codec change after name node restart, cluster migratio

[jira] [Created] (HDFS-12399) Handle erasure coding codec change after name node restart

2017-09-06 Thread SammiChen (JIRA)
SammiChen created HDFS-12399: Summary: Handle erasure coding codec change after name node restart Key: HDFS-12399 URL: https://issues.apache.org/jira/browse/HDFS-12399 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154993#comment-16154993 ] SammiChen edited comment on HDFS-7859 at 9/6/17 8:30 AM: - Thanks [~

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-06 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.014.patch Thanks [~drankye] for the review! Upload a new patch, 1. fix style issues 2.

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.003.patch 1. Fix style issues 2. Check failed unit tests, not relevant > Write str

[jira] [Comment Edited] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154705#comment-16154705 ] SammiChen edited comment on HDFS-11467 at 9/6/17 2:26 AM: -- Assign

[jira] [Assigned] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11467: Assignee: Wei Zhou (was: SammiChen) > Support ErasureCodingPolicyManager section in OIV XML/Revers

[jira] [Commented] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154705#comment-16154705 ] SammiChen commented on HDFS-11467: -- Assign to Wei per Kai's suggestion. > Support Erasu

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.013.patch > Erasure Coding: Persist erasure coding policies in NameNode > -

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153453#comment-16153453 ] SammiChen commented on HDFS-7859: - Thanks [~drankye] for quick review! bq. 1. Did you not

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.002.patch [~drankye] thanks for the quick review! A new patch uploaded. > Write

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Status: Patch Available (was: Open) > Support add, remove, disable and enable erasure coding policy opera

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.001.patch Initial patch > Support add, remove, disable and enable erasure coding p

[jira] [Assigned] (HDFS-12394) Erasure coding policy cell size should not be greater than file block size

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12394: Assignee: Wei Zhou > Erasure coding policy cell size should not be greater than file block size > -

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Summary: Support add, remove, disable and enable erasure coding policy operations in edit log (was: Suppo

[jira] [Created] (HDFS-12395) Support add, remove, disable, enable erasure coding policy operation in edit log

2017-09-05 Thread SammiChen (JIRA)
SammiChen created HDFS-12395: Summary: Support add, remove, disable, enable erasure coding policy operation in edit log Key: HDFS-12395 URL: https://issues.apache.org/jira/browse/HDFS-12395 Project: Hadoo

[jira] [Updated] (HDFS-12394) Erasure coding policy cell size should not be greater than file block size

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12394: - Description: Current the minimum block size is defined by "dfs.namenode.fs-limits.min-block-size" with de

[jira] [Updated] (HDFS-12394) Erasure coding policy cell size should not be greater than file block size

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12394: - Description: Current the minimum block size is defined by "dfs.namenode.fs-limits.min-block-size" with de

[jira] [Created] (HDFS-12394) Erasure coding policy cell size should not be greater than file block size

2017-09-04 Thread SammiChen (JIRA)
SammiChen created HDFS-12394: Summary: Erasure coding policy cell size should not be greater than file block size Key: HDFS-12394 URL: https://issues.apache.org/jira/browse/HDFS-12394 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-12392) Write striped file failure

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153129#comment-16153129 ] SammiChen edited comment on HDFS-12392 at 9/5/17 5:45 AM: -- Initia

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.001.patch Initial patch > Write striped file failure > --

[jira] [Assigned] (HDFS-12392) Write striped file failure

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12392: Assignee: SammiChen > Write striped file failure > -- > > K

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Summary: Write striped file failure (was: Randomly write striped file failure) > Write striped file fail

[jira] [Updated] (HDFS-12392) Randomly write striped file failure

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Summary: Randomly write striped file failure (was: Randomly read striped file failure) > Randomly write

[jira] [Created] (HDFS-12392) Randomly read striped file failure

2017-09-04 Thread SammiChen (JIRA)
SammiChen created HDFS-12392: Summary: Randomly read striped file failure Key: HDFS-12392 URL: https://issues.apache.org/jira/browse/HDFS-12392 Project: Hadoop HDFS Issue Type: Bug Comp

[jira] [Commented] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153033#comment-16153033 ] SammiChen commented on HDFS-11467: -- Hi [~andrew.wang], given the beta1 timeline, I would

[jira] [Assigned] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11467: Assignee: SammiChen > Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tool

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.012.patch Rebase patch against trunk code > Erasure Coding: Persist erasure coding pol

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146892#comment-16146892 ] SammiChen commented on HDFS-7859: - [~eddyxu] mentioned upgrade and downgrade, it's a good q

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-29 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146700#comment-16146700 ] SammiChen commented on HDFS-7859: - Hi [~eddyxu], thanks for reviewing the patch! Persist e

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2017-08-27 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143057#comment-16143057 ] SammiChen commented on HDFS-7337: - Hi [~andrew.wang], the remaining task is to persist era

<    1   2   3   4   5   6   7   >