[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128381#comment-16128381 ] Rakesh R commented on HDFS-12258: - bq. my solution is ignore the user's input policy state and set it to

[jira] [Resolved] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-08-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-12202. -- Resolution: Won't Fix > Provide new set of FileSystem API to bypass external attribute provider

[jira] [Commented] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128432#comment-16128432 ] Hadoop QA commented on HDFS-12269: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128430#comment-16128430 ] Akira Ajisaka commented on HDFS-12269: -- Mostly looks good to me. Two minor comments: 1. Would you

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-16 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.002.patch > Ozone: DeleteKey-5: Implement SCM DeletedBlockLog >

[jira] [Commented] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128395#comment-16128395 ] Anu Engineer commented on HDFS-12307: - This test was passing earlier, till i fixed the issue that

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-08-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128417#comment-16128417 ] Yongjun Zhang commented on HDFS-12202: -- Thanks [~daryn] and [~chris.douglas]. Chris's answer to

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-16 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128428#comment-16128428 ] Yuanbo Liu commented on HDFS-12283: --- [~cheersyang] Thanks a lot for your review. Agree with the most

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128507#comment-16128507 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128475#comment-16128475 ] Hadoop QA commented on HDFS-11082: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-16 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128531#comment-16128531 ] Mukul Kumar Singh commented on HDFS-12292: -- Hi [~erofeev], the patch looks really good to me.

[jira] [Comment Edited] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-16 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128545#comment-16128545 ] Wellington Chevreuil edited comment on HDFS-12182 at 8/16/17 9:28 AM: --

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-16 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12182: Attachment: HDFS-12182-branch-2.002.patch Fixed issue on TestMetaSave. Other tests

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128498#comment-16128498 ] Surendra Singh Lilhore commented on HDFS-12214: --- bq. FSNamesystem#startActiveServices() flow

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128520#comment-16128520 ] Hadoop QA commented on HDFS-12258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128582#comment-16128582 ] Huafeng Wang commented on HDFS-12269: - Hi [~ajisakaa], thanks for your review. I just uploaded a new

[jira] [Updated] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-12269: Attachment: HDFS-12269.003.patch > Better to return a Map rather than HashMap in

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128682#comment-16128682 ] Hadoop QA commented on HDFS-12182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128724#comment-16128724 ] Hadoop QA commented on HDFS-12269: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Attachment: HDFS-12214-HDFS-10285-08.patch > [SPS]: Fix review comments of StoragePolicySatisfier feature >

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128935#comment-16128935 ] Rakesh R commented on HDFS-12214: - Yes, I got it. Attached new patch addressing the comments. > [SPS]:

[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12248: Attachment: HDFS-12248-002.patch Thanks [~shahrs87] and [~hkoneru] for taking look

[jira] [Created] (HDFS-12309) Incorrect null check in the AdminHelper.java

2017-08-16 Thread Oleg Danilov (JIRA)
Oleg Danilov created HDFS-12309: --- Summary: Incorrect null check in the AdminHelper.java Key: HDFS-12309 URL: https://issues.apache.org/jira/browse/HDFS-12309 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12119) Inconsistent "Number of Under-Replicated Blocks" shown on HDFS web UI and fsck report

2017-08-16 Thread liuyiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyiyang updated HDFS-12119: - Attachment: HDFS-12119.001.patch > Inconsistent "Number of Under-Replicated Blocks" shown on HDFS web UI

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-16 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: (was: HDFS-12292-003.patch) > Federation: Support viewfs:// schema path for

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-16 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: HDFS-12292-003.patch > Federation: Support viewfs:// schema path for DfsAdmin

[jira] [Commented] (HDFS-12119) Inconsistent "Number of Under-Replicated Blocks" shown on HDFS web UI and fsck report

2017-08-16 Thread liuyiyang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128841#comment-16128841 ] liuyiyang commented on HDFS-12119: -- I attached a patch for this problem, can someone please review it?

[jira] [Updated] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-16 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Erofeev updated HDFS-12292: --- Attachment: HDFS-12292-003.patch > Federation: Support viewfs:// schema path for DfsAdmin

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-16 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128860#comment-16128860 ] Mikhail Erofeev commented on HDFS-12292: Thanks [~msingh] for looking into this jira and for

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2017-08-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128972#comment-16128972 ] Erik Krogen commented on HDFS-10326: [~wheat9] want to confirm, I see fix version is only 2.8.2 right

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-08-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128995#comment-16128995 ] Brahma Reddy Battula commented on HDFS-11817: - I feel, this can be merged to {{branch-2.7}} as

[jira] [Updated] (HDFS-12299) Race Between update pipeline and DN Re-Registration

2017-08-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12299: Attachment: HDFS-12299.patch Uploading the test to reproduce this issue. Duplicate

[jira] [Commented] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129811#comment-16129811 ] Weiwei Yang commented on HDFS-12307: Thanks [~xyao], you are right, this is a dup of HDFS-12216. Lets

[jira] [Resolved] (HDFS-12312) Rebasing HDFS-10467 (2)

2017-08-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-12312. Resolution: Fixed Fix Version/s: HDFS-10467 > Rebasing HDFS-10467 (2) >

[jira] [Commented] (HDFS-12312) Rebasing HDFS-10467 (2)

2017-08-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129689#comment-16129689 ] Íñigo Goiri commented on HDFS-12312: Not waiting for jenkins because the branch is broken. Committed.

[jira] [Comment Edited] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-16 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129736#comment-16129736 ] George Huang edited comment on HDFS-11912 at 8/17/17 1:29 AM: -- Hi Manoj,

[jira] [Comment Edited] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-16 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129759#comment-16129759 ] liaoyuxiangqin edited comment on HDFS-12302 at 8/17/17 1:59 AM:

[jira] [Commented] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-16 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129759#comment-16129759 ] liaoyuxiangqin commented on HDFS-12302: --- bq. [~vagarychen]Thanks for your review, as you say the

[jira] [Resolved] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12307. Resolution: Duplicate Assignee: Weiwei Yang > Ozone: TestKeys#testPutAndGetKeyWithDnRestart

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129922#comment-16129922 ] Rakesh R commented on HDFS-12214: - Note: Findbug warnings & test failures are not related to this patch.

[jira] [Updated] (HDFS-12314) Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume()

2017-08-16 Thread Oleg Danilov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Danilov updated HDFS-12314: Attachment: HDFS-12314.patch > Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume() >

[jira] [Updated] (HDFS-12314) Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume()

2017-08-16 Thread Oleg Danilov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Danilov updated HDFS-12314: Status: Patch Available (was: Open) > Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume()

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129691#comment-16129691 ] Hadoop QA commented on HDFS-12159: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-10631: --- Attachment: HDFS-10631-HDFS-10467-008.patch # Rebasing after HDFS-12312. # Fixed most of [~subru]

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-16 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.004.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129751#comment-16129751 ] Xiaoyu Yao commented on HDFS-12159: --- Thanks Anu for the update. +1 v6 patch. > Ozone: SCM: Add create

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129773#comment-16129773 ] Hadoop QA commented on HDFS-10631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12216) Ozone: TestKeys and TestKeysRatis are failing consistently

2017-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129817#comment-16129817 ] Weiwei Yang edited comment on HDFS-12216 at 8/17/17 3:14 AM: - I agree this is

[jira] [Commented] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129859#comment-16129859 ] Vinayakumar B commented on HDFS-12248: -- patch looks almost good. +1 once these nits are addressed. 1.

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129881#comment-16129881 ] Manoj Govindassamy commented on HDFS-11912: --- [~ghuangups], Checkstyle issues are mostly fixed.

[jira] [Commented] (HDFS-12293) DataNode should log file name on disk error

2017-08-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129882#comment-16129882 ] Wei-Chiu Chuang commented on HDFS-12293: Thanks for the patch, Ajay Kumar. Looks good. Would you

[jira] [Comment Edited] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129881#comment-16129881 ] Manoj Govindassamy edited comment on HDFS-11912 at 8/17/17 4:18 AM:

[jira] [Created] (HDFS-12314) Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume()

2017-08-16 Thread Oleg Danilov (JIRA)
Oleg Danilov created HDFS-12314: --- Summary: Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume() Key: HDFS-12314 URL: https://issues.apache.org/jira/browse/HDFS-12314 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11082) Provide replicated EC policy to replicate files

2017-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11082: --- Summary: Provide replicated EC policy to replicate files (was: Erasure Coding : Provide replicated

[jira] [Updated] (HDFS-11082) Provide replicated EC policy to replicate files

2017-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11082: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-12313) Ozone: SCM: move container/pipeline StateMachine to the right package

2017-08-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12313: -- Attachment: HDFS-12313-HDFS-7240.002.patch Minor update: adding a missing package-info.java > Ozone:

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129951#comment-16129951 ] Uma Maheswara Rao G commented on HDFS-12214: Thank you [~rakeshr] for working on this. All

[jira] [Created] (HDFS-12315) Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles()

2017-08-16 Thread Oleg Danilov (JIRA)
Oleg Danilov created HDFS-12315: --- Summary: Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles() Key: HDFS-12315 URL: https://issues.apache.org/jira/browse/HDFS-12315 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129525#comment-16129525 ] Uma Maheswara Rao G edited comment on HDFS-10285 at 8/17/17 5:36 AM: -

[jira] [Commented] (HDFS-12315) Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles()

2017-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129957#comment-16129957 ] ASF GitHub Bot commented on HDFS-12315: --- GitHub user dosoft opened a pull request:

[jira] [Updated] (HDFS-12315) Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles()

2017-08-16 Thread Oleg Danilov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Danilov updated HDFS-12315: Attachment: HDFS-12315.patch > Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles() >

[jira] [Updated] (HDFS-12315) Use Path instead of String in the TestHdfsAdmin.verifyOpenFiles()

2017-08-16 Thread Oleg Danilov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Danilov updated HDFS-12315: Status: Patch Available (was: Open) > Use Path instead of String in the

[jira] [Updated] (HDFS-12312) Rebasing HDFS-10467 (2)

2017-08-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12312: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-10467 > Rebasing HDFS-10467 (2) >

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129720#comment-16129720 ] Andrew Wang commented on HDFS-11885: Hey [~shahrs87], are you planning to post the patch that Daryn

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129804#comment-16129804 ] Weiwei Yang commented on HDFS-12283: Hi [~yuanbo] The new patch seems to cause a lot of UT failures,

[jira] [Commented] (HDFS-11817) A faulty node can cause a lease leak and NPE on accessing data

2017-08-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129868#comment-16129868 ] Vinayakumar B commented on HDFS-11817: -- bq. I feel, this can be merged to branch-2.7 as well. +1 > A

[jira] [Updated] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12269: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129913#comment-16129913 ] Hudson commented on HDFS-12269: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12200 (See

[jira] [Commented] (HDFS-12314) Typo in the TestDataNodeHotSwapVolumes.testAddOneNewVolume()

2017-08-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129941#comment-16129941 ] ASF GitHub Bot commented on HDFS-12314: --- GitHub user dosoft opened a pull request:

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-16 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129736#comment-16129736 ] George Huang commented on HDFS-11912: - Test randomly generated number of iterations for the current

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-16 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129764#comment-16129764 ] SammiChen commented on HDFS-11082: -- Double checked the failed UTs, not relevant. > Erasure Coding :

[jira] [Commented] (HDFS-12311) [branch-2] HDFS specific network topology classes with storage type info included

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129806#comment-16129806 ] Hadoop QA commented on HDFS-12311: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11082) Provide replicated EC policy to replicate files

2017-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129965#comment-16129965 ] Hudson commented on HDFS-11082: --- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12201 (See

[jira] [Commented] (HDFS-12216) Ozone: TestKeys and TestKeysRatis are failing consistently

2017-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129817#comment-16129817 ] Weiwei Yang commented on HDFS-12216: I agree this is failing since HDFS-12115. Since we are using

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129845#comment-16129845 ] Hadoop QA commented on HDFS-11912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-16 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129884#comment-16129884 ] Akira Ajisaka commented on HDFS-12269: -- +1, I ran the failed tests locally and all of them passed. >

[jira] [Created] (HDFS-12313) Ozone: SCM: move container/pipeline StateMachine to the right package

2017-08-16 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12313: - Summary: Ozone: SCM: move container/pipeline StateMachine to the right package Key: HDFS-12313 URL: https://issues.apache.org/jira/browse/HDFS-12313 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12313) Ozone: SCM: move container/pipeline StateMachine to the right package

2017-08-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12313: -- Affects Version/s: HDFS-7240 > Ozone: SCM: move container/pipeline StateMachine to the right package >

[jira] [Commented] (HDFS-12216) Ozone: TestKeys and TestKeysRatis are failing consistently

2017-08-16 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129933#comment-16129933 ] Mukul Kumar Singh commented on HDFS-12216: -- Hi [~cheersyang] thanks for looking into the issue.

[jira] [Updated] (HDFS-12313) Ozone: SCM: move container/pipeline StateMachine to the right package

2017-08-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12313: -- Attachment: HDFS-12313-HDFS-7240.001.patch > Ozone: SCM: move container/pipeline StateMachine to the

[jira] [Updated] (HDFS-12313) Ozone: SCM: move container/pipeline StateMachine to the right package

2017-08-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12313: -- Status: Patch Available (was: Open) > Ozone: SCM: move container/pipeline StateMachine to the right

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129525#comment-16129525 ] Uma Maheswara Rao G edited comment on HDFS-10285 at 8/17/17 5:22 AM: -

[jira] [Commented] (HDFS-12306) [branch-2]Separate class InnerNode from class NetworkTopology and make it extendable

2017-08-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129565#comment-16129565 ] Chen Liang commented on HDFS-12306: --- [~szetszwo] could you please take a look? thanks! >

[jira] [Updated] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-08-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11430: --- Fix Version/s: 2.9.0 Thanks, Chen. I just have merged this to branch-2. > Separate

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Attachment: federationUI-1.png > Federation UI > - > > Key: HDFS-12273 >

[jira] [Commented] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129116#comment-16129116 ] Hadoop QA commented on HDFS-12248: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-16 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129183#comment-16129183 ] Chen Liang commented on HDFS-12302: --- [~liaoyuxiangqin] hmm...this is not as straightforward as it may

[jira] [Commented] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129051#comment-16129051 ] Xiaoyu Yao commented on HDFS-12307: --- Is this the dup of HDFS-12216? > Ozone:

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129065#comment-16129065 ] Hadoop QA commented on HDFS-12292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129136#comment-16129136 ] Hadoop QA commented on HDFS-12214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12294) Let distcp to bypass external attribute provider when calling getFileStatus etc at source cluster

2017-08-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129256#comment-16129256 ] Yongjun Zhang commented on HDFS-12294: -- Hi [~chris.douglas], I thought I udpated here, but seems I

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Attachment: HDFS-12159-HDFS-7240.006.patch Uploading patch v6. Changes from v5 are: * Fixed the

[jira] [Comment Edited] (HDFS-12273) Federation UI

2017-08-16 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129575#comment-16129575 ] Giovanni Matteo Fumarola edited comment on HDFS-12273 at 8/16/17 10:58 PM:

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-16 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129575#comment-16129575 ] Giovanni Matteo Fumarola commented on HDFS-12273: - [~goiri], it would be great if you add

[jira] [Comment Edited] (HDFS-12295) NameNode to support file path prefix /.reserved/bypassExtAttr

2017-08-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129342#comment-16129342 ] Yongjun Zhang edited comment on HDFS-12295 at 8/16/17 8:12 PM: --- Hi [~daryn],

[jira] [Updated] (HDFS-12305) Ozone: SCM: Add StateMachine for pipeline/container

2017-08-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12305: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129525#comment-16129525 ] Uma Maheswara Rao G commented on HDFS-10285: Hi [~andrew.wang] Thank you for helping us a lot

[jira] [Comment Edited] (HDFS-12293) DataNode should log file name on disk error

2017-08-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126790#comment-16126790 ] Ajay Kumar edited comment on HDFS-12293 at 8/16/17 10:51 PM: - [~jojochuang],

[jira] [Commented] (HDFS-12309) Incorrect null check in the AdminHelper.java

2017-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129567#comment-16129567 ] Hadoop QA commented on HDFS-12309: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Attachment: (was: federationUI-1.png) > Federation UI > - > > Key:

  1   2   >