[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-27 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065917#comment-16065917 ] lufei commented on HDFS-11870: -- [~jojochuang],Thank you very much for your review. I have finished the

[jira] [Commented] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065914#comment-16065914 ] Anu Engineer commented on HDFS-12047: - [~cheersyang] Thanks for the documentation. Looks really good.

[jira] [Updated] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12050: -- Priority: Minor (was: Major) > Ozone: StorageHandler: Implementation of "close" for releasing

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065900#comment-16065900 ] Hadoop QA commented on HDFS-11870: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065898#comment-16065898 ] Hadoop QA commented on HDFS-9388: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9388: - Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha4 Status:

[jira] [Updated] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9388: - Attachment: HDFS-9388.01.patch [~mingma], {{DatanodeAdminManager}} sounds good to me.

[jira] [Updated] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-27 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-11870: - Attachment: HDFS-11870.006.patch > Add CLI cmd to enable/disable an erasure code policy >

[jira] [Commented] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065788#comment-16065788 ] Weiwei Yang commented on HDFS-12047: + [~anu], [~xyao] > Ozone: Add REST API documentation >

[jira] [Assigned] (HDFS-12052) Set "SWEBHDFS delegation" as DT kind if ssl is enabled in HttpFS

2017-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-12052: -- Assignee: Zoran Dimitrijevic > Set "SWEBHDFS delegation" as DT kind if ssl is enabled

[jira] [Commented] (HDFS-12052) Set "SWEBHDFS delegation" as DT kind if ssl is enabled in HttpFS

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065755#comment-16065755 ] Hadoop QA commented on HDFS-12052: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration in branch-2.7.

2017-06-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061676#comment-16061676 ] Brahma Reddy Battula edited comment on HDFS-11896 at 6/28/17 12:59 AM:

[jira] [Comment Edited] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration in branch-2.7.

2017-06-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061676#comment-16061676 ] Brahma Reddy Battula edited comment on HDFS-11896 at 6/28/17 12:59 AM:

[jira] [Updated] (HDFS-12052) Set "SWEBHDFS delegation" as DT kind if ssl is enabled in HttpFS

2017-06-27 Thread Zoran Dimitrijevic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoran Dimitrijevic updated HDFS-12052: -- Status: Patch Available (was: Open) > Set "SWEBHDFS delegation" as DT kind if ssl is

[jira] [Updated] (HDFS-12052) Set "SWEBHDFS delegation" as DT kind if ssl is enabled in HttpFS

2017-06-27 Thread Zoran Dimitrijevic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoran Dimitrijevic updated HDFS-12052: -- Attachment: HDFS-12052.00.patch This simple patch fixes the issue. I'll add tests soon.

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12043: -- Status: Patch Available (was: Open) > Add counters for block re-replication >

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12043: -- Attachment: HDFS-12043.001.patch Post v001 patch. > Add counters for block re-replication >

[jira] [Created] (HDFS-12052) Set "SWEBHDFS delegation" as DT kind if ssl is enabled in HttpFS

2017-06-27 Thread Zoran Dimitrijevic (JIRA)
Zoran Dimitrijevic created HDFS-12052: - Summary: Set "SWEBHDFS delegation" as DT kind if ssl is enabled in HttpFS Key: HDFS-12052 URL: https://issues.apache.org/jira/browse/HDFS-12052 Project:

[jira] [Commented] (HDFS-11975) Provide a system-default EC policy

2017-06-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065704#comment-16065704 ] Lei (Eddy) Xu commented on HDFS-11975: -- [~Sammi] +1 to the idea. > Provide a system-default EC

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065692#comment-16065692 ] Wei-Chiu Chuang commented on HDFS-11881: LGTM. Thanks a lot. The chart shows heap usage grows

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065673#comment-16065673 ] Hadoop QA commented on HDFS-12044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work stopped] (HDFS-11704) OzoneFileSystem: A Hadoop file system implementation for Ozone

2017-06-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11704 stopped by Mingliang Liu. > OzoneFileSystem: A Hadoop file system implementation for Ozone >

[jira] [Commented] (HDFS-12027) Add KMS API to get service version and health check

2017-06-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065659#comment-16065659 ] Xiao Chen commented on HDFS-12027: -- Thanks for the info, just re-opened HADOOP-13872 and updated affect

[jira] [Comment Edited] (HDFS-10391) Always enable NameNode service RPC port

2017-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065636#comment-16065636 ] Xiaoyu Yao edited comment on HDFS-10391 at 6/27/17 11:02 PM: - Thanks

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065636#comment-16065636 ] Xiaoyu Yao commented on HDFS-10391: --- *NameNode.java* Line 507: should we document the change of service

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-06-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065619#comment-16065619 ] Xiao Chen commented on HDFS-10899: -- I'm working on the next rev to address Andrew's comments and previous

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Attachment: HDFS-12044.00.patch There are two potential approaches to this. * Allow

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Status: Patch Available (was: Open) > Mismatch between BlockManager#maxReplicatioStreams and >

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10480: -- Attachment: HDFS-10480-branch-2.8.01.patch [~andrew.wang], [~shahrs87], Attached

[jira] [Commented] (HDFS-12048) Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065533#comment-16065533 ] Xiaoyu Yao commented on HDFS-12048: --- Thanks [~msingh] for fixing this. Patch looks good to me. +1. I

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065502#comment-16065502 ] Hadoop QA commented on HDFS-12042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065480#comment-16065480 ] Wei-Chiu Chuang commented on HDFS-11870: One of the test failure is fixed by HDFS-12040. The patch

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Updated] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12051: -- Description: When snapshot diff operation is performed in a NameNode that manages several

[jira] [Created] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-27 Thread Misha Dmitriev (JIRA)
Misha Dmitriev created HDFS-12051: - Summary: Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory Key: HDFS-12051 URL: https://issues.apache.org/jira/browse/HDFS-12051 Project:

[jira] [Updated] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12050: -- Attachment: HDFS-12050-HDFS-7240.000.patch > Ozone: StorageHandler: Implementation of "close" for

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065375#comment-16065375 ] Nandakumar commented on HDFS-12050: --- Without this patch eviction is done only when eviction criteria is

[jira] [Updated] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-27 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12050: -- Description: When we use DistributedStorageHandler and call {{newKeyWriter}}, it will create

[jira] [Created] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-27 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12050: - Summary: Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown Key: HDFS-12050 URL: https://issues.apache.org/jira/browse/HDFS-12050

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065364#comment-16065364 ] Misha Dmitriev commented on HDFS-12042: --- [~manojg], I'll add/update the tests and will post another

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065349#comment-16065349 ] Manoj Govindassamy commented on HDFS-12042: --- [~mi...@cloudera.com], Looks good overall. Can

[jira] [Comment Edited] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065349#comment-16065349 ] Manoj Govindassamy edited comment on HDFS-12042 at 6/27/17 7:44 PM:

[jira] [Comment Edited] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065349#comment-16065349 ] Manoj Govindassamy edited comment on HDFS-12042 at 6/27/17 7:43 PM:

[jira] [Commented] (HDFS-12048) Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065337#comment-16065337 ] Hadoop QA commented on HDFS-12048: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Attachment: HDFS-12042.03.patch Addressed [~jojochuang]'s comments. > Lazy initialize

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: Patch Available (was: In Progress) > Lazy initialize AbstractINodeDiffList#diffs for

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: In Progress (was: Patch Available) > Lazy initialize AbstractINodeDiffList#diffs for

[jira] [Commented] (HDFS-11975) Provide a system-default EC policy

2017-06-27 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065282#comment-16065282 ] SammiChen commented on HDFS-11975: -- Currently, all build-in EC policies are disabled by default. After we

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065266#comment-16065266 ] Misha Dmitriev commented on HDFS-12042: --- Hi [~manojg], With all the due respect, the measurements

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12042: -- Summary: Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory

[jira] [Commented] (HDFS-12027) Add KMS API to get service version and health check

2017-06-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065223#comment-16065223 ] Rushabh S Shah commented on HDFS-12027: --- I too am getting the CNF exception

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065205#comment-16065205 ] Manoj Govindassamy commented on HDFS-12042: --- [~mi...@cloudera.com], I believe lazy

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065184#comment-16065184 ] Misha Dmitriev commented on HDFS-12042: --- Yes [~jojochuang], you are correct. The essence of the

[jira] [Updated] (HDFS-12048) Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12048: - Status: Patch Available (was: Open) > Ozone:TestOzoneContainerRatis & TestRatisManager

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065162#comment-16065162 ] Wei-Chiu Chuang commented on HDFS-12042: Thanks [~mi...@cloudera.com], very good report and

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065126#comment-16065126 ] Weiwei Yang commented on HDFS-12030: Hi [~linyiqun] Thanks for working on this one, most of the patch

[jira] [Commented] (HDFS-12011) Add a new load balancing volume choosing policy

2017-06-27 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065098#comment-16065098 ] Ravi Prakash commented on HDFS-12011: - HI Chencan! Thanks for your contribution. Could you please

[jira] [Commented] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065078#comment-16065078 ] Hadoop QA commented on HDFS-12047: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Assigned] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HDFS-12044: Assignee: Lei (Eddy) Xu > Mismatch between BlockManager#maxReplicatioStreams and >

[jira] [Commented] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065039#comment-16065039 ] Weiwei Yang commented on HDFS-12047: Spent a few hours verified all ozone REST APIs, here is the doc I

[jira] [Updated] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12047: --- Status: Patch Available (was: Open) > Ozone: Add REST API documentation >

[jira] [Updated] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12047: --- Attachment: HDFS-12047-HDFS-7240.001.patch > Ozone: Add REST API documentation >

[jira] [Updated] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12047: --- Attachment: (was: HDFS-12047-HDFS-7240.001.patch) > Ozone: Add REST API documentation >

[jira] [Created] (HDFS-12049) Recommissioning live nodes stalls the NN

2017-06-27 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12049: -- Summary: Recommissioning live nodes stalls the NN Key: HDFS-12049 URL: https://issues.apache.org/jira/browse/HDFS-12049 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12048) Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12048: - Summary: Ozone:TestOzoneContainerRatis & TestRatisManager are failing consistently (was:

[jira] [Updated] (HDFS-12048) TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12048: - Attachment: HDFS-12048-HDFS-7240.001.patch > TestOzoneContainerRatis & TestRatisManager

[jira] [Commented] (HDFS-12048) TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064895#comment-16064895 ] Mukul Kumar Singh commented on HDFS-12048: -- This failure is because the "repository" directory is

[jira] [Created] (HDFS-12048) TestOzoneContainerRatis & TestRatisManager are failing consistently

2017-06-27 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12048: Summary: TestOzoneContainerRatis & TestRatisManager are failing consistently Key: HDFS-12048 URL: https://issues.apache.org/jira/browse/HDFS-12048 Project:

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064882#comment-16064882 ] Hadoop QA commented on HDFS-12030: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-06-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064748#comment-16064748 ] Akira Ajisaka commented on HDFS-11882: -- bq. With 6+3 scheme, numAllBlocks is 9, and the logic takes

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064722#comment-16064722 ] Hudson commented on HDFS-12040: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11930 (See

[jira] [Updated] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12030: - Attachment: HDFS-12030-HDFS-7240.002.patch [~xyao], thanks for your review and comments. All the review

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12040: - Affects Version/s: (was: 3.0.0-alpha3) > TestFsDatasetImpl.testCleanShutdownOfVolume fails >

[jira] [Updated] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-12040: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Commented] (HDFS-12040) TestFsDatasetImpl.testCleanShutdownOfVolume fails

2017-06-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064648#comment-16064648 ] Akira Ajisaka commented on HDFS-12040: -- +1 > TestFsDatasetImpl.testCleanShutdownOfVolume fails >

[jira] [Updated] (HDFS-12047) Ozone: Add REST API documentation

2017-06-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12047: --- Attachment: HDFS-12047-HDFS-7240.001.patch > Ozone: Add REST API documentation >

[jira] [Assigned] (HDFS-12038) Ozone: Non-admin user is unable to run InfoVolume to the volume owned by itself

2017-06-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12038: Assignee: Mukul Kumar Singh > Ozone: Non-admin user is unable to run InfoVolume to

[jira] [Assigned] (HDFS-12039) Ozone: Implement update volume owner in ozone shell

2017-06-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12039: Assignee: Mukul Kumar Singh > Ozone: Implement update volume owner in ozone shell

[jira] [Commented] (HDFS-12037) Ozone: Improvement rest API output format for better looking

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064475#comment-16064475 ] Hadoop QA commented on HDFS-12037: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-27 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064472#comment-16064472 ] Misha Dmitriev commented on HDFS-12042: --- Looks like the failed test are unrelated and flaky - at

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064467#comment-16064467 ] steven-wugang commented on HDFS-12025: -- [~anu]ok, I know it。thank you! > Modify help instructions of

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064458#comment-16064458 ] Anu Engineer commented on HDFS-12025: - Not really a rule, just makes it easy to see what the changes

[jira] [Commented] (HDFS-12042) Reduce memory used by snapshot diff data structures

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064457#comment-16064457 ] Hadoop QA commented on HDFS-12042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064453#comment-16064453 ] steven-wugang edited comment on HDFS-12025 at 6/27/17 8:24 AM: --- [~anu]

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064453#comment-16064453 ] steven-wugang commented on HDFS-12025: -- sorry,I don't really know it.I'll follow the rule next

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064451#comment-16064451 ] Anu Engineer commented on HDFS-12025: - [~steven-wugang] Could you please post the output of the

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064442#comment-16064442 ] Anu Engineer commented on HDFS-12025: - [~steven-wugang] Thanks for tagging me and the contribution. I

[jira] [Updated] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12025: Component/s: diskbalancer > Modify help instructions of Plan command and Execute command about >

[jira] [Assigned] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12025: --- Assignee: steven-wugang > Modify help instructions of Plan command and Execute command about

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064435#comment-16064435 ] Hudson commented on HDFS-12045: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11929 (See

[jira] [Commented] (HDFS-12025) Modify help instructions of Plan command and Execute command about DiskBalancer

2017-06-27 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064421#comment-16064421 ] steven-wugang commented on HDFS-12025: -- [~anu] Could you please help me with this commit? Some of the

[jira] [Updated] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12045: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4 Target

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-27 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064404#comment-16064404 ] steven-wugang commented on HDFS-12045: -- [~anu] thank you very much! > Add log when Diskbalancer

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064402#comment-16064402 ] Anu Engineer commented on HDFS-12045: - I have added you to the contributors list, so you will be able

[jira] [Assigned] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12045: --- Assignee: steven-wugang (was: Anu Engineer) > Add log when Diskbalancer volume is transient

[jira] [Commented] (HDFS-12045) Add log when Diskbalancer volume is transient storage type

2017-06-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064398#comment-16064398 ] Anu Engineer commented on HDFS-12045: - yes, you are right this failure is not related to you patch. I

  1   2   >