[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Patch Available (was: Open) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Open (was: Patch Available) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Attachment: HDFS_12067.001.patch > Add command help description about 'hdfs dfsadmin -help

[jira] [Commented] (HDFS-12068) Modify judgment condition in function computeVolumeDataDensity,otherwise maybe divided by zero

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067770#comment-16067770 ] Hadoop QA commented on HDFS-12068: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12053) Ozone: ozone server should create missing metadata directory if it has permission to

2017-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12053: --- Attachment: HDFS-12053-HDFS-7240.003.patch > Ozone: ozone server should create missing metadata

[jira] [Commented] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067721#comment-16067721 ] Hadoop QA commented on HDFS-12066: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067714#comment-16067714 ] Hadoop QA commented on HDFS-12067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12046) Hadoop CRC implementation using Intel ISA-L library

2017-06-28 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-12046: - Summary: Hadoop CRC implementation using Intel ISA-L library (was: Hadoop CRC implementation using Intel

[jira] [Updated] (HDFS-12046) Hadoop CRC implementation using Intel ISA-L library

2017-06-28 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-12046: - Attachment: ISA-L CRC Performance Report using intel ISA-L.pdf > Hadoop CRC implementation using Intel

[jira] [Commented] (HDFS-12053) Ozone: ozone server should create missing metadata directory if it has permission to

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067701#comment-16067701 ] Hadoop QA commented on HDFS-12053: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067693#comment-16067693 ] Wei-Chiu Chuang commented on HDFS-12054: Looks good to me. Would you mind to also add the same for

[jira] [Commented] (HDFS-10776) Revisit Hdfs Audit Logging

2017-06-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067671#comment-16067671 ] Allen Wittenauer commented on HDFS-10776: - Sorry, here it is:

[jira] [Updated] (HDFS-12068) Modify judgment condition in function computeVolumeDataDensity,otherwise maybe divided by zero

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12068: - Status: Patch Available (was: Open) > Modify judgment condition in function

[jira] [Updated] (HDFS-12068) Modify judgment condition in function computeVolumeDataDensity,otherwise maybe divided by zero

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12068: - Attachment: HDFS-12068.patch > Modify judgment condition in function

[jira] [Assigned] (HDFS-12068) Modify judgment condition in function computeVolumeDataDensity,otherwise maybe divided by zero

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang reassigned HDFS-12068: Assignee: steven-wugang > Modify judgment condition in function

[jira] [Created] (HDFS-12068) Modify judgment condition in function computeVolumeDataDensity,otherwise maybe divided by zero

2017-06-28 Thread steven-wugang (JIRA)
steven-wugang created HDFS-12068: Summary: Modify judgment condition in function computeVolumeDataDensity,otherwise maybe divided by zero Key: HDFS-12068 URL: https://issues.apache.org/jira/browse/HDFS-12068

[jira] [Commented] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067661#comment-16067661 ] Hadoop QA commented on HDFS-12054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067653#comment-16067653 ] Yiqun Lin edited comment on HDFS-12063 at 6/29/17 3:22 AM: --- Thanks for reporting

[jira] [Assigned] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-12063: Assignee: Yiqun Lin > Ozone: Ozone shell: Multiple RPC calls for put/get key >

[jira] [Commented] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067653#comment-16067653 ] Yiqun Lin commented on HDFS-12063: -- Thanks for reporting this, [~nanda_in]! It will be nice to optimize

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067634#comment-16067634 ] Weiwei Yang commented on HDFS-12030: Thanks [~linyiqun] for confirming that. Yes, lets wait for

[jira] [Commented] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067633#comment-16067633 ] Hadoop QA commented on HDFS-12054: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067626#comment-16067626 ] Yiqun Lin commented on HDFS-12030: -- Hi [~cheersyang], bq. But I doubt if getKey would still work if you

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Patch Available (was: Open) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Attachment: HDFS-12067.patch > Add command help description about 'hdfs dfsadmin -help

[jira] [Assigned] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang reassigned HDFS-12067: Assignee: steven-wugang > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12066: - Attachment: HDFS-12066.001.patch > When Namenode is in safemode,may not allowed to remove an user's erasure >

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12066: - Status: Patch Available (was: Open) > When Namenode is in safemode,may not allowed to remove an user's erasure

[jira] [Created] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-28 Thread steven-wugang (JIRA)
steven-wugang created HDFS-12067: Summary: Add command help description about 'hdfs dfsadmin -help getVolumeReport' command. Key: HDFS-12067 URL: https://issues.apache.org/jira/browse/HDFS-12067

[jira] [Created] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-06-28 Thread lufei (JIRA)
lufei created HDFS-12066: Summary: When Namenode is in safemode,may not allowed to remove an user's erasure coding policy Key: HDFS-12066 URL: https://issues.apache.org/jira/browse/HDFS-12066 Project: Hadoop

[jira] [Comment Edited] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066736#comment-16066736 ] Weiwei Yang edited comment on HDFS-12030 at 6/29/17 2:18 AM: - Hi [~linyiqun]

[jira] [Commented] (HDFS-12053) Ozone: ozone server should create missing metadata directory if it has permission to

2017-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067597#comment-16067597 ] Weiwei Yang commented on HDFS-12053: Thanks [~msingh] for your comments, I've updated the patch to

[jira] [Updated] (HDFS-12053) Ozone: ozone server should create missing metadata directory if it has permission to

2017-06-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12053: --- Attachment: HDFS-12053-HDFS-7240.002.patch > Ozone: ozone server should create missing metadata

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067564#comment-16067564 ] Hadoop QA commented on HDFS-12043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Status: Patch Available (was: Open) > FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: HDFS-12054.001.patch > FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure >

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Status: Open (was: Patch Available) > FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: (was: HDFS-12054.001.patch) > FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to

[jira] [Issue Comment Deleted] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Comment: was deleted (was: add checkNameNodeSafeMode call by HDFS-12054.001.patch) > FSNamesystem#addECPolicies

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Status: Patch Available (was: Open) add checkNameNodeSafeMode call by HDFS-12054.001.patch >

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufei updated HDFS-12054: - Attachment: HDFS-12054.001.patch > FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure >

[jira] [Comment Edited] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067538#comment-16067538 ] Mingliang Liu edited comment on HDFS-12065 at 6/29/17 1:03 AM: ---

[jira] [Commented] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067538#comment-16067538 ] Mingliang Liu commented on HDFS-12065: -- https://www.slf4j.org/faq.html#paramException Per the

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067526#comment-16067526 ] Hadoop QA commented on HDFS-12042: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067523#comment-16067523 ] Hadoop QA commented on HDFS-12065: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067519#comment-16067519 ] Wei-Chiu Chuang commented on HDFS-12042: LGTM. Would any one else like to chime in? > Lazy

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-28 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067509#comment-16067509 ] lufei commented on HDFS-11870: -- I am so sorry for the javadocs missing remain, I'll checkout carefully next

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067487#comment-16067487 ] Hadoop QA commented on HDFS-12044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12043: -- Attachment: HDFS-12043.002.patch Thanks [~arpitagarwal] for the comments! Post v002 patch. The other

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-28 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067460#comment-16067460 ] Misha Dmitriev commented on HDFS-12051: --- Upon a closer analysis of the problem, it looks like we

[jira] [Commented] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067432#comment-16067432 ] Lei (Eddy) Xu commented on HDFS-12065: -- [~jojochuang] [~andrew.wang] could you take a look? This one

[jira] [Updated] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12065: - Tags: (was: ec) Status: Patch Available (was: Open) > Fix log format in

[jira] [Updated] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12065: - Attachment: HDFS-12065.00.patch > Fix log format in StripedBlockReconstructor >

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Attachment: HDFS-12042.04.patch Addressed the last comment by [~jojochuang], submitted

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: Patch Available (was: In Progress) > Lazy initialize AbstractINodeDiffList#diffs for

[jira] [Updated] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated HDFS-12042: -- Status: In Progress (was: Patch Available) > Lazy initialize AbstractINodeDiffList#diffs for

[jira] [Created] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12065: Summary: Fix log format in StripedBlockReconstructor Key: HDFS-12065 URL: https://issues.apache.org/jira/browse/HDFS-12065 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067380#comment-16067380 ] Hadoop QA commented on HDFS-12050: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Attachment: HDFS-12044.02.patch Rebase and re-upload patch 02 > Mismatch between

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Attachment: (was: HDFS-12044.02.patch) > Mismatch between BlockManager#maxReplicatioStreams

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067315#comment-16067315 ] Hadoop QA commented on HDFS-12044: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Attachment: HDFS-12044.02.patch Hi, [~andrew.wang] NN limits the speed of putting such tasks to

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067218#comment-16067218 ] Andrew Wang commented on HDFS-12044: Hi Eddy, thanks for working on this, IIUC the intent of this

[jira] [Commented] (HDFS-12061) Add TraceScope for several DFSClient EC operations

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067207#comment-16067207 ] Hadoop QA commented on HDFS-12061: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11646) Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11646: - Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Target Version/s: 3.0.0-alpha4

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067198#comment-16067198 ] Arpit Agarwal commented on HDFS-12043: -- Thanks for this improvement [~vagarychen]! A few comments: #

[jira] [Commented] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067183#comment-16067183 ] Lei (Eddy) Xu commented on HDFS-12062: -- LGTM. Could you add a simple test as the spec? Thanks for

[jira] [Commented] (HDFS-11965) [SPS] Fix TestPersistentStoragePolicySatisfier#testWithCheckpoint failure

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067171#comment-16067171 ] Hadoop QA commented on HDFS-11965: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067148#comment-16067148 ] Hudson commented on HDFS-11870: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11942 (See

[jira] [Created] (HDFS-12064) Reuse object mapper in HDFS

2017-06-28 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-12064: Summary: Reuse object mapper in HDFS Key: HDFS-12064 URL: https://issues.apache.org/jira/browse/HDFS-12064 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-28 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12063: - Summary: Ozone: Ozone shell: Multiple RPC calls for put/get key Key: HDFS-12063 URL: https://issues.apache.org/jira/browse/HDFS-12063 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-06-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12036: --- Labels: hdfs-ec-3.0-must-do (was: ) > Add audit log for getErasureCodingPolicy,

[jira] [Commented] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-06-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067138#comment-16067138 ] Andrew Wang commented on HDFS-12036: Nice find Wei-chiu, we definitely need audit logs for these. >

[jira] [Updated] (HDFS-12057) Ozone: OzoneClient: Implementation of OzoneClient

2017-06-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12057: -- Status: Open (was: Patch Available) > Ozone: OzoneClient: Implementation of OzoneClient >

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067080#comment-16067080 ] Wei-Chiu Chuang commented on HDFS-12042: The last patch looks mostly good. When you post another

[jira] [Comment Edited] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067080#comment-16067080 ] Wei-Chiu Chuang edited comment on HDFS-12042 at 6/28/17 7:19 PM: - The last

[jira] [Updated] (HDFS-12057) Ozone: OzoneClient: Implementation of OzoneClient

2017-06-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12057: -- Status: Patch Available (was: Open) > Ozone: OzoneClient: Implementation of OzoneClient >

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067075#comment-16067075 ] Nandakumar commented on HDFS-12050: --- Upload patch v01 with {{clientCache.cleanup()}} in

[jira] [Updated] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12050: -- Attachment: HDFS-12050-HDFS-7240.001.patch > Ozone: StorageHandler: Implementation of "close" for

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067054#comment-16067054 ] Nandakumar commented on HDFS-12050: --- Thanks [~vagarychen] for the review. We only have

[jira] [Updated] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12054: --- Labels: hdfs-ec-3.0-nice-to-have (was: ) > FSNamesystem#addECPolicies should call

[jira] [Updated] (HDFS-12061) Add TraceScope for several DFSClient EC operations

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12061: --- Attachment: HDFS-12061.001.patch Posted a simple patch for review. > Add TraceScope for

[jira] [Updated] (HDFS-12061) Add TraceScope for several DFSClient EC operations

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12061: --- Status: Patch Available (was: Open) > Add TraceScope for several DFSClient EC operations >

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12044: - Attachment: HDFS-12044.01.patch Add unit test to approach 1. > Mismatch between

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Labels: hdfs-ec-3.0-must-do (was: ) > removeErasureCodingPolicy needs super user permission

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Attachment: HDFS-12062.001.patch Attach a simple one-liner fix to add permission check.

[jira] [Created] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12062: -- Summary: removeErasureCodingPolicy needs super user permission Key: HDFS-12062 URL: https://issues.apache.org/jira/browse/HDFS-12062 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12043: - Status: Open (was: Patch Available) > Add counters for block re-replication >

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12043: - Status: Patch Available (was: Open) > Add counters for block re-replication >

[jira] [Commented] (HDFS-11955) Ozone: Set proper parameter default values for listBuckets http request

2017-06-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066965#comment-16066965 ] Anu Engineer commented on HDFS-11955: - sorry for the delay, I will look at this today. > Ozone: Set

[jira] [Updated] (HDFS-12061) Add TraceScope for several DFSClient EC operations

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12061: --- Summary: Add TraceScope for several DFSClient EC operations (was: Add TraceScope for

[jira] [Assigned] (HDFS-12061) Add TraceScope for multiple DFSClient EC operations

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-12061: -- Assignee: Wei-Chiu Chuang > Add TraceScope for multiple DFSClient EC operations >

[jira] [Created] (HDFS-12061) Add TraceScope for multiple DFSClient EC operations

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12061: -- Summary: Add TraceScope for multiple DFSClient EC operations Key: HDFS-12061 URL: https://issues.apache.org/jira/browse/HDFS-12061 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066961#comment-16066961 ] Hadoop QA commented on HDFS-12050: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066951#comment-16066951 ] Wei-Chiu Chuang commented on HDFS-11870: Actually, [~figo], I just found

[jira] [Updated] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11870: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11870) Add CLI cmd to enable/disable an erasure code policy

2017-06-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11870: --- Fix Version/s: 3.0.0-alpha4 I just committed the patch to trunk. Thanks very much for the

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066943#comment-16066943 ] Chen Liang commented on HDFS-12050: --- Thanks [~nandakumar131] for the catch! The patch LGTM, one question

[jira] [Commented] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-06-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066932#comment-16066932 ] Manoj Govindassamy commented on HDFS-9388: -- Above unit test failures are not related to the patch.

[jira] [Updated] (HDFS-11965) [SPS] Fix TestPersistentStoragePolicySatisfier#testWithCheckpoint failure

2017-06-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11965: -- Status: Patch Available (was: Open) > [SPS] Fix

  1   2   >