[jira] [Commented] (HDFS-11975) Provide a system-default EC policy

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069544#comment-16069544 ] Hadoop QA commented on HDFS-11975: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx bean property to setup hostname

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069476#comment-16069476 ] Hadoop QA commented on HDFS-11502: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10529) Df reports incorrect usage when appending less than block size

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069464#comment-16069464 ] Hadoop QA commented on HDFS-10529: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11399) Many tests fails in Windows due to injecting disk failures

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069456#comment-16069456 ] Hadoop QA commented on HDFS-11399: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069455#comment-16069455 ] Hadoop QA commented on HDFS-12067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11455) Fix javac warnings in HDFS that caused by deprecated FileSystem APIs

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069443#comment-16069443 ] Hadoop QA commented on HDFS-11455: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11398) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure still fails intermittently

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069441#comment-16069441 ] Hadoop QA commented on HDFS-11398: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10436) dfs.block.access.token.enable should default on when security is !simple

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069440#comment-16069440 ] Hadoop QA commented on HDFS-10436: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11356) figure out what to do about hadoop-hdfs-project/hadoop-hdfs/src/main/native

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069423#comment-16069423 ] Hadoop QA commented on HDFS-11356: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11975) Provide a system-default EC policy

2017-06-29 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11975: - Attachment: HDFS-11975-002.patch > Provide a system-default EC policy >

[jira] [Commented] (HDFS-8065) Erasure coding: Support truncate at striped group boundary

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069382#comment-16069382 ] Hadoop QA commented on HDFS-8065: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12046) Hadoop CRC implementation using Intel ISA-L library

2017-06-29 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-12046: - Attachment: (was: ISA-L CRC Performance Report using intel ISA-L.pdf) > Hadoop CRC implementation

[jira] [Commented] (HDFS-10848) Move hadoop-hdfs-native-client module into hadoop-hdfs-client

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069367#comment-16069367 ] Hadoop QA commented on HDFS-10848: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11232) System.err should be System.out

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069365#comment-16069365 ] Hadoop QA commented on HDFS-11232: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10531) Add EC policy and storage policy related usage summarization function to dfs du command

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069360#comment-16069360 ] Hadoop QA commented on HDFS-10531: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11350) Document the missing settings relevant to DataNode disk IO statistics

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069361#comment-16069361 ] Hadoop QA commented on HDFS-11350: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069335#comment-16069335 ] Anu Engineer edited comment on HDFS-12030 at 6/30/17 1:53 AM: -- [~linyiqun] My

[jira] [Commented] (HDFS-12030) Ozone: CLI: support infoKey command

2017-06-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069335#comment-16069335 ] Anu Engineer commented on HDFS-12030: - [~linyiqun] My vote is to go the way suggested by

[jira] [Resolved] (HDFS-11752) getNonDfsUsed return 0 if reserved bigger than actualNonDfsUsed

2017-06-29 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong resolved HDFS-11752. --- Resolution: Not A Problem > getNonDfsUsed return 0 if reserved bigger than actualNonDfsUsed >

[jira] [Commented] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069298#comment-16069298 ] steven-wugang commented on HDFS-12067: -- [~vagarychen] thank you for your review,I have revised it. >

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069284#comment-16069284 ] Hadoop QA commented on HDFS-12043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11515) -du throws ConcurrentModificationException

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11515: --- Target Version/s: 2.8.1, 3.0.0-beta1 (was: 3.0.0-alpha4, 2.8.1) > -du throws

[jira] [Updated] (HDFS-11944) TestAclsEndToEnd#testCreateEncryptionZone failing very frequently.

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11944: --- Target Version/s: 3.0.0-beta1, 2.8.2 (was: 3.0.0-alpha4, 2.8.2) >

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11472: --- Target Version/s: 2.8.1, 2.7.4, 3.0.0-beta1 (was: 2.7.4, 3.0.0-alpha4, 2.8.1) > Fix inconsistent

[jira] [Updated] (HDFS-11422) Need a method to refresh the list of NN StorageDirectories after removal

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11422: --- Target Version/s: 2.7.4, 3.0.0-beta1 (was: 2.7.4, 3.0.0-alpha4) > Need a method to refresh the list

[jira] [Updated] (HDFS-11752) getNonDfsUsed return 0 if reserved bigger than actualNonDfsUsed

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11752: --- Target Version/s: 2.7.1, 3.0.0-beta1 (was: 2.7.1, 3.0.0-alpha4) > getNonDfsUsed return 0 if reserved

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069280#comment-16069280 ] Hudson commented on HDFS-12043: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11956 (See

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Patch Available (was: Open) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11885: --- Target Version/s: 2.9.0, 3.0.0-beta1, 2.8.2 (was: 2.9.0, 3.0.0-alpha4, 2.8.2) >

[jira] [Updated] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx bean property to setup hostname

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11502: --- Target Version/s: 2.8.1, 2.9.0, 3.0.0-beta1 (was: 2.9.0, 3.0.0-alpha4, 2.8.1) > dn.js set datanode

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Attachment: HDFS_12067.003.patch > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Open (was: Patch Available) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12043: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069237#comment-16069237 ] Hadoop QA commented on HDFS-12043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2017-06-29 Thread Venkat Ranganathan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069222#comment-16069222 ] Venkat Ranganathan commented on HDFS-9820: -- This is an incompatible change in branch-2. This

[jira] [Created] (HDFS-12072) Provide fairness between EC and non-EC recovery tasks.

2017-06-29 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12072: Summary: Provide fairness between EC and non-EC recovery tasks. Key: HDFS-12072 URL: https://issues.apache.org/jira/browse/HDFS-12072 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12027) Add KMS API to get service version and health check

2017-06-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069194#comment-16069194 ] Xiao Chen commented on HDFS-12027: -- There was some jira gardening, but [~jzhuge] just fixed this via

[jira] [Commented] (HDFS-12071) Ozone: PetaGen: Implementation of PetaGen

2017-06-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069175#comment-16069175 ] Anu Engineer commented on HDFS-12071: - [~nandakumar131] Thanks for the JIRA. I was talking to

[jira] [Commented] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069174#comment-16069174 ] Hadoop QA commented on HDFS-12062: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12065) Fix log format in StripedBlockReconstructor

2017-06-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12065: - Resolution: Invalid Status: Resolved (was: Patch Available) Thanks for pointing out the

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069153#comment-16069153 ] Arpit Agarwal commented on HDFS-12043: -- Thanks [~vagarychen]. +1 for the v4 patch, pending Jenkins.

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12043: -- Attachment: HDFS-12043.004.patch Thanks [~arpitagarwal] who pointed out offline that the use of

[jira] [Updated] (HDFS-12071) Ozone: PetaGen: Implementation of PetaGen

2017-06-29 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12071: -- Attachment: (was: HDFS-12071-HDFS-7240.000.patch) > Ozone: PetaGen: Implementation of PetaGen >

[jira] [Commented] (HDFS-12042) Lazy initialize AbstractINodeDiffList#diffs for snapshots to reduce memory consumption

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069097#comment-16069097 ] Wei-Chiu Chuang commented on HDFS-12042: +1 on rev 04 patch. > Lazy initialize

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12044: --- Labels: hdfs-ec-3.0-must-do (was: ) > Mismatch between BlockManager#maxReplicationStreams and >

[jira] [Updated] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12043: -- Attachment: HDFS-12043.003.patch Thanks [~arpitagarwal] for the comments! Post v003 patch to rename the

[jira] [Updated] (HDFS-12044) Mismatch between BlockManager#maxReplicationStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and bursty recovery

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12044: --- Summary: Mismatch between BlockManager#maxReplicationStreams and

[jira] [Commented] (HDFS-12044) Mismatch between BlockManager#maxReplicatioStreams and ErasureCodingWorker.stripedReconstructionPool pool size causes slow and burst recovery.

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069077#comment-16069077 ] Andrew Wang commented on HDFS-12044: Thanks for the explanation Eddy, very helpful. I refreshed myself

[jira] [Work started] (HDFS-12071) Ozone: PetaGen: Implementation of PetaGen

2017-06-29 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12071 started by Nandakumar. - > Ozone: PetaGen: Implementation of PetaGen >

[jira] [Updated] (HDFS-12071) Ozone: PetaGen: Implementation of PetaGen

2017-06-29 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12071: -- Attachment: HDFS-12071-HDFS-7240.000.patch > Ozone: PetaGen: Implementation of PetaGen >

[jira] [Commented] (HDFS-12071) Ozone: PetaGen: Implementation of PetaGen

2017-06-29 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069068#comment-16069068 ] Nandakumar commented on HDFS-12071: --- Initial version will only support offline mode. > Ozone: PetaGen:

[jira] [Created] (HDFS-12071) Ozone: PetaGen: Implementation of PetaGen

2017-06-29 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12071: - Summary: Ozone: PetaGen: Implementation of PetaGen Key: HDFS-12071 URL: https://issues.apache.org/jira/browse/HDFS-12071 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12057) Ozone: OzoneClient: Implementation of OzoneClient

2017-06-29 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12057: -- Status: Patch Available (was: Open) > Ozone: OzoneClient: Implementation of OzoneClient >

[jira] [Updated] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12050: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: StorageHandler:

[jira] [Commented] (HDFS-12050) Ozone: StorageHandler: Implementation of "close" for releasing resources during shutdown

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069030#comment-16069030 ] Chen Liang commented on HDFS-12050: --- The failed tests are unrelated. Committed to the feature branch,

[jira] [Commented] (HDFS-12043) Add counters for block re-replication

2017-06-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16069029#comment-16069029 ] Arpit Agarwal commented on HDFS-12043: -- Thanks for updating the patch [~vagarychen]! bq. Regarding

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Attachment: HDFS-12062.002.patch My bad. Here's the real patch > removeErasureCodingPolicy

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Attachment: (was: HDFS-12062.001.patch) > removeErasureCodingPolicy needs super user

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Status: Patch Available (was: Open) > removeErasureCodingPolicy needs super user permission

[jira] [Commented] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068998#comment-16068998 ] Hudson commented on HDFS-11696: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11954 (See

[jira] [Work stopped] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12062 stopped by Wei-Chiu Chuang. -- > removeErasureCodingPolicy needs super user permission >

[jira] [Work started] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12062 started by Wei-Chiu Chuang. -- > removeErasureCodingPolicy needs super user permission >

[jira] [Updated] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12062: --- Attachment: HDFS-12062.001.patch Added tests for this EC operation as well as a few others

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068972#comment-16068972 ] Manoj Govindassamy commented on HDFS-11881: --- Thanks for the review and commit help

[jira] [Updated] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11696: --- Fix Version/s: (was: 3.0.0-alpha4) > Fix warnings from Spotbugs in hadoop-hdfs >

[jira] [Reopened] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11696: > Fix warnings from Spotbugs in hadoop-hdfs > - > >

[jira] [Commented] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-06-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068965#comment-16068965 ] Andrew Wang commented on HDFS-11696: This JIRA caused a regression, since it makes "hdfs namenode

[jira] [Resolved] (HDFS-12041) Block Storage : make the server address config more concise

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-12041. --- Resolution: Won't Fix > Block Storage : make the server address config more concise >

[jira] [Assigned] (HDFS-12041) Block Storage : make the server address config more concise

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-12041: - Assignee: Chen Liang > Block Storage : make the server address config more concise >

[jira] [Comment Edited] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068839#comment-16068839 ] Chen Liang edited comment on HDFS-12063 at 6/29/17 7:40 PM: Thanks [~linyiqun]

[jira] [Commented] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068839#comment-16068839 ] Chen Liang commented on HDFS-12063: --- Thanks [~linyiqun] for working on this! v001 LGTM overall, with

[jira] [Commented] (HDFS-11965) [SPS] Fix TestPersistentStoragePolicySatisfier#testWithCheckpoint failure

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068826#comment-16068826 ] Hadoop QA commented on HDFS-11965: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2017-06-29 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068797#comment-16068797 ] Misha Dmitriev commented on HDFS-12051: --- I've just discovered that this problem has apparently been

[jira] [Commented] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068680#comment-16068680 ] Chen Liang commented on HDFS-12067: --- Thanks [~steven-wugang] for the contribution. One comment though,

[jira] [Created] (HDFS-12070) Failed block recovery leaves files open indefinitely and at risk for data loss

2017-06-29 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12070: -- Summary: Failed block recovery leaves files open indefinitely and at risk for data loss Key: HDFS-12070 URL: https://issues.apache.org/jira/browse/HDFS-12070 Project:

[jira] [Updated] (HDFS-11965) [SPS] Fix TestPersistentStoragePolicySatisfier#testWithCheckpoint failure

2017-06-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11965: -- Attachment: HDFS-11965-HDFS-10285.002.patch Fixed checkstyle and whitespace

[jira] [Work started] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-06-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12069 started by Weiwei Yang. -- > Ozone: Create a general abstraction for metadata store >

[jira] [Created] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-06-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12069: -- Summary: Ozone: Create a general abstraction for metadata store Key: HDFS-12069 URL: https://issues.apache.org/jira/browse/HDFS-12069 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068374#comment-16068374 ] Hudson commented on HDFS-11881: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11950 (See

[jira] [Updated] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11881: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11881) NameNode consumes a lot of memory for snapshot diff report generation

2017-06-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11881: --- Fix Version/s: 2.8.2 3.0.0-alpha4 2.9.0 > NameNode

[jira] [Commented] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068171#comment-16068171 ] Hadoop QA commented on HDFS-12067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16068107#comment-16068107 ] Hadoop QA commented on HDFS-12063: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Patch Available (was: Open) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Attachment: HDFS_12067.002.patch > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12067: - Status: Open (was: Patch Available) > Add command help description about 'hdfs dfsadmin -help

[jira] [Updated] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12063: - Attachment: HDFS-12063-HDFS-7240.001.patch > Ozone: Ozone shell: Multiple RPC calls for put/get key >

[jira] [Updated] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12063: - Attachment: (was: HDFS-12063-HDFS-7240.001.patch) > Ozone: Ozone shell: Multiple RPC calls for

[jira] [Updated] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12063: - Attachment: HDFS-12063-HDFS-7240.001.patch Attach the initial patch. Some notes that will be helpful for

[jira] [Commented] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067953#comment-16067953 ] Hadoop QA commented on HDFS-12063: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12063) Ozone: Ozone shell: Multiple RPC calls for put/get key

2017-06-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12063: - Status: Patch Available (was: Open) > Ozone: Ozone shell: Multiple RPC calls for put/get key >

[jira] [Commented] (HDFS-12067) Add command help description about 'hdfs dfsadmin -help getVolumeReport' command.

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067950#comment-16067950 ] Hadoop QA commented on HDFS-12067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12053) Ozone: ozone server should create missing metadata directory if it has permission to

2017-06-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067897#comment-16067897 ] Hadoop QA commented on HDFS-12053: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12054) FSNamesystem#addECPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-06-29 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067834#comment-16067834 ] lufei commented on HDFS-12054: -- [~jojochuang], thanks for your time to review.I have checked all the kind of