[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979062#comment-14979062 ] Colin Patrick McCabe commented on HDFS-9267: I don't see why you have to load all replicas into

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979100#comment-14979100 ] Hudson commented on HDFS-9279: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1332 (See

[jira] [Commented] (HDFS-9083) Replication violates block placement policy.

2015-10-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979115#comment-14979115 ] Kihwal Lee commented on HDFS-9083: -- +1 > Replication violates block placement policy. >

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-10-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9083: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status: Resolved

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979724#comment-14979724 ] Hudson commented on HDFS-9168: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2486 (See

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979725#comment-14979725 ] Hudson commented on HDFS-9295: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2486 (See

[jira] [Commented] (HDFS-9057) allow/disallow snapshots via webhdfs

2015-10-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979664#comment-14979664 ] Vinayakumar B commented on HDFS-9057: - +1, Latest revision Patch looks great. Pending jenkins. just

[jira] [Commented] (HDFS-9303) Balancer slowly with too many small file blocks

2015-10-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979663#comment-14979663 ] Tsz Wo Nicholas Sze commented on HDFS-9303: --- Hi Lin, thanks. We recently have quite a few

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-10-28 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.06.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979733#comment-14979733 ] Walter Su commented on HDFS-9334: - It shouldn't return -1. If it did, it means the linked list is broken.

[jira] [Commented] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979726#comment-14979726 ] Hadoop QA commented on HDFS-9044: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8545) Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979775#comment-14979775 ] Hadoop QA commented on HDFS-8545: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9335) Webhdfs hangs when folder is used for Append

2015-10-28 Thread Jagadesh Kiran N (JIRA)
Jagadesh Kiran N created HDFS-9335: -- Summary: Webhdfs hangs when folder is used for Append Key: HDFS-9335 URL: https://issues.apache.org/jira/browse/HDFS-9335 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9057) allow/disallow snapshots via webhdfs

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979833#comment-14979833 ] Hadoop QA commented on HDFS-9057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8545) Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path

2015-10-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8545: - Attachment: HDFS-8545.7.patch Attaching a patch, fixing checkstyle errors. Please review. > Refactor

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979652#comment-14979652 ] Hadoop QA commented on HDFS-9331: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9334: - Summary: NameNode crash caused by ArrayIndexOutOfBoundsException Key: HDFS-9334 URL: https://issues.apache.org/jira/browse/HDFS-9334 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979756#comment-14979756 ] Hudson commented on HDFS-9295: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #548 (See

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979755#comment-14979755 ] Hudson commented on HDFS-9168: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #548 (See

[jira] [Updated] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9229: - Attachment: HDFS-9229.006.patch Thanks [~zhz]! Fixed remaining two comments.

[jira] [Commented] (HDFS-9332) Fix Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979655#comment-14979655 ] Hadoop QA commented on HDFS-9332: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979682#comment-14979682 ] Hadoop QA commented on HDFS-9117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979748#comment-14979748 ] He Xiaoqiao commented on HDFS-9334: --- hi [~walter.k.su], the case happens at SBN when do editlog tailer.

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979765#comment-14979765 ] He Xiaoqiao commented on HDFS-9334: --- the following scenario may occur ArrayIndexOutOfBoundsException: 1.

[jira] [Commented] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-10-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979772#comment-14979772 ] J.Andreina commented on HDFS-9044: -- Failures are unrelated to this patch. Please review. > Give Priority

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.015.patch The v15 patch fixes another conflict with [HDFS-4015]. Per offline

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979880#comment-14979880 ] Walter Su commented on HDFS-9334: - In the latest code from thunk, {{removeStorage()}} is always called

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2015-10-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8498: - Target Version/s: 2.7.3 > Blocks can be committed with wrong size >

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2015-10-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8498: - Target Version/s: (was: 2.7.2) > Blocks can be committed with wrong size >

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Attachment: HDFS-9262.001.patch Posted patch 001. > Reconfigure lazy writer interval on the fly >

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979240#comment-14979240 ] Hudson commented on HDFS-9279: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2539 (See

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2015-10-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979256#comment-14979256 ] Kihwal Lee commented on HDFS-8498: -- This is an existing bug, I believe. Re-targeting to 2.7.3. > Blocks

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.06.patch Updating the patch with more Javadoc and addressing the test failures. In 05

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.013.patch The v13 patch revisits the synchronized methods in

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979170#comment-14979170 ] Lei (Eddy) Xu commented on HDFS-9267: - bq. I don't see why you have to load all replicas into a map.

[jira] [Created] (HDFS-9330) Reconfigure deleting duplicate replica on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9330: --- Summary: Reconfigure deleting duplicate replica on the fly Key: HDFS-9330 URL: https://issues.apache.org/jira/browse/HDFS-9330 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9330) Reconfigure deleting duplicate replica on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Description: This is to reconfigure {code} dfs.datanode.duplicate.replica.deletion {code} without

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9295: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Status: Patch Available (was: Open) > Reconfigure lazy writer interval on the fly >

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Attachment: HDFS-9295.003.patch [~zhz], I think this patch addresses all of your concerns. >

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979283#comment-14979283 ] Zhe Zhang commented on HDFS-9295: - 03 patch looks great! Thanks very much for the update Daniel. +1,

[jira] [Commented] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

2015-10-28 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979305#comment-14979305 ] Uma Maheswara Rao G commented on HDFS-9261: --- +1 on the latest path. Thanks Rakesh. > Erasure

[jira] [Updated] (HDFS-9289) check genStamp when complete file

2015-10-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9289: --- Attachment: HDFS-9289.4.patch Thanks [~jingzhao] for proposal! I have updated .4 patch which log mismatched

[jira] [Updated] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-10-28 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9331: -- Status: Patch Available (was: Open) > Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.012.patch Added brackets to if blocks. Got all the error

[jira] [Updated] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-10-28 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9331: -- Attachment: HDFS-9331.001.patch In v1 patch: * Relax the check in {{TestNameNodeMXBean#testNameNodeMXBeanInfo}}

[jira] [Updated] (HDFS-9332) Fix Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9332: -- Summary: Fix Precondition failures from NameNodeEditLogRoller while saving namespace (was: Fix repeated

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-10-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979365#comment-14979365 ] Hadoop QA commented on HDFS-7163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.014.patch The v14 patch resolves the conflicts with [HDFS-4015]. Thanks to

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8766: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Status: Resolved

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979418#comment-14979418 ] Haohui Mai commented on HDFS-8766: -- bq. Currently the only way people can find out that this project

[jira] [Created] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-10-28 Thread Tony Wu (JIRA)
Tony Wu created HDFS-9331: - Summary: Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use Key: HDFS-9331 URL: https://issues.apache.org/jira/browse/HDFS-9331

[jira] [Created] (HDFS-9332) Fix repeated Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-9332: - Summary: Fix repeated Precondition failures from NameNodeEditLogRoller while saving namespace Key: HDFS-9332 URL: https://issues.apache.org/jira/browse/HDFS-9332 Project:

[jira] [Updated] (HDFS-9332) Fix Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9332: -- Status: Patch Available (was: Open) > Fix Precondition failures from NameNodeEditLogRoller while saving

[jira] [Updated] (HDFS-9332) Fix Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9332: -- Attachment: HDFS-9332.001.patch Simple patch attached. FSNamesystem already has a method which does the

[jira] [Commented] (HDFS-9289) check genStamp when complete file

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979367#comment-14979367 ] Zhe Zhang commented on HDFS-9289: - Thanks Jing for sharing the thoughts. I think the GS validation in

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979415#comment-14979415 ] Haohui Mai commented on HDFS-8766: -- +1. > Implement a libhdfs(3) compatible API >

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979436#comment-14979436 ] Hudson commented on HDFS-9168: -- FAILURE: Integrated in Hadoop-trunk-Commit #8721 (See

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979437#comment-14979437 ] Hudson commented on HDFS-9295: -- FAILURE: Integrated in Hadoop-trunk-Commit #8721 (See

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979434#comment-14979434 ] Zhe Zhang commented on HDFS-8498: - bq. A faulty client may misreport the size when committing the block.

[jira] [Commented] (HDFS-8333) Create EC zone should not need superuser privilege

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979440#comment-14979440 ] Zhe Zhang commented on HDFS-8333: - bq. createEncryptionZone requires superuser privilege. So we should do

[jira] [Updated] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-10-28 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9331: -- Description: {{TestNameNodeMXBean#testNameNodeMXBeanInfo}} expects a none-zero nonDFS size. The nonDFS size is

[jira] [Commented] (HDFS-9289) check genStamp when complete file

2015-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979400#comment-14979400 ] Jing Zhao commented on HDFS-9289: - bq. What if the updatePipeline RPC call has successfully finished NN

[jira] [Commented] (HDFS-9332) Fix Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979406#comment-14979406 ] Yongjun Zhang commented on HDFS-9332: - Thanks [~awang] for reporting the issue and patch, +1 pending

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979413#comment-14979413 ] Jing Zhao commented on HDFS-9168: - +1 on the latest patch. > Move client side unit test to

[jira] [Commented] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979426#comment-14979426 ] Zhe Zhang commented on HDFS-9229: - Thanks Surendra! I agree with you on both points above. I understood

[jira] [Updated] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9168: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979467#comment-14979467 ] Hudson commented on HDFS-9168: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #597 (See

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979468#comment-14979468 ] Hudson commented on HDFS-9295: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #597 (See

[jira] [Commented] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979541#comment-14979541 ] Hudson commented on HDFS-9295: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2540 (See

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979540#comment-14979540 ] Hudson commented on HDFS-9168: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2540 (See

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979549#comment-14979549 ] Hudson commented on HDFS-9279: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #547 (See

[jira] [Commented] (HDFS-9332) Fix Precondition failures from NameNodeEditLogRoller while saving namespace

2015-10-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979450#comment-14979450 ] Mingliang Liu commented on HDFS-9332: - Looks good to me. +1 (non-bing) > Fix Precondition failures

[jira] [Updated] (HDFS-6200) Create a separate jar for hdfs-client

2015-10-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6200: - Resolution: Fixed Fix Version/s: 2.8.0 Release Note: Projects that access HDFS can

[jira] [Commented] (HDFS-9279) Decomissioned capacity should not be considered for configured/used capacity

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979465#comment-14979465 ] Hudson commented on HDFS-9279: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2485 (See

[jira] [Commented] (HDFS-8333) Create EC zone should not need superuser privilege

2015-10-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979473#comment-14979473 ] Andrew Wang commented on HDFS-8333: --- Regarding createEncryptionZone, we kept it superuser-only since a

[jira] [Commented] (HDFS-8705) BlockStoragePolicySuite uses equalsIgnoreCase for name lookup, won't work in all locales

2015-10-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977996#comment-14977996 ] Brahma Reddy Battula commented on HDFS-8705: {{StringUtils.equalsIgnoreCase(..)}} tells

[jira] [Updated] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-10-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9044: - Attachment: HDFS-9044.6.patch > Give Priority to FavouredNodes , before selecting nodes from

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978017#comment-14978017 ] Hudson commented on HDFS-9231: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2536 (See

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Summary: Wait previous ErasureCodingWork to finish before schedule another one (was: Fix

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Description: In {{ErasureCodingWorker}}, for the same block group, one task doesn't know which internal

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Attachment: HDFS-9275.04.patch for non-ec block, if it loses 1 replica, we schedule 1 task. It loses 1

[jira] [Updated] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-10-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9044: - Attachment: (was: HDFS-9044.6.patch) > Give Priority to FavouredNodes , before selecting nodes from

[jira] [Commented] (HDFS-9302) WebHDFS throws NullPointerException if newLength is not provided

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978013#comment-14978013 ] Hudson commented on HDFS-9302: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2536 (See

[jira] [Commented] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978014#comment-14978014 ] Hudson commented on HDFS-9317: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2536 (See

[jira] [Commented] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978016#comment-14978016 ] Hudson commented on HDFS-9311: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2536 (See

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Attachment: (was: HDFS-9275.04.patch) > Wait previous ErasureCodingWork to finish before schedule

[jira] [Commented] (HDFS-9302) WebHDFS throws NullPointerException if newLength is not provided

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978055#comment-14978055 ] Hudson commented on HDFS-9302: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #606 (See

[jira] [Commented] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978058#comment-14978058 ] Hudson commented on HDFS-9311: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #606 (See

[jira] [Commented] (HDFS-9317) Document fsck -blockId and -storagepolicy options in branch-2.7

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978056#comment-14978056 ] Hudson commented on HDFS-9317: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #606 (See

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-10-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978059#comment-14978059 ] Hudson commented on HDFS-9231: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #606 (See

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Attachment: HDFS-9275.04.patch > Wait previous ErasureCodingWork to finish before schedule another one >

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Attachment: (was: HDFS-9275.04.patch) > Wait previous ErasureCodingWork to finish before schedule

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Attachment: HDFS-9275.04.patch > Wait previous ErasureCodingWork to finish before schedule another one >

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-10-28 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9275: Status: Patch Available (was: Open) > Wait previous ErasureCodingWork to finish before schedule another one

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-10-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9333: Summary: Some tests using MiniDFSCluster errored complaining port in use (was: TestBlockTokenWithDFSStriped

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-28 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.010.patch Stripped trailing whitespace. > Config file reader / options

[jira] [Created] (HDFS-9333) TestBlockTokenWithDFSStriped errored complaining port in use

2015-10-28 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9333: --- Summary: TestBlockTokenWithDFSStriped errored complaining port in use Key: HDFS-9333 URL: https://issues.apache.org/jira/browse/HDFS-9333 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-10-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9333: Description: Ref. the following: {noformat} Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-10-28 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979572#comment-14979572 ] Kai Zheng commented on HDFS-9333: - Just a quick thought, maybe we could use random server port every time

<    1   2   3   >