[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990427#comment-14990427 ] Hadoop QA commented on HDFS-9364: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990444#comment-14990444 ] Hudson commented on HDFS-9007: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990446#comment-14990446 ] Hudson commented on HDFS-8855: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990447#comment-14990447 ] Hudson commented on HDFS-9357: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-11-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: HDFS-9371.000.patch > Code cleanup for DatanodeManager > > >

[jira] [Updated] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9377: Hadoop Flags: Reviewed Target Version/s: 2.8.0 Component/s: namenode +1 pending

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990521#comment-14990521 ] Tony Wu commented on HDFS-9282: --- Thanks [~eddyxu] for catching this. I have incorporated the comments in the

[jira] [Commented] (HDFS-9318) considerLoad factor can be improved

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990641#comment-14990641 ] Hadoop QA commented on HDFS-9318: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9377: Description: I ran findbugs version 3.0.1 and find there is a findbugs warning in

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-11-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990582#comment-14990582 ] Yongjun Zhang commented on HDFS-9231: - Many thanks [~liuml07], I reviewed and commented in HDFS-9377.

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990579#comment-14990579 ] Yongjun Zhang commented on HDFS-9377: - Thanks [~liuml07] a lot for the good find here! +1 pending

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-11-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: (was: HDFS-9371.000.patch) > Code cleanup for DatanodeManager >

[jira] [Updated] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9282: -- Attachment: HDFS-9282.004.patch In v4 patch: * Addressed [~eddyxu]'s review comments (use {{try-with-resources}}

[jira] [Updated] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9377: Status: Patch Available (was: Open) > Fix findbugs warnings in FSDirSnapshotOp >

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990546#comment-14990546 ] Mingliang Liu commented on HDFS-9231: - I found a findbugs warning in {{FSDirSnapshotOp}} probably

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990628#comment-14990628 ] Xiao Chen commented on HDFS-9231: - Thanks [~liuml07] and [~yzhangal], and sorry for the findbugs miss. >

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990464#comment-14990464 ] James Clampffer commented on HDFS-9103: --- The thumbs down was supposed to be a log base 2. One of

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990634#comment-14990634 ] Xiao Chen commented on HDFS-9377: - Thanks very much for the work guys! I added a link to the original JIRA,

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990381#comment-14990381 ] James Clampffer commented on HDFS-9103: --- "Every node in the set requires a separate heap allocation.

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990445#comment-14990445 ] Hudson commented on HDFS-9363: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990449#comment-14990449 ] Hudson commented on HDFS-9331: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990478#comment-14990478 ] Haohui Mai commented on HDFS-9103: -- Thanks for the investigation. I'm okay with either approach. Please

[jira] [Assigned] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9328: - Assignee: James Clampffer (was: Haohui Mai) > Formalize coding standards for libhdfs++

[jira] [Updated] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9377: Attachment: HDFS-9377.000.patch > Fix findbugs warnings in FSDirSnapshotOp >

[jira] [Created] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9377: --- Summary: Fix findbugs warnings in FSDirSnapshotOp Key: HDFS-9377 URL: https://issues.apache.org/jira/browse/HDFS-9377 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990593#comment-14990593 ] Hudson commented on HDFS-9007: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990596#comment-14990596 ] Hudson commented on HDFS-9357: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990598#comment-14990598 ] Hudson commented on HDFS-9331: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990594#comment-14990594 ] Hudson commented on HDFS-9363: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990595#comment-14990595 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990651#comment-14990651 ] Hudson commented on HDFS-9363: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1362 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990654#comment-14990654 ] Hudson commented on HDFS-9331: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1362 (See

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990661#comment-14990661 ] Mingliang Liu commented on HDFS-9231: - Thanks for your quick reply, [~yzhangal] and [~xiaochen].

[jira] [Commented] (HDFS-9369) Use ctest to run tests for hadoop-hdfs-native-client

2015-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990736#comment-14990736 ] Haohui Mai commented on HDFS-9369: -- It looks like there is no need to change the patch. The information is

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9103: -- Attachment: HDFS-9103.HDFS-8707.007.patch New patch, there's a bit of extra noise due to

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

2015-11-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990731#comment-14990731 ] Xiaoyu Yao commented on HDFS-9360: -- Patch v002 looks good to me. The test failures and findbugs issues are

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990727#comment-14990727 ] Hudson commented on HDFS-9363: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #628 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990728#comment-14990728 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #628 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990730#comment-14990730 ] Hudson commented on HDFS-9331: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #628 (See

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990800#comment-14990800 ] Zhe Zhang commented on HDFS-9364: - Thanks Xiao for the patch and [~andreina] for the review. Should we add

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990799#comment-14990799 ] Haohui Mai commented on HDFS-9378: -- +1. Thanks. > hadoop-hdfs-client tests do not write logs. >

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-11-04 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990758#comment-14990758 ] Staffan Friberg commented on HDFS-9260: --- Hi Daryn, Thanks for the comments and the additional data

[jira] [Created] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9378: --- Summary: hadoop-hdfs-client tests do not write logs. Key: HDFS-9378 URL: https://issues.apache.org/jira/browse/HDFS-9378 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-04 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990903#comment-14990903 ] Walter Su commented on HDFS-9236: - The logic looks good to me. Thanks [~twu] for updating and [~yzhangal]

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990945#comment-14990945 ] Yongjun Zhang commented on HDFS-9236: - Thanks [~twu] for the new rev and [~walter.k.su] for the

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990726#comment-14990726 ] Hudson commented on HDFS-9007: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #628 (See

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-11-04 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFSBenchmarks.zip Microbenchmarks > Improve performance and GC friendliness of

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990857#comment-14990857 ] Mingliang Liu commented on HDFS-9378: - +1 (non-binding). I also think it's OK to commit without

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.021.patch The failing tests can pass locally. The v21 patch is to address the

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990983#comment-14990983 ] Hadoop QA commented on HDFS-9103: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990743#comment-14990743 ] Arpit Agarwal commented on HDFS-9378: - +1, probably okay to commit this without Jenkins +1. Thanks for

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990652#comment-14990652 ] Hudson commented on HDFS-8855: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1362 (See

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990650#comment-14990650 ] Hudson commented on HDFS-9007: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1362 (See

[jira] [Commented] (HDFS-9168) Move client side unit test to hadoop-hdfs-client

2015-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990719#comment-14990719 ] Chris Nauroth commented on HDFS-9168: - I noticed that the tests that have been moved into

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-11-04 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Description: This patch changes the datastructures used for BlockInfos and Replicas to keep

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990924#comment-14990924 ] Hadoop QA commented on HDFS-9282: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990939#comment-14990939 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990938#comment-14990938 ] Hudson commented on HDFS-9363: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990942#comment-14990942 ] Hudson commented on HDFS-9331: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990937#comment-14990937 ] Hudson commented on HDFS-9007: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990940#comment-14990940 ] Hudson commented on HDFS-9357: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-04 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990964#comment-14990964 ] Rui Li commented on HDFS-8968: -- Thanks [~rakeshr] for the detailed and helpful comments. I'll update the patch

[jira] [Updated] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9378: Attachment: HDFS-9378.001.patch I'm attaching a trivial patch that simply copies the same

[jira] [Updated] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9378: Status: Patch Available (was: Open) > hadoop-hdfs-client tests do not write logs. >

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990995#comment-14990995 ] Hudson commented on HDFS-9363: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990999#comment-14990999 ] Hudson commented on HDFS-9331: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See

[jira] [Commented] (HDFS-9372) Typo in DataStorage.recoverTransitionRead

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991074#comment-14991074 ] Mingliang Liu commented on HDFS-9372: - +1 (non-binding) pending on Jenkins. > Typo in

[jira] [Created] (HDFS-9380) Builds are failing with protobuf directories as undef

2015-11-04 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9380: Summary: Builds are failing with protobuf directories as undef Key: HDFS-9380 URL: https://issues.apache.org/jira/browse/HDFS-9380 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991236#comment-14991236 ] Brahma Reddy Battula commented on HDFS-9038: Uploaded the patch fix the checkstyle issues..

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-11-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991047#comment-14991047 ] ASF GitHub Bot commented on HDFS-8562: -- GitHub user hash-X opened a pull request:

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991106#comment-14991106 ] Hadoop QA commented on HDFS-9129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

2015-11-04 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-9382: - Summary: Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work Key: HDFS-9382 URL:

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991104#comment-14991104 ] Bob Hansen commented on HDFS-9103: -- I think the design is sound. We could create an interface and

[jira] [Created] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-04 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-9381: - Summary: When same block came for replication for Striped mode, we can move that block to PendingReplications Key: HDFS-9381 URL:

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991191#comment-14991191 ] Hadoop QA commented on HDFS-9379: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990994#comment-14990994 ] Hudson commented on HDFS-9007: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990997#comment-14990997 ] Hudson commented on HDFS-9357: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990996#comment-14990996 ] Hudson commented on HDFS-8855: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991030#comment-14991030 ] Hadoop QA commented on HDFS-9103: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9372) Typo in DataStorage.recoverTransitionRead

2015-11-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-9372: Attachment: HDFS-9372-v1.patch Just remove the dead code. > Typo in DataStorage.recoverTransitionRead >

[jira] [Created] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

2015-11-04 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9379: --- Summary: Make NNThroughputBenchmark support more than 10 numThreads Key: HDFS-9379 URL: https://issues.apache.org/jira/browse/HDFS-9379 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Status: Patch Available (was: Open) > Make NNThroughputBenchmark support more than 10 numThreads >

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

2015-11-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Attachment: HDFS-9379.000.patch > Make NNThroughputBenchmark support more than 10 numThreads >

[jira] [Commented] (HDFS-9372) Typo in DataStorage.recoverTransitionRead

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991156#comment-14991156 ] Hadoop QA commented on HDFS-9372: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9038: --- Attachment: HDFS-9038-002.patch > Reserved space is erroneously counted towards

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-11-04 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991250#comment-14991250 ] Surendra Singh Lilhore commented on HDFS-9234: -- The test failures and findbugs issues are

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990291#comment-14990291 ] Hudson commented on HDFS-9357: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #627 (See

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990185#comment-14990185 ] Ming Ma commented on HDFS-9007: --- Thanks [~eddyxu]! > Fix HDFS Balancer to honor upgrade domain policy >

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990215#comment-14990215 ] Tony Wu commented on HDFS-9236: --- Thanks a lot [~yzhangal] for your comments. I incorporated them into the new

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990244#comment-14990244 ] Rakesh R commented on HDFS-8968: Good work [~lirui]. I've few comments, please take a look at it. # Can we

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990257#comment-14990257 ] Hudson commented on HDFS-9363: -- FAILURE: Integrated in Hadoop-trunk-Commit #8757 (See

[jira] [Updated] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9236: -- Attachment: HDFS-9236.007.patch In v7 patch: * Addressed [~yzhangal]'s review comments. * Update the test case.

[jira] [Commented] (HDFS-9357) NN UI renders icons of decommissioned DN incorrectly

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990248#comment-14990248 ] Hudson commented on HDFS-9357: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1361 (See

[jira] [Commented] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990256#comment-14990256 ] Hudson commented on HDFS-9007: -- FAILURE: Integrated in Hadoop-trunk-Commit #8757 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990258#comment-14990258 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-trunk-Commit #8757 (See

[jira] [Commented] (HDFS-9331) Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

2015-11-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990260#comment-14990260 ] Hudson commented on HDFS-9331: -- FAILURE: Integrated in Hadoop-trunk-Commit #8757 (See

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

2015-11-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989523#comment-14989523 ] Rakesh R commented on HDFS-7764: Thanks [~cmccabe] for the suggestion. I've attached another patch

[jira] [Updated] (HDFS-9375) Set balancer bandwidth for specific node

2015-11-04 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9375: Status: Patch Available (was: Open) > Set balancer bandwidth for specific node >

[jira] [Updated] (HDFS-9375) Set balancer bandwidth for specific node

2015-11-04 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9375: Attachment: HDFS-9375.001.patch I attach the patch, add a new dfsadmin command

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989659#comment-14989659 ] Hadoop QA commented on HDFS-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >