[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993301#comment-14993301 ] Hudson commented on HDFS-9384: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #646 (See [htt

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993274#comment-14993274 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #576 (See [htt

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993258#comment-14993258 ] Hadoop QA commented on HDFS-9276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993248#comment-14993248 ] Hadoop QA commented on HDFS-6481: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993246#comment-14993246 ] Hudson commented on HDFS-9384: -- FAILURE: Integrated in Hadoop-trunk-Commit #8766 (See [https:

[jira] [Commented] (HDFS-9394) branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.

2015-11-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993229#comment-14993229 ] Chris Nauroth commented on HDFS-9394: - The easiest way to see this problem is to run th

[jira] [Created] (HDFS-9394) branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.

2015-11-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9394: --- Summary: branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Key: HDFS-9394 URL: https://issues.apache.org/jira/brow

[jira] [Resolved] (HDFS-3909) Change Jenkins setting to test libwebhdfs

2015-11-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-3909. Resolution: Fixed Closing as fixed. Yetus now compiles libwebhdfs. > Change Jenkins setting

[jira] [Commented] (HDFS-9375) Set balancer bandwidth for specific node

2015-11-05 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993210#comment-14993210 ] Brahma Reddy Battula commented on HDFS-9375: Thanks [~linyiqun] for reporting t

[jira] [Updated] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9384: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

2015-11-05 Thread J.Andreina (JIRA)
J.Andreina created HDFS-9393: Summary: After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy Key: HDFS-9393 URL: https://issues.apache.org/jira/browse/HDFS-9393

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993148#comment-14993148 ] Hadoop QA commented on HDFS-9234: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9371) Code cleanup for DatanodeManager

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993117#comment-14993117 ] Hadoop QA commented on HDFS-9371: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993058#comment-14993058 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2514 (See [https://

[jira] [Commented] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993057#comment-14993057 ] Hadoop QA commented on HDFS-9387: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993053#comment-14993053 ] Arpit Agarwal commented on HDFS-9379: - +1 for the patch. Did you get a chance to test i

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-11-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993025#comment-14993025 ] Tsz Wo Nicholas Sze commented on HDFS-6481: --- [~rmetzger], thanks for the info. I

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14993004#comment-14993004 ] Hudson commented on HDFS-9377: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #644 (See [htt

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-05 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.12.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-05 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992989#comment-14992989 ] Liangliang Gu commented on HDFS-9276: - Thanks YiLiu Using {code}UserGroupInformation.g

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992979#comment-14992979 ] Rakesh R commented on HDFS-8968: OK, Agreed. > New benchmark throughput tool for striping

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-11-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992975#comment-14992975 ] Xiaoyu Yao commented on HDFS-9234: -- Thanks [~surendrasingh] for the update. Patch v007 LGT

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-11-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992965#comment-14992965 ] Duo Zhang commented on HDFS-8578: - Could we assign these values earlier at the time you loa

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992946#comment-14992946 ] Hadoop QA commented on HDFS-9094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9392) Admins support for maintenance state

2015-11-05 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9392: - Summary: Admins support for maintenance state Key: HDFS-9392 URL: https://issues.apache.org/jira/browse/HDFS-9392 Project: Hadoop HDFS Issue Type: Sub-task Rep

[jira] [Created] (HDFS-9391) Update webUI/JMX/fsck to display maintenance state info

2015-11-05 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9391: - Summary: Update webUI/JMX/fsck to display maintenance state info Key: HDFS-9391 URL: https://issues.apache.org/jira/browse/HDFS-9391 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992932#comment-14992932 ] Hudson commented on HDFS-9282: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #575 (See [htt

[jira] [Created] (HDFS-9390) Block management for maintenance states

2015-11-05 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9390: - Summary: Block management for maintenance states Key: HDFS-9390 URL: https://issues.apache.org/jira/browse/HDFS-9390 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992931#comment-14992931 ] Hudson commented on HDFS-9372: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #575 (See [htt

[jira] [Created] (HDFS-9389) Add maintenance states to AdminStates

2015-11-05 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9389: - Summary: Add maintenance states to AdminStates Key: HDFS-9389 URL: https://issues.apache.org/jira/browse/HDFS-9389 Project: Hadoop HDFS Issue Type: Sub-task Re

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992906#comment-14992906 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992904#comment-14992904 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1367 (See [https://

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992900#comment-14992900 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #633 (See

[jira] [Created] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2015-11-05 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9388: - Summary: Refactor decommission related code to support maintenance state for datanodes Key: HDFS-9388 URL: https://issues.apache.org/jira/browse/HDFS-9388 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-11-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992898#comment-14992898 ] Vinayakumar B commented on HDFS-8578: - bq. I skimmed patch v10, seems you do not modify

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992894#comment-14992894 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2573 (See [htt

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992893#comment-14992893 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2573 (See [htt

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992866#comment-14992866 ] Rui Li commented on HDFS-8968: -- I was planning to run ErasureCodeBenchmarkThroughput with Mini

[jira] [Updated] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-11-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9234: - Attachment: HDFS-9234-007.patch Removed whitespace... Attached updated patch, pleas

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992801#comment-14992801 ] Hudson commented on HDFS-9377: -- FAILURE: Integrated in Hadoop-trunk-Commit #8763 (See [https:

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992790#comment-14992790 ] Hadoop QA commented on HDFS-7163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9371) Code cleanup for DatanodeManager

2015-11-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992785#comment-14992785 ] Jing Zhao commented on HDFS-9371: - Currently I think we can do this cleanup in trunk. I wil

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-11-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Status: Patch Available (was: Open) > Code cleanup for DatanodeManager > >

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2015-11-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9371: Attachment: HDFS-9371.001.patch > Code cleanup for DatanodeManager > > >

[jira] [Updated] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9387: Status: Patch Available (was: Open) > Parse namenodeUri parameter only once in > NNThroughputBenchm

[jira] [Updated] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9387: Attachment: HDFS-9387.000.patch > Parse namenodeUri parameter only once in > NNThroughputBenchmark$O

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992742#comment-14992742 ] Hadoop QA commented on HDFS-9384: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-05 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992724#comment-14992724 ] Tony Wu commented on HDFS-9236: --- Looked at the failed tests and none are related to block rec

[jira] [Created] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-05 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9387: --- Summary: Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument() Key: HDFS-9387 URL: https://issues.apache.org/jira/browse/HDFS-9387

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992684#comment-14992684 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2513 (See [https://

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992683#comment-14992683 ] Hudson commented on HDFS-9372: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2513 (See [https://

[jira] [Updated] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9377: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Com

[jira] [Resolved] (HDFS-4764) TestBlockReaderLocalLegacy flakes in MiniDFSCluster#shutdown

2015-11-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-4764. Resolution: Cannot Reproduce Closing this as stale. > TestBlockReaderLocalLegacy flakes in M

[jira] [Resolved] (HDFS-2881) org.apache.hadoop.hdfs.TestDatanodeBlockScanner Fails Intermittently

2015-11-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-2881. Resolution: Not A Problem Closing this jira. Likely already fixed. > org.apache.hadoop.hdfs.

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992636#comment-14992636 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #643 (See [htt

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-11-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.08.patch The new patch fixed a few bugs: # DN failures can happen in 2 cases: i) while

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992619#comment-14992619 ] Mingliang Liu commented on HDFS-9377: - Thanks to [~yzhangal] for review and commit. Tha

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992613#comment-14992613 ] Yongjun Zhang commented on HDFS-9377: - Thanks [~liuml07]. I will commit it momentarily.

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992606#comment-14992606 ] Mingliang Liu commented on HDFS-9377: - The failing tests are not related. > Fix findbu

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Status: Patch Available (was: Open) > Make NNThroughputBenchmark$BlockReportStats support more than

[jira] [Commented] (HDFS-9234) WebHdfs : getContentSummary() should give quota for storage types

2015-11-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992596#comment-14992596 ] Xiaoyu Yao commented on HDFS-9234: -- [~surendrasingh], can you fix the whitespace issue in

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Summary: Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes (was: Make NNThr

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark$BlockReportStats support more than 10 numThreads

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Summary: Make NNThroughputBenchmark$BlockReportStats support more than 10 numThreads (was: Make NNTh

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Description: Currently, the {{NNThroughputBenchmark}} test {{BlockReportStats}} relies on sorted {{d

[jira] [Updated] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

2015-11-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9379: Status: Open (was: Patch Available) > Make NNThroughputBenchmark support more than 10 numThreads > -

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992575#comment-14992575 ] Hadoop QA commented on HDFS-9117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992572#comment-14992572 ] Xiaoyu Yao commented on HDFS-9384: -- Thanks [~cnauroth] for addressing my comments. Patch v

[jira] [Updated] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9384: Attachment: HDFS-9384.003.patch Hi Xiaoyu. Thank you for reviewing. Technically, it's not necessary

[jira] [Created] (HDFS-9386) Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file

2015-11-05 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-9386: --- Summary: Erasure coding: updateBlockForPipeline sometimes returns non-striped block for striped file Key: HDFS-9386 URL: https://issues.apache.org/jira/browse/HDFS-9386 Project

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992541#comment-14992541 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #632 (See

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992540#comment-14992540 ] Hudson commented on HDFS-9372: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #632 (See

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992532#comment-14992532 ] Hudson commented on HDFS-9372: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1366 (See [https://

[jira] [Commented] (HDFS-9282) Make data directory count and storage raw capacity related tests FsDataset-agnostic

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992533#comment-14992533 ] Hudson commented on HDFS-9282: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1366 (See [https://

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Status: Patch Available (was: Open) > Add command line option to ask NameNode reload configuration.

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094.001.patch Posted patch v001. Kindly review, thanks! > Add command line option

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992514#comment-14992514 ] Xiaoyu Yao commented on HDFS-9384: -- Sorry for the late. The fix looks good to me. I only h

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Component/s: performance ha > Unnecessary DNS resolution attempts when creating NameNodeProx

[jira] [Updated] (HDFS-9123) Copying from the root to a subdirectory should be forbidden

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9123: Labels: supportability (was: ) > Copying from the root to a subdirectory should be forbidden > -

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-8164: Labels: supportability (was: ) > cTime is 0 in VERSION file for newly formatted NameNode. >

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9250: Labels: supportability (was: ) > Add Precondition check to LocatedBlock#addCachedLoc > -

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992509#comment-14992509 ] Hudson commented on HDFS-9372: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2572 (See [htt

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7087: Labels: supportability (was: ) > Ability to list /.reserved > -- > >

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992491#comment-14992491 ] Arpit Agarwal commented on HDFS-9384: - And +1 from Jenkins too! I can't recall the last

[jira] [Updated] (HDFS-9280) Document NFS gateway export point parameter

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9280: Labels: supportability (was: ) > Document NFS gateway export point parameter > -

[jira] [Updated] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-11-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9231: Labels: supportability (was: ) > fsck doesn't list correct file path when Bad Replicas/Blocks are in

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992495#comment-14992495 ] Chris Nauroth commented on HDFS-9384: - bq. And +1 from Jenkins too! I can't recall the

[jira] [Commented] (HDFS-9384) TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.

2015-11-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992488#comment-14992488 ] Arpit Agarwal commented on HDFS-9384: - +1, nice find. > TestWebHdfsContentLength inter

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-05 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992486#comment-14992486 ] Haohui Mai commented on HDFS-9328: -- It's better to have the file in markdown format, prefe

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992484#comment-14992484 ] Hadoop QA commented on HDFS-9377: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-05 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992443#comment-14992443 ] Bob Hansen commented on HDFS-9103: -- {quote} "I would like to see the FileHandle::Pread met

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992445#comment-14992445 ] James Clampffer commented on HDFS-9328: --- I'm fine with relaxing the clang-format rule

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992431#comment-14992431 ] James Clampffer commented on HDFS-9103: --- Thanks for the comments Bob! "Include an ab

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-05 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992415#comment-14992415 ] Bob Hansen commented on HDFS-9328: -- I am not keen on tying the coding standards to a tool

[jira] [Commented] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992412#comment-14992412 ] Hudson commented on HDFS-4937: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #574 (See [htt

[jira] [Commented] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992413#comment-14992413 ] Hudson commented on HDFS-9378: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #574 (See [htt

[jira] [Commented] (HDFS-9372) Remove dead code in DataStorage.recoverTransitionRead

2015-11-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14992396#comment-14992396 ] Hudson commented on HDFS-9372: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #642 (See [htt

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163.002.patch New patch (HDFS-7163.002.patch). Fixed unit test failures for {{TestWriteR

[jira] [Updated] (HDFS-9385) Enable config substitutions in libhdfs++

2015-11-05 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9385: - Attachment: HDFS-9385.patch Implementation of config and environment substitution > Enable config substitu

[jira] [Created] (HDFS-9385) Enable config substitutions in libhdfs++

2015-11-05 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9385: Summary: Enable config substitutions in libhdfs++ Key: HDFS-9385 URL: https://issues.apache.org/jira/browse/HDFS-9385 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-05 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.012.patch Removed all references to substitution > Config file reader / op

  1   2   >