[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-6826: -- Attachment: HDFS-6826.14.patch Fixing Javadoc error. The remaining test case failure is unrelated

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370944#comment-14370944 ] Hadoop QA commented on HDFS-7961: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370812#comment-14370812 ] Hadoop QA commented on HDFS-7833: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370828#comment-14370828 ] Yongjun Zhang commented on HDFS-7835: - Thanks [~zxu]. +1, and I will commit tomorrow.

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370854#comment-14370854 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-trunk-Commit #7380 (See

[jira] [Commented] (HDFS-7957) Truncate should verify quota before making changes

2015-03-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370905#comment-14370905 ] Tsz Wo Nicholas Sze commented on HDFS-7957: --- In

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370814#comment-14370814 ] Lei (Eddy) Xu commented on HDFS-7833: - These failing tests are not related. DataNode

[jira] [Commented] (HDFS-7835) make initial sleeptime in locateFollowingBlock configurable for DFSClient.

2015-03-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370821#comment-14370821 ] zhihai xu commented on HDFS-7835: - All these test failure are not related to my change.

[jira] [Commented] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

2015-03-20 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370834#comment-14370834 ] Anthony Hsu commented on HDFS-6599: --- We're encountering NameNode slowness on Hadoop 2.3

[jira] [Updated] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7962: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7427) [fetchimage] Should give correct error message when it's not able flush the image file.

2015-03-20 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370893#comment-14370893 ] Walter Su commented on HDFS-7427: - It's fixed in my hadoop 2.6.0 version. {code}

[jira] [Updated] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-7963: --- Affects Version/s: 2.7.0 Status: Patch Available (was: Open) Fix expected

[jira] [Updated] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-7963: --- Attachment: HDFS-7963.001.patch There are no tracing spans named DFSOutputStream any more. In

[jira] [Commented] (HDFS-6841) Use Time.monotonicNow() wherever applicable instead of Time.now()

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370950#comment-14370950 ] Hadoop QA commented on HDFS-6841: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7881) TestHftpFileSystem#testSeek fails in branch-2

2015-03-20 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371076#comment-14371076 ] Akira AJISAKA commented on HDFS-7881: - Thanks [~brahmareddy] for the update. Mostly

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-006.patch Separate class DataStreamer out of DFSOutputStream

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371090#comment-14371090 ] Li Bo commented on HDFS-7854: - The failure of {{TestTracing#testWriteTraceHooks}} seems caused

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371159#comment-14371159 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371162#comment-14371162 ] Hudson commented on HDFS-7816: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371164#comment-14371164 ] Hudson commented on HDFS-7932: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371167#comment-14371167 ] Hadoop QA commented on HDFS-7963: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371161#comment-14371161 ] Hudson commented on HDFS-7930: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371048#comment-14371048 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-03-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7966: - Labels: gsoc gsoc2015 mentor (was: gsoc2015 mentor) New Data Transfer Protocol via HTTP/2

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372359#comment-14372359 ] Hadoop QA commented on HDFS-7928: - {color:red}-1 overall{color}. Here are the results of

[jira] [Work started] (HDFS-7969) Erasure coding: lease recovery for striped block groups

2015-03-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7969 started by Zhe Zhang. --- Erasure coding: lease recovery for striped block groups

[jira] [Commented] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372392#comment-14372392 ] Hadoop QA commented on HDFS-7942: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372433#comment-14372433 ] Hadoop QA commented on HDFS-7961: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372272#comment-14372272 ] Zhe Zhang commented on HDFS-7854: - Thanks Bo for the updated patch. It looks good to me. It

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372295#comment-14372295 ] Andrew Wang commented on HDFS-7960: --- Reading through it again, few comments:

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-03-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372343#comment-14372343 ] Ravi Prakash commented on HDFS-7713: I just noticed that browsing that directory leads

[jira] [Created] (HDFS-7969) Erasure coding: lease recovery for striped block groups

2015-03-20 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7969: --- Summary: Erasure coding: lease recovery for striped block groups Key: HDFS-7969 URL: https://issues.apache.org/jira/browse/HDFS-7969 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6353) Handle checkpoint failure more gracefully

2015-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6353: Attachment: HDFS-6353.002.patch Rebase the patch to run Jenkins. Handle checkpoint failure more gracefully

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-20 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372316#comment-14372316 ] Jitendra Nath Pandey commented on HDFS-6826: Hi [~asuresh], Thanks for the

[jira] [Updated] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-03-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7713: --- Attachment: HDFS-7713.07.patch Improve the HDFS Web UI browser to allow creating dirs

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372424#comment-14372424 ] Hadoop QA commented on HDFS-7854: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7942) NFS: support regexp grouping in nfs.exports.allowed.hosts

2015-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372303#comment-14372303 ] Jing Zhao commented on HDFS-7942: - The patch looks good to me. +1 In the meanwhile, looks

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2015-03-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372305#comment-14372305 ] Daryn Sharp commented on HDFS-7967: --- The current implementation is so bad that on large

[jira] [Updated] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-03-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7713: --- Attachment: HDFS-7713.07.patch Thanks a lot Haohui! Great catch! Here a patch which encodes the URI

[jira] [Updated] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-03-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7713: --- Attachment: (was: HDFS-7713.07.patch) Improve the HDFS Web UI browser to allow creating dirs

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372281#comment-14372281 ] Zhe Zhang commented on HDFS-7854: - Thanks Jing! In that case I'll do the rebase now.

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7854: Attachment: HDFS-7854-007.patch The rebase is mainly about 3 commits: HDFS-7835 and HDFS-6841. Their changes

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-03-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372334#comment-14372334 ] Daryn Sharp commented on HDFS-7964: --- As background, the problem was tackled after

[jira] [Commented] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372349#comment-14372349 ] Hadoop QA commented on HDFS-7917: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372278#comment-14372278 ] Jing Zhao commented on HDFS-7854: - I quickly went through the latest patch and it looks

[jira] [Created] (HDFS-7967) Reduce the performance impact of the balancer

2015-03-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-7967: - Summary: Reduce the performance impact of the balancer Key: HDFS-7967 URL: https://issues.apache.org/jira/browse/HDFS-7967 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

2015-03-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372340#comment-14372340 ] Brandon Li commented on HDFS-5523: -- Sounds like a good start point. Additionally, how

[jira] [Created] (HDFS-7968) Properly encode WebHDFS requests coming from the NN UI

2015-03-20 Thread Ravi Prakash (JIRA)
Ravi Prakash created HDFS-7968: -- Summary: Properly encode WebHDFS requests coming from the NN UI Key: HDFS-7968 URL: https://issues.apache.org/jira/browse/HDFS-7968 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-6826: -- Attachment: HDFS-6826.15.patch [~jnp], yup.. agreed, interfaces are cleaner.. will revert uploading new

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372371#comment-14372371 ] Hadoop QA commented on HDFS-7748: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372404#comment-14372404 ] Colin Patrick McCabe commented on HDFS-7960: bq. there's a TODO: FIXME, we

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372454#comment-14372454 ] Hadoop QA commented on HDFS-7960: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2015-03-20 Thread Frode Halvorsen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371277#comment-14371277 ] Frode Halvorsen commented on HDFS-7212: --- Sometimes the datanoe dosen't come back by

[jira] [Updated] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7963: - Description: Setting the target version to 2.7.0. We don't want to release it with the test broken.

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371372#comment-14371372 ] Hudson commented on HDFS-7930: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #129 (See

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371370#comment-14371370 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #129 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371364#comment-14371364 ] Hudson commented on HDFS-7816: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2070 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371373#comment-14371373 ] Hudson commented on HDFS-7816: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #129 (See

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371375#comment-14371375 ] Hudson commented on HDFS-7932: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #129 (See

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371361#comment-14371361 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2070 (See

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371368#comment-14371368 ] Hudson commented on HDFS-7932: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2070 (See

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371363#comment-14371363 ] Hudson commented on HDFS-7930: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2070 (See

[jira] [Reopened] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2015-03-20 Thread Frode Halvorsen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frode Halvorsen reopened HDFS-7212: --- Still a problem in 2.6.0. I have 6 datanodes in two racks. Periodically one or two nodes is

[jira] [Commented] (HDFS-6599) 2.4 addBlock is 10 to 20 times slower compared to 0.23

2015-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371310#comment-14371310 ] Kihwal Lee commented on HDFS-6599: -- There have been many performance improvements since

[jira] [Updated] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7963: - Description: There are no tracing spans named DFSOutputStream any more. In addition, spans having multiple

[jira] [Updated] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7963: - Description: (was: Setting the target version to 2.7.0. We don't want to release it with the test

[jira] [Updated] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2015-03-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7597: -- Summary: DNs should not open new NN connections when webhdfs clients seek (was: Clients seeking over

[jira] [Commented] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2015-03-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371285#comment-14371285 ] Jason Lowe commented on HDFS-7212: -- Wondering if you were seeing the same thing as

[jira] [Updated] (HDFS-5241) Provide alternate queuing audit logger to reduce logging contention

2015-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5241: - Fix Version/s: 2.3.0 Provide alternate queuing audit logger to reduce logging contention

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371294#comment-14371294 ] Hadoop QA commented on HDFS-7854: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371344#comment-14371344 ] Kihwal Lee commented on HDFS-7963: -- [~cmccabe], I think you are most familiar with this.

[jira] [Commented] (HDFS-7941) SequenceFile.Writer.hsync() not working?

2015-03-20 Thread Sverre Bakke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371459#comment-14371459 ] Sverre Bakke commented on HDFS-7941: Ok, I just tested this will BLOCK compression,

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371473#comment-14371473 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2088 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371476#comment-14371476 ] Hudson commented on HDFS-7816: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2088 (See

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371452#comment-14371452 ] Hudson commented on HDFS-7962: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371457#comment-14371457 ] Hudson commented on HDFS-7932: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371454#comment-14371454 ] Hudson commented on HDFS-7930: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371455#comment-14371455 ] Hudson commented on HDFS-7816: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #138 (See

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371478#comment-14371478 ] Hudson commented on HDFS-7932: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2088 (See

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371475#comment-14371475 ] Hudson commented on HDFS-7930: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2088 (See

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372517#comment-14372517 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372485#comment-14372485 ] Colin Patrick McCabe commented on HDFS-7960: ok, this version adds a good unit

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372487#comment-14372487 ] Hadoop QA commented on HDFS-7960: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372508#comment-14372508 ] Colin Patrick McCabe commented on HDFS-6658: Daryn, I apologize for not being

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.006.patch rebase on trunk The full block report should prune

[jira] [Commented] (HDFS-6353) Handle checkpoint failure more gracefully

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372484#comment-14372484 ] Hadoop QA commented on HDFS-6353: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Open (was: Patch Available) The full block report should prune zombie

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Patch Available (was: Open) The full block report should prune zombie

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: (was: HDFS-7960.004.patch) The full block report should prune zombie

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.005.patch The full block report should prune zombie storages

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372493#comment-14372493 ] Hadoop QA commented on HDFS-7713: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.004.patch The full block report should prune zombie storages

[jira] [Resolved] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-7847. Resolution: Fixed Fix Version/s: HDFS-7836 Committed to HDFS-7836 branch. Modify

[jira] [Commented] (HDFS-7962) Remove duplicated logs in BlockManager

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371193#comment-14371193 ] Hudson commented on HDFS-7962: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #872 (See

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371196#comment-14371196 ] Hudson commented on HDFS-7816: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #872 (See

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371195#comment-14371195 ] Hudson commented on HDFS-7930: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #872 (See

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371198#comment-14371198 ] Hudson commented on HDFS-7932: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #872 (See

[jira] [Commented] (HDFS-6353) Handle checkpoint failure more gracefully

2015-03-20 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372090#comment-14372090 ] Jitendra Nath Pandey commented on HDFS-6353: +1, the patch looks good to me.

[jira] [Commented] (HDFS-6353) Handle checkpoint failure more gracefully

2015-03-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372108#comment-14372108 ] Hadoop QA commented on HDFS-6353: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-03-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7839: Description: As a quick first step to facilitate initial development and testing, HDFS-7347 added EC

  1   2   >