[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645568#comment-14645568 ] Hudson commented on HDFS-6482: -- FAILURE: Integrated in Hadoop-trunk-Commit #8236 (See [https:

[jira] [Commented] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645569#comment-14645569 ] Hudson commented on HDFS-8834: -- FAILURE: Integrated in Hadoop-trunk-Commit #8236 (See [https:

[jira] [Updated] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8834: Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status: Resolved (w

[jira] [Commented] (HDFS-7351) Document the HDFS Erasure Coding feature

2015-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645549#comment-14645549 ] Vinayakumar B commented on HDFS-7351: - Thanks [~zhz] for the review and update. Sure wi

[jira] [Commented] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645543#comment-14645543 ] Hadoop QA commented on HDFS-8834: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8811) Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645540#comment-14645540 ] Hudson commented on HDFS-8811: -- FAILURE: Integrated in Hadoop-trunk-Commit #8235 (See [https:

[jira] [Commented] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645541#comment-14645541 ] Hudson commented on HDFS-8822: -- FAILURE: Integrated in Hadoop-trunk-Commit #8235 (See [https:

[jira] [Updated] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

2015-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8822: Hadoop Flags: Reviewed > Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies >

[jira] [Updated] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

2015-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8822: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Tha

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-07-28 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645522#comment-14645522 ] Jagadesh Kiran N commented on HDFS-8622: Hi the test case failure "org.apache.hado

[jira] [Commented] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645524#comment-14645524 ] Hadoop QA commented on HDFS-8581: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8811) Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java

2015-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8811: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-7351) Document the HDFS Erasure Coding feature

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645519#comment-14645519 ] Zhe Zhang commented on HDFS-7351: - Thanks [~vinayrpet] and [~umamaheswararao] for the great

[jira] [Resolved] (HDFS-8768) Erasure Coding: block group ID displayed in WebUI is not consistent with fsck

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8768. - Resolution: Duplicate > Erasure Coding: block group ID displayed in WebUI is not consistent with fsck > ---

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645511#comment-14645511 ] Zhe Zhang commented on HDFS-8480: - [~mingma] Thanks for the good catch! Yes this is indeed

[jira] [Commented] (HDFS-8815) DFS getStoragePolicy implementation using single RPC call

2015-07-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645506#comment-14645506 ] Vinayakumar B commented on HDFS-8815: - Hi [~surendrasingh], thanks for taking this up.

[jira] [Commented] (HDFS-8811) Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java

2015-07-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645484#comment-14645484 ] Yi Liu commented on HDFS-8811: -- Thanks Vinay for working on this. I agree all the constants o

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8830.03.patch Fix the checkstyle issue. > Support add/remove directories to an existing e

[jira] [Commented] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

2015-07-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645475#comment-14645475 ] Yi Liu commented on HDFS-8822: -- +1, Thanks Vinay. > Add SSD storagepolicy tests in TestBlock

[jira] [Commented] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645453#comment-14645453 ] Hadoop QA commented on HDFS-8816: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8820) Enable RPC Congestion control by default

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645445#comment-14645445 ] Hadoop QA commented on HDFS-8820: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645438#comment-14645438 ] Hudson commented on HDFS-8180: -- FAILURE: Integrated in Hadoop-trunk-Commit #8234 (See [https:

[jira] [Updated] (HDFS-8670) Better to exclude decommissioned nodes for namenode NodeUsage JMX

2015-07-28 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8670: - Attachment: HDFS-8670.5.patch Thanks [~vinayrpet] for the review comments. I have updated the patch .Sorry

[jira] [Updated] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8180: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (wa

[jira] [Commented] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645417#comment-14645417 ] Jakob Homan commented on HDFS-8180: --- +1 > AbstractFileSystem Implementation for WebHdfs

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

2015-07-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645399#comment-14645399 ] Ming Ma commented on HDFS-8480: --- Thanks [~zhz]. The test code simulates older version edit b

[jira] [Commented] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645391#comment-14645391 ] Yi Liu commented on HDFS-8834: -- +1, pending Jenkins, thanks Lei. > TestReplication#testReplic

[jira] [Commented] (HDFS-8820) Enable RPC Congestion control by default

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645388#comment-14645388 ] Hadoop QA commented on HDFS-8820: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-07-28 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287-HDFS-7285.00.patch > DFSStripedOutputStream.writeChunk should not wait for writing pa

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-07-28 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Status: Patch Available (was: Open) > DFSStripedOutputStream.writeChunk should not wait for writing parity

[jira] [Commented] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645337#comment-14645337 ] Hadoop QA commented on HDFS-8830: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645332#comment-14645332 ] Zhe Zhang commented on HDFS-8499: - [~szetszwo] Sure, thanks for offering to do that. The on

[jira] [Updated] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

2015-07-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8816: - Attachment: HDFS-8816.004.patch > Improve visualization for the Datanode tab in the NN UI > ---

[jira] [Comment Edited] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

2015-07-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645300#comment-14645300 ] Haohui Mai edited comment on HDFS-8816 at 7/29/15 12:55 AM: bq.

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-07-28 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645305#comment-14645305 ] He Tianyi commented on HDFS-8829: - This affects pipeline throughput, and I've observed a 30

[jira] [Commented] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

2015-07-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645300#comment-14645300 ] Haohui Mai commented on HDFS-8816: -- bq. Could you please also address? I tested with Chro

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645296#comment-14645296 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- Thanks for trying. Please revert th

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-07-28 Thread li zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645292#comment-14645292 ] li zhang commented on HDFS-6994: Hi Zhanwei Wang I see that Hadoop 2.4.1 provided centr

[jira] [Resolved] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8499. - Resolution: Fixed Hadoop Flags: Reviewed [~andrew.wang] tried reverting the patch and found some conf

[jira] [Created] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

2015-07-28 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8835: --- Summary: Convert BlockInfoUnderConstruction as an interface Key: HDFS-8835 URL: https://issues.apache.org/jira/browse/HDFS-8835 Project: Hadoop HDFS Issue Type: Improv

[jira] [Commented] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645270#comment-14645270 ] Zhe Zhang commented on HDFS-8202: - Thanks Xinwei for updating the patch. The patch LGTM exc

[jira] [Updated] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8834: Attachment: HDFS-8834.00.patch Use {{Files#walkFileTree}} to collect block files and add asserts to m

[jira] [Updated] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8834: Status: Patch Available (was: Open) > TestReplication#testReplicationWhenBlockCorruption is not vali

[jira] [Updated] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8834: Description: {{TestReplication#testReplicationWhenBlockCorruption}} assumes DN has one level of dire

[jira] [Created] (HDFS-8834) TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482

2015-07-28 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-8834: --- Summary: TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482 Key: HDFS-8834 URL: https://issues.apache.org/jira/browse/HDFS-8834 Project: Ha

[jira] [Commented] (HDFS-3743) QJM: improve formatting behavior for JNs

2015-07-28 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645247#comment-14645247 ] Jian Fang commented on HDFS-3743: - I was working on other things and now come back to this

[jira] [Updated] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

2015-07-28 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8816: --- Attachment: HDFS-8816.png Thanks for the work Haohui! The indentation is indeed fixed now. However I se

[jira] [Updated] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-07-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7858: -- Description: In an HA deployment, Clients are configured with the hostnames of both the Active and Stand

[jira] [Updated] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-07-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7858: -- Description: In an HA deployment, Clients are configured with the hostnames of both the Active and Stand

[jira] [Updated] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-07-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7858: -- Description: In an HA deployment, Clients are configured with the hostnames of both the Active and Stand

[jira] [Resolved] (HDFS-8728) Erasure coding: revisit and simplify BlockInfoStriped and INodeFile

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8728. - Resolution: Later Since HDFS-8499 is reopened, closing this one. We should revisit it after finalizing the

[jira] [Updated] (HDFS-8796) Erasure coding: merge HDFS-8499 to EC branch and refactor BlockInfoStriped

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8796: Parent Issue: HDFS-8031 (was: HDFS-7285) > Erasure coding: merge HDFS-8499 to EC branch and refactor BlockIn

[jira] [Commented] (HDFS-8059) Erasure coding: revisit how to store EC schema and cellSize in NameNode

2015-07-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645178#comment-14645178 ] Zhe Zhang commented on HDFS-8059: - I created HDFS-8833 to make the change [~andrew.wang] su

[jira] [Created] (HDFS-8833) Erasure coding: store EC schema and cell size with INodeFile and eliminate EC zones

2015-07-28 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8833: --- Summary: Erasure coding: store EC schema and cell size with INodeFile and eliminate EC zones Key: HDFS-8833 URL: https://issues.apache.org/jira/browse/HDFS-8833 Project: Hadoop

[jira] [Commented] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645143#comment-14645143 ] Hadoop QA commented on HDFS-8180: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8820) Enable RPC Congestion control by default

2015-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8820: Attachment: HDFS-8820.02.patch v02 patch updates test cases to add cleanup. > Enable RPC Congestion

[jira] [Comment Edited] (HDFS-8820) Enable RPC Congestion control by default

2015-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645083#comment-14645083 ] Arpit Agarwal edited comment on HDFS-8820 at 7/28/15 9:36 PM: --

[jira] [Updated] (HDFS-8820) Enable RPC Congestion control by default

2015-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8820: Attachment: HDFS-8820.01.patch Add a new configuration key to simplify controlling RPC backoff for NN

[jira] [Updated] (HDFS-8820) Enable RPC Congestion control by default

2015-07-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8820: Status: Patch Available (was: Open) > Enable RPC Congestion control by default > ---

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-07-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Attachment: HDFS-8828.001.patch > Utilize Snapshot diff report to build copy list in distcp > -

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-07-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Component/s: snapshots distcp > Utilize Snapshot diff report to build copy list in distcp > --

[jira] [Created] (HDFS-8832) Document hdfs crypto cli changes

2015-07-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8832: Summary: Document hdfs crypto cli changes Key: HDFS-8832 URL: https://issues.apache.org/jira/browse/HDFS-8832 Project: Hadoop HDFS Issue Type: Sub-task R

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8830.02.patch Clean up unused code and some typos from v01. > Support add/remove director

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: (was: HDFS-8830.01.patch) > Support add/remove directories to an existing encryption zone >

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8830.01.patch > Support add/remove directories to an existing encryption zone > --

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: (was: HDFS-8747.01.patch) > Support add/remove directories to an existing encryption zone >

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8830.01.patch Rename the patch to match with the JIRA ID of the subtask. > Support add/re

[jira] [Created] (HDFS-8831) Support "Soft Delete" for files under HDFS encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8831: Summary: Support "Soft Delete" for files under HDFS encryption zone Key: HDFS-8831 URL: https://issues.apache.org/jira/browse/HDFS-8831 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-8747) Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encryption Zones

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8747: - Attachment: HDFS-8747-07282015.pdf > Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encr

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Status: Patch Available (was: Open) > Support add/remove directories to an existing encryption zone >

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8747.01.patch Attach an initial patch that 1) Allow directories to be added and removed

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2015-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644944#comment-14644944 ] Tsz Wo Nicholas Sze commented on HDFS-8818: --- I am going to make MAX_BLOCKS_SIZE_T

[jira] [Created] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-07-28 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8830: Summary: Support add/remove directories to an existing encryption zone Key: HDFS-8830 URL: https://issues.apache.org/jira/browse/HDFS-8830 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644935#comment-14644935 ] Tsz Wo Nicholas Sze commented on HDFS-3570: --- > ... It went on scheduling writes t

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2015-07-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644919#comment-14644919 ] Chang Li commented on HDFS-8818: Also right now Souce will fetch from namenode no more than

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2015-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644906#comment-14644906 ] Tsz Wo Nicholas Sze commented on HDFS-8818: --- Datanode store blocks in TB scale.

[jira] [Updated] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8180: -- Status: Patch Available (was: Open) > AbstractFileSystem Implementation for WebHdfs > --

[jira] [Updated] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8180: -- Status: Open (was: Patch Available) > AbstractFileSystem Implementation for WebHdfs > --

[jira] [Assigned] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-07-28 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8829: - Assignee: kanaka kumar avvaru > DataNode sets SO_RCVBUF explicitly is disabling tc

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

2015-07-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644896#comment-14644896 ] Haohui Mai commented on HDFS-8823: -- I should have word it more clear. The main motivation

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2015-07-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644888#comment-14644888 ] Chang Li commented on HDFS-8818: bq. Balancer waits until all block transfer are done each

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644870#comment-14644870 ] Allen Wittenauer commented on HDFS-3570: bq. We could get space used by calling df

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644844#comment-14644844 ] Hadoop QA commented on HDFS-8622: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Santhosh G Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh G Nayak reassigned HDFS-8180: -- Assignee: Santhosh G Nayak (was: Jakob Homan) > AbstractFileSystem Implementation for W

[jira] [Updated] (HDFS-8180) AbstractFileSystem Implementation for WebHdfs

2015-07-28 Thread Santhosh G Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh G Nayak updated HDFS-8180: --- Attachment: HDFS-8180-4.patch Thanks [~jghoman]. Uploading the patch version 4 with check style

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644814#comment-14644814 ] Colin Patrick McCabe commented on HDFS-3570: I agree that it would be nice to h

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-07-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644810#comment-14644810 ] Colin Patrick McCabe commented on HDFS-7240: [~jnp], [~sanjay.radia], did we co

[jira] [Updated] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

2015-07-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8695: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolve

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2015-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644790#comment-14644790 ] Tsz Wo Nicholas Sze commented on HDFS-8818: --- > now that dispatcher will keep fetc

[jira] [Updated] (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

2015-07-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-742: - Priority: Minor (was: Major) Hadoop Flags: Reviewed +1 patch looks good. > A down

[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

2015-07-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644745#comment-14644745 ] Anu Engineer commented on HDFS-8695: [~arpitagarwal] [~kanaka] Thanks for the reviews.

[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

2015-07-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644743#comment-14644743 ] Anu Engineer commented on HDFS-8695: bq. One comment - handleIOException looks out of

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

2015-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644727#comment-14644727 ] Andrew Wang commented on HDFS-8823: --- I think this work should happen on a branch if affec

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on "DFS Space Used %" as that ignores non-DFS used space

2015-07-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644720#comment-14644720 ] Allen Wittenauer commented on HDFS-3570: bq. Setting the parameter for non-dfs used

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2015-07-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644620#comment-14644620 ] Chang Li commented on HDFS-8818: [~szetszwo] thanks for the patch. One thing I am concerned

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644548#comment-14644548 ] Hudson commented on HDFS-8785: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2216 (See [htt

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644543#comment-14644543 ] Hudson commented on HDFS-7858: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2216 (See [htt

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644537#comment-14644537 ] Hudson commented on HDFS-8785: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #267 (See

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644532#comment-14644532 ] Hudson commented on HDFS-7858: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #267 (See

[jira] [Updated] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-07-28 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8622: --- Attachment: HDFS-8622-05.patch Hi [~ajisakaa] , i have updated the patch as per your comments ,

  1   2   >