[jira] [Commented] (HDFS-11172) Support an erasure coding policy using RS 10 + 4

2016-12-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724734#comment-15724734 ] Kai Zheng commented on HDFS-11172: -- It's good to support an RS(10, 4) policy, as it's widely used in the

[jira] [Updated] (HDFS-11172) Support an erasure coding policy using RS 10 + 4

2016-12-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11172: - Summary: Support an erasure coding policy using RS 10 + 4 (was: Support an erasure coding policy

[jira] [Created] (HDFS-11212) FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations

2016-12-05 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-11212: Summary: FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations Key: HDFS-11212 URL:

[jira] [Created] (HDFS-11213) FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations

2016-12-05 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-11213: Summary: FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations Key: HDFS-11213 URL:

[jira] [Commented] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-05 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724676#comment-15724676 ] Akira Ajisaka commented on HDFS-11211: -- "duration(ns): %s" seems fine. > Add a time unit to the

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724671#comment-15724671 ] Hudson commented on HDFS-11156: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10946 (See

[jira] [Updated] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-05 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11211: - Labels: newbie supportability (was: supportability) > Add a time unit to the DataNode client

[jira] [Created] (HDFS-11211) Add a time unit to the DataNode client trace format

2016-12-05 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HDFS-11211: Summary: Add a time unit to the DataNode client trace format Key: HDFS-11211 URL: https://issues.apache.org/jira/browse/HDFS-11211 Project: Hadoop HDFS

[jira] [Work started] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11156 started by Weiwei Yang. -- > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724654#comment-15724654 ] Weiwei Yang commented on HDFS-11156: Sure, thanks a lot. > Add new op GETFILEBLOCKLOCATIONS to

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724650#comment-15724650 ] Mingliang Liu commented on HDFS-11156: -- Sorry I missed the point of not changing the

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11156: --- Fix Version/s: (was: 3.0.0-alpha2) (was: 2.8.0) > Add new op

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2016-12-05 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724651#comment-15724651 ] Kai Jiang commented on HDFS-10685: -- Thanks! I am still interested in this one. I will open a Pull Request

[jira] [Reopened] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-11156: > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724646#comment-15724646 ] Andrew Wang commented on HDFS-11156: Great, thanks [~cheersyang]. I'm going to revert this in the

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724634#comment-15724634 ] Weiwei Yang commented on HDFS-11156: Hi [~andrew.wang] You are right. I missed that. Thanks! A

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724599#comment-15724599 ] Xiao Chen edited comment on HDFS-10899 at 12/6/16 6:39 AM: --- Oops, was fixing

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: (was: HDFS-10899.01.patch) > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.01.patch Oops, was fixing some last-minute checkstyle which turns out failed

[jira] [Created] (HDFS-11210) Enhance key rolling to be atomic

2016-12-05 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-11210: Summary: Enhance key rolling to be atomic Key: HDFS-11210 URL: https://issues.apache.org/jira/browse/HDFS-11210 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724552#comment-15724552 ] Andrew Wang commented on HDFS-11156: Hi [~cheersyang] I think you misunderstand: the new version of

[jira] [Commented] (HDFS-11198) NN UI should link DN web address using hostnames

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724486#comment-15724486 ] Hadoop QA commented on HDFS-11198: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11198) NN UI should link DN web address using hostnames

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11198: --- Attachment: HDFS-11198.02.patch Upload the patch again to trigger the jenkins job, v2 file is just a

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724475#comment-15724475 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724468#comment-15724468 ] Weiwei Yang edited comment on HDFS-11156 at 12/6/16 6:00 AM: - Hi

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724468#comment-15724468 ] Weiwei Yang commented on HDFS-11156: Hi [~andrew.wang] In that case client can still call

[jira] [Updated] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11207: --- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Priority: Critical

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724456#comment-15724456 ] Hadoop QA commented on HDFS-10899: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724450#comment-15724450 ] Andrew Wang commented on HDFS-10899: I think that will work, but do we also need a drain command for

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1572#comment-1572 ] Andrew Wang commented on HDFS-11156: To expand on my previous comment, the new client will try to call

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724397#comment-15724397 ] ASF GitHub Bot commented on HDFS-10930: --- GitHub user xiaoyuyao opened a pull request:

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724398#comment-15724398 ] Xiao Chen commented on HDFS-10899: -- Good question. My intention was that after a {{hadoop key roll}}

[jira] [Commented] (HDFS-11172) Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724296#comment-15724296 ] Hadoop QA commented on HDFS-11172: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11115) Remove bytes2Array and string2Bytes

2016-12-05 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724288#comment-15724288 ] Akira Ajisaka commented on HDFS-5: -- I doubt that using String "UTF-8" is a optimization. I did a

[jira] [Commented] (HDFS-11164) Mover should avoid unnecessary retries if the block is pinned

2016-12-05 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724275#comment-15724275 ] Uma Maheswara Rao G commented on HDFS-11164: [~rakeshr] Overall patch looks good to me. +1

[jira] [Commented] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724247#comment-15724247 ] Weiwei Yang commented on HDFS-10581: Thanks [~djp], that makes sense to me. > Hide redundant table on

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.10.patch I've tested it locally and the try with resource finally solve the

[jira] [Commented] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724206#comment-15724206 ] Junping Du commented on HDFS-10581: --- The latest patch indeed becomes a trivial fix which looks good to

[jira] [Updated] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10581: -- Priority: Trivial (was: Major) > Hide redundant table on NameNode WebUI when no nodes are

[jira] [Commented] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724130#comment-15724130 ] Hudson commented on HDFS-10581: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10944 (See

[jira] [Commented] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724108#comment-15724108 ] Weiwei Yang commented on HDFS-10581: My pleasure, thank you [~andrew.wang] :). > Hide redundant table

[jira] [Commented] (HDFS-11195) When appending files by webhdfs rest api fails, it returns 200

2016-12-05 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724096#comment-15724096 ] Yuanbo Liu commented on HDFS-11195: --- I have reproduced this issue in trunk branch, but still doesn't

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724091#comment-15724091 ] Weiwei Yang commented on HDFS-11156: Hello [~andrew.wang] Thank you for raising up your concern. I

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-12-05 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724086#comment-15724086 ] Wei Zhou commented on HDFS-10885: - The test case failures are unrelated to this patch. Thanks! > [SPS]:

[jira] [Updated] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10581: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Updated] (HDFS-10581) Hide redundant table on NameNode WebUI when no nodes are decomissioning

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10581: --- Summary: Hide redundant table on NameNode WebUI when no nodes are decomissioning (was: Hide

[jira] [Updated] (HDFS-10581) Hide redundant table on dfshealth WebUI when no nodes are decomissioning

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10581: --- Summary: Hide redundant table on dfshealth WebUI when no nodes are decomissioning (was: Redundant

[jira] [Commented] (HDFS-10581) Redundant table on Datanodes page when no nodes under decomissioning

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724051#comment-15724051 ] Hadoop QA commented on HDFS-10581: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11209: --- Affects Version/s: 2.8.0 3.0.0-alpha1 Target Version/s: 2.8.0,

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724041#comment-15724041 ] Andrew Wang commented on HDFS-10899: I just looking at HADOOP-13827, and noticed that it also tries to

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-12-05 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724038#comment-15724038 ] Yuanbo Liu commented on HDFS-11150: --- [~rakeshr] Thanks a lot for your comment. > [SPS]: Provide

[jira] [Comment Edited] (HDFS-10581) Redundant table on Datanodes page when no nodes under decomissioning

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724026#comment-15724026 ] Weiwei Yang edited comment on HDFS-10581 at 12/6/16 2:01 AM: - According to

[jira] [Updated] (HDFS-10581) Redundant table on Datanodes page when no nodes under decomissioning

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10581: --- Attachment: HDFS-10581.03.patch According to [~andrew.wang]'s comment, retain the header and displays

[jira] [Updated] (HDFS-11172) Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS

2016-12-05 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-11172: Attachment: HDFS-11172-v2.patch Thanks [~andrew.wang] for reviewing! The patch is updated and other

[jira] [Commented] (HDFS-10581) Redundant table on Datanodes page when no nodes under decomissioning

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723989#comment-15723989 ] Andrew Wang commented on HDFS-10581: Seems like a nice change, thanks for working on this Weiwei Yang!

[jira] [Commented] (HDFS-8411) Add bytes count metrics to datanode for ECWorker

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723974#comment-15723974 ] Andrew Wang commented on HDFS-8411: --- Thanks for working on this Sammi and Rakesh for reviewing, I had a

[jira] [Updated] (HDFS-11191) In the command “hdfs dfsadmin -report” The Configured Capacity is misleading if the dfs.datanode.data.dir is configured with two directories from the same file system.

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11191: --- Status: Open (was: Patch Available) > In the command “hdfs dfsadmin -report” The Configured Capacity

[jira] [Updated] (HDFS-11198) NN UI should link DN web address using hostnames

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11198: --- Status: Open (was: Patch Available) > NN UI should link DN web address using hostnames >

[jira] [Updated] (HDFS-11198) NN UI should link DN web address using hostnames

2016-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11198: --- Status: Patch Available (was: Open) > NN UI should link DN web address using hostnames >

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723956#comment-15723956 ] Junping Du commented on HDFS-10684: --- Thanks for comments, Andrew. [~jzhuge], do we make any progress so

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10684: --- Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) > WebHDFS DataNode calls fail without parameter

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723942#comment-15723942 ] Andrew Wang commented on HDFS-10684: I think this is still a blocker, it was found via downstream

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723936#comment-15723936 ] Andrew Wang commented on HDFS-11156: Sorry I didn't get a chance to review this earlier, but I have a

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723932#comment-15723932 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11172) Support an erasure coding policy RS-DEFAULT-10-4-64k in HDFS

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723904#comment-15723904 ] Andrew Wang commented on HDFS-11172: Thanks for working on this Wei Zhou, looks good overall.

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723896#comment-15723896 ] Andrew Wang commented on HDFS-11072: Hi Sammi, thanks for working on this. Some review comments in

[jira] [Commented] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723897#comment-15723897 ] Hadoop QA commented on HDFS-11201: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723837#comment-15723837 ] Junping Du commented on HDFS-10684: --- Hi, this doesn't sounds like a blocker for our 2.8 release. Can

[jira] [Commented] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723804#comment-15723804 ] Andrew Wang commented on HDFS-8630: --- A couple tiny nits: * We need to update WebHDFS's Get All Storage

[jira] [Created] (HDFS-11209) SNN can't checkpoint when rolling upgrade is not finalized

2016-12-05 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-11209: - Summary: SNN can't checkpoint when rolling upgrade is not finalized Key: HDFS-11209 URL: https://issues.apache.org/jira/browse/HDFS-11209 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11205) Fix findbugs issue with BlockPoolSlice#validateIntegrityAndSetLength

2016-12-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-11205. --- Resolution: Not A Problem Will track the fix along with the recommit of HDFS-10930, which will fix

[jira] [Updated] (HDFS-11205) Fix findbugs issue with BlockPoolSlice#validateIntegrityAndSetLength

2016-12-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11205: -- Status: Open (was: Patch Available) > Fix findbugs issue with

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723760#comment-15723760 ] Andrew Wang commented on HDFS-11188: To further elaborate, I haven't done any rolling upgrade testing

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.09.patch Change to use {{IOUtils.cleanup}} {code} IOUtils.cleanup(null,

[jira] [Commented] (HDFS-11188) Change min supported DN and NN versions back to 2.x

2016-12-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723754#comment-15723754 ] Andrew Wang commented on HDFS-11188: Hi Yongjun, this is just setting the min software version back to

[jira] [Updated] (HDFS-11208) Deadlock in WebHDFS on shutdown

2016-12-05 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11208: --- Attachment: HDFS-11208-test-deadlock.patch I am attaching a patch containing a unit test which

[jira] [Commented] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723664#comment-15723664 ] Hadoop QA commented on HDFS-11207: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-11208) Deadlock in WebHDFS on shutdown

2016-12-05 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-11208: -- Summary: Deadlock in WebHDFS on shutdown Key: HDFS-11208 URL: https://issues.apache.org/jira/browse/HDFS-11208 Project: Hadoop HDFS Issue Type: Bug

[jira] [Comment Edited] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723622#comment-15723622 ] Eric Badger edited comment on HDFS-11207 at 12/5/16 10:54 PM: -- It looks like

[jira] [Commented] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723622#comment-15723622 ] Eric Badger commented on HDFS-11207: It looks like {{HAServiceState}} is used in more places than just

[jira] [Updated] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-11207: --- Status: Open (was: Patch Available) > Unnecessary incompatible change of NNHAStatusHeartbeat.state

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723611#comment-15723611 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

2016-12-05 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Sohn updated HDFS-11201: -- Attachment: HDFS-11201.3.patch Had to rebase. Corrected diff. > Spelling errors in the logging, help,

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723593#comment-15723593 ] Hadoop QA commented on HDFS-8344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-12-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723567#comment-15723567 ] Ravi Prakash commented on HDFS-8344: Hi Wei-Chiu Chuang! FWIW, we have not seen this bug specifically

[jira] [Comment Edited] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-12-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723538#comment-15723538 ] Wei-Chiu Chuang edited comment on HDFS-8344 at 12/5/16 10:23 PM: - I believe

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

2016-12-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723538#comment-15723538 ] Wei-Chiu Chuang commented on HDFS-8344: --- I believe I saw a variant of this bug. Symptom: HBase WAL

[jira] [Commented] (HDFS-9562) libhdfs++ RpcConnectionImpl::Connect should acquire connection state lock

2016-12-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723532#comment-15723532 ] James Clampffer commented on HDFS-9562: --- Underlying fix for this is easy, but it breaks a ton of

[jira] [Updated] (HDFS-9562) libhdfs++ RpcConnectionImpl::Connect should acquire connection state lock

2016-12-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9562: -- Assignee: (was: James Clampffer) > libhdfs++ RpcConnectionImpl::Connect should acquire

[jira] [Updated] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-11207: --- Status: Patch Available (was: Open) > Unnecessary incompatible change of NNHAStatusHeartbeat.state

[jira] [Updated] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-11207: --- Attachment: HDFS-11207.001.patch Attaching a patch that adds a new field to the enum, but won't

[jira] [Created] (HDFS-11207) Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos

2016-12-05 Thread Eric Badger (JIRA)
Eric Badger created HDFS-11207: -- Summary: Unnecessary incompatible change of NNHAStatusHeartbeat.state in DatanodeProtocolProtos Key: HDFS-11207 URL: https://issues.apache.org/jira/browse/HDFS-11207

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2016-12-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723485#comment-15723485 ] James Clampffer commented on HDFS-10685: Looks like Jira got locked down again so I can't assign

[jira] [Commented] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723478#comment-15723478 ] Hadoop QA commented on HDFS-11201: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11205) Fix findbugs issue with BlockPoolSlice#validateIntegrityAndSetLength

2016-12-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723474#comment-15723474 ] Hadoop QA commented on HDFS-11205: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2016-12-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723471#comment-15723471 ] James Clampffer commented on HDFS-10685: Hey [~vectorijk], sorry I didn't see this for so long.

[jira] [Commented] (HDFS-11197) Listing encryption zones fails when deleting a EZ that is on a snapshotted directory

2016-12-05 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723414#comment-15723414 ] Wellington Chevreuil commented on HDFS-11197: - Hi [~jojochuang]. Thanks for the comments.

[jira] [Created] (HDFS-11206) libhdfs++: FileSystem doesn't handle directory paths with a trailing "/"

2016-12-05 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11206: -- Summary: libhdfs++: FileSystem doesn't handle directory paths with a trailing "/" Key: HDFS-11206 URL: https://issues.apache.org/jira/browse/HDFS-11206 Project:

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.08.patch Revert and reattach a new patch to correct the typo in commit message

[jira] [Comment Edited] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723377#comment-15723377 ] Xiaoyu Yao edited comment on HDFS-10930 at 12/5/16 9:09 PM: Revert and

  1   2   >