[jira] [Updated] (HDFS-7788) Post-2.6 namenode may not start up with an image containing inodes created with an old release.

2015-02-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7788: - Summary: Post-2.6 namenode may not start up with an image containing inodes created with an old release.

[jira] [Updated] (HDFS-3689) Add support for variable length block

2015-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Fix Version/s: 2.7.0 Add support for variable length block -

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

2015-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318751#comment-14318751 ] Brahma Reddy Battula commented on HDFS-7711: Hi [~wheat9] Thanks for taking

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-02-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318856#comment-14318856 ] Allen Wittenauer commented on HDFS-5796: The irony is that our handler is using the

[jira] [Commented] (HDFS-7788) Post-2.6 namenode may not start up with an image containing inodes created with an old release.

2015-02-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318668#comment-14318668 ] Kihwal Lee commented on HDFS-7788: -- One option is to make namenode automatically convert

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7584: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7790: --- Priority: Minor (was: Major) Do not create optional fields in DFSInputStream unless

[jira] [Updated] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7790: --- Status: Patch Available (was: Open) Do not create optional fields in DFSInputStream

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318785#comment-14318785 ] Hudson commented on HDFS-7584: -- FAILURE: Integrated in Hadoop-trunk-Commit #7092 (See

[jira] [Created] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-12 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7790: -- Summary: Do not create optional fields in DFSInputStream unless they are needed Key: HDFS-7790 URL: https://issues.apache.org/jira/browse/HDFS-7790

[jira] [Updated] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7790: --- Attachment: HDFS-7790.001.patch Do not create optional fields in DFSInputStream

[jira] [Updated] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7322: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the review!

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318742#comment-14318742 ] Hudson commented on HDFS-7694: -- FAILURE: Integrated in Hadoop-trunk-Commit #7091 (See

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7723: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Description: This JIRA updates NameNode to handle background / offline recovery of erasure coded blocks. It

[jira] [Commented] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318887#comment-14318887 ] Hudson commented on HDFS-7322: -- FAILURE: Integrated in Hadoop-trunk-Commit #7093 (See

[jira] [Commented] (HDFS-7788) Post 2.6 namenode may not start up with an image containing inodes created with an old release.

2015-02-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318655#comment-14318655 ] Kihwal Lee commented on HDFS-7788: -- The stack trace: {panel} 2015-02-09 19:02:28,361

[jira] [Commented] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

2015-02-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318709#comment-14318709 ] Haohui Mai commented on HDFS-7711: -- +1. I'll commit shortly. [ HDFS DOC ] Various Typos

[jira] [Commented] (HDFS-3689) Add support for variable length block

2015-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318705#comment-14318705 ] Jing Zhao commented on HDFS-3689: - I've merged this to branch-2. Add support for variable

[jira] [Commented] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

2015-02-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318721#comment-14318721 ] Haohui Mai commented on HDFS-7711: -- The patch no longer apply due to HADOOP-11495. Can you

[jira] [Commented] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318820#comment-14318820 ] Hadoop QA commented on HDFS-7711: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318847#comment-14318847 ] Arun Suresh commented on HDFS-5796: --- [~aw], Yup, you are correct.. HDFS-5716 does work

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318793#comment-14318793 ] Tsz Wo Nicholas Sze commented on HDFS-7769: --- The rule has been always clear for

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318782#comment-14318782 ] Akira AJISAKA commented on HDFS-7684: - Looking around the code, I'm thinking it would

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7584: - Release Note: 1. Introduced quota by storage type as a hard limit on the amount of space usage allowed

[jira] [Updated] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: HDFS-7396-000.patch A very simple patch for step 1 in the JIRA description. Ultimately we want

[jira] [Created] (HDFS-7788) Post 2.6 namenode may not start up with an image containing inodes created with an old release.

2015-02-12 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7788: Summary: Post 2.6 namenode may not start up with an image containing inodes created with an old release. Key: HDFS-7788 URL: https://issues.apache.org/jira/browse/HDFS-7788

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318660#comment-14318660 ] Zhe Zhang commented on HDFS-7729: - Thanks Bo for the quick rev! The overall structure looks

[jira] [Created] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

2015-02-12 Thread Gera Shegalov (JIRA)
Gera Shegalov created HDFS-7789: --- Summary: DFsck should resolve the path to support cross-FS symlinks Key: HDFS-7789 URL: https://issues.apache.org/jira/browse/HDFS-7789 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7787) Wrong priorty of replication

2015-02-12 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318723#comment-14318723 ] Ravi Prakash commented on HDFS-7787: Frode! The code for prioritizing under-replicated

[jira] [Updated] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

2015-02-12 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HDFS-7789: Status: Patch Available (was: Open) DFsck should resolve the path to support cross-FS symlinks

[jira] [Updated] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

2015-02-12 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HDFS-7789: Attachment: HDFS-7789.001.patch v1 for review. DFsck should resolve the path to support cross-FS

[jira] [Updated] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

2015-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7711: --- Attachment: HDFS-7711-002.patch [ HDFS DOC ] Various Typos in ClusterSetup.html and

[jira] [Updated] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-12 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7713: --- Attachment: HDFS-7713.03.patch You're right Haohui! Specifically for mkdir , bootstrap-editable wasn't

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318866#comment-14318866 ] Arun Suresh commented on HDFS-5796: --- bq. The irony is that our handler is using the

[jira] [Updated] (HDFS-7322) deprecate sbin/hadoop-daemon.sh

2015-02-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7322: --- Summary: deprecate sbin/hadoop-daemon.sh (was: deprecate sbin/*.sh) deprecate

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-02-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318883#comment-14318883 ] Arun Suresh commented on HDFS-5796: --- apologize for the spam.. thought you meant doesn't

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318882#comment-14318882 ] Chris Nauroth commented on HDFS-7684: - Trimming in {{NetUtils}} might be a valuable

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318905#comment-14318905 ] Akira AJISAKA commented on HDFS-7684: - bq. I also think trimming when getting out of

[jira] [Commented] (HDFS-7787) Wrong priorty of replication

2015-02-12 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318737#comment-14318737 ] Ravi Prakash commented on HDFS-7787: By the way, here are guidelines for contributing:

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318794#comment-14318794 ] Xiaoyu Yao commented on HDFS-7584: -- Thanks all for the review and feedbacks. I will update

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

2015-02-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318795#comment-14318795 ] Xiaoyu Yao commented on HDFS-7584: -- Thanks all for the review and feedbacks. I will update

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318804#comment-14318804 ] Akira AJISAKA commented on HDFS-7684: - I think if the parameters were trimmed in

[jira] [Commented] (HDFS-7760) Document truncate for WebHDFS.

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318077#comment-14318077 ] Hudson commented on HDFS-7760: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318061#comment-14318061 ] Hudson commented on HDFS-316: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7736) Fix typos in dfsadmin/fsck/snapshotDiff usage messages

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318064#comment-14318064 ] Hudson commented on HDFS-7736: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318080#comment-14318080 ] Hudson commented on HDFS-7761: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318063#comment-14318063 ] Hudson commented on HDFS-7771: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318081#comment-14318081 ] Hudson commented on HDFS-7703: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318078#comment-14318078 ] Hudson commented on HDFS-7720: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318057#comment-14318057 ] Hudson commented on HDFS-6133: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1431#comment-1431 ] Hadoop QA commented on HDFS-7694: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-02-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5356: --- Attachment: HDFS-5356-1.patch MiniDFSCluster shoud close all open FileSystems when shutdown()

[jira] [Commented] (HDFS-7664) Reed-Solomon ErasureCoder

2015-02-12 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317890#comment-14317890 ] Kai Zheng commented on HDFS-7664: - The attached patch implements and relies on the

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317795#comment-14317795 ] Hudson commented on HDFS-7703: -- FAILURE: Integrated in Hadoop-trunk-Commit #7084 (See

[jira] [Commented] (HDFS-7774) Unresolved symbols error while compiling HDFS on Windows 7/32 bit

2015-02-12 Thread Kiran Kumar M R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317798#comment-14317798 ] Kiran Kumar M R commented on HDFS-7774: --- Following changes are required to make

[jira] [Created] (HDFS-7786) Handle failures and slow writers for DFSOutputStream when there're multiple data streamers

2015-02-12 Thread Li Bo (JIRA)
Li Bo created HDFS-7786: --- Summary: Handle failures and slow writers for DFSOutputStream when there're multiple data streamers Key: HDFS-7786 URL: https://issues.apache.org/jira/browse/HDFS-7786 Project: Hadoop

[jira] [Commented] (HDFS-7785) Add detailed message for HttpPutFailedException

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318048#comment-14318048 ] Hadoop QA commented on HDFS-7785: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7774) Unresolved symbols error while compiling HDFS on Windows 7/32 bit

2015-02-12 Thread Venkatasubramaniam Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317958#comment-14317958 ] Venkatasubramaniam Ramakrishnan commented on HDFS-7774: --- There are

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318044#comment-14318044 ] Hadoop QA commented on HDFS-5356: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318075#comment-14318075 ] Hudson commented on HDFS-7723: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #102 (See

[jira] [Commented] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318982#comment-14318982 ] Colin Patrick McCabe commented on HDFS-7496: Good find, [~cnauroth]! Fix

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319042#comment-14319042 ] Anu Engineer commented on HDFS-7684: Addressed comments from [~cnauroth] and

[jira] [Commented] (HDFS-7764) DirectoryScanner should cancel the future tasks when #compileReport throws exception

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319069#comment-14319069 ] Colin Patrick McCabe commented on HDFS-7764: Can you explain why we would want

[jira] [Comment Edited] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319103#comment-14319103 ] Colin Patrick McCabe edited comment on HDFS-7083 at 2/12/15 10:12 PM:

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319100#comment-14319100 ] Haohui Mai commented on HDFS-7713: -- Looks like the indentation is off in many places. And

[jira] [Commented] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319103#comment-14319103 ] Colin Patrick McCabe commented on HDFS-7083: Ted, this is a duplicate of

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319074#comment-14319074 ] Hadoop QA commented on HDFS-7686: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319115#comment-14319115 ] Haohui Mai commented on HDFS-7784: -- I've done some experiments in HDFS-5698. Parallelism

[jira] [Commented] (HDFS-7784) load fsimage in parallel

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319097#comment-14319097 ] Colin Patrick McCabe commented on HDFS-7784: Hi Walter, this is an interesting

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318961#comment-14318961 ] Akira AJISAKA commented on HDFS-7684: - bq. Trimming in NetUtils might be a valuable

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Attachment: HDFS-7686.004.patch Re-add rapid rescan of possibly corrupt block feature

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319028#comment-14319028 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- [~cmccabe], I means these questions:

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319136#comment-14319136 ] Zhe Zhang commented on HDFS-7729: - Thanks [~jingzhao] and [~szetszwo] for the in-depth

[jira] [Comment Edited] (HDFS-7784) load fsimage in parallel

2015-02-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319115#comment-14319115 ] Haohui Mai edited comment on HDFS-7784 at 2/12/15 10:32 PM:

[jira] [Updated] (HDFS-7720) Quota by Storage Type API, tools and ClientNameNode Protocol changes

2015-02-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7720: Fix Version/s: (was: 3.0.0) 2.7.0 Quota by Storage Type API, tools and

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319034#comment-14319034 ] Jing Zhao commented on HDFS-7729: - My main concern is that whether we can/should now define

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319033#comment-14319033 ] Colin Patrick McCabe commented on HDFS-7648: bq. should the block report

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318940#comment-14318940 ] Chris Nauroth commented on HDFS-7609: - I tried testing an old client without call ID

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7723: - Affects Version/s: (was: 3.0.0) Quota By Storage Type namenode implemenation

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318978#comment-14318978 ] Colin Patrick McCabe commented on HDFS-6994: bq. As the existing native code in

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318996#comment-14318996 ] Colin Patrick McCabe commented on HDFS-7648: If there are a bunch of files in

[jira] [Updated] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7684: --- Attachment: HDFS-7684.004.patch The host:port settings of dfs.namenode.secondary.http-address should

[jira] [Commented] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319062#comment-14319062 ] Hadoop QA commented on HDFS-7790: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319063#comment-14319063 ] Colin Patrick McCabe commented on HDFS-7758: Thanks for taking this on, Eddy.

[jira] [Updated] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7684: Target Version/s: 2.7.0 Hadoop Flags: Reviewed +1 for patch v004, pending Jenkins run.

[jira] [Resolved] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7083. Resolution: Duplicate TestDecommission#testIncludeByRegistrationName sometimes

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319015#comment-14319015 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~szetszwo], since you

[jira] [Updated] (HDFS-7773) Additional metrics in HDFS to be accessed via jmx.

2015-02-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7773: Summary: Additional metrics in HDFS to be accessed via jmx. (was: Improved HDFS dashboard)

[jira] [Commented] (HDFS-7789) DFsck should resolve the path to support cross-FS symlinks

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319119#comment-14319119 ] Hadoop QA commented on HDFS-7789: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-12 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7713: --- Attachment: HDFS-7713.04.patch Thanks for the suggestion Haohui! Here's a patch where I've tried to

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319377#comment-14319377 ] Hadoop QA commented on HDFS-7684: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7684) The host:port settings of dfs.namenode.secondary.http-address should be trimmed before use

2015-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319386#comment-14319386 ] Akira AJISAKA commented on HDFS-7684: - +1. Thanks [~anu] for the contribution, and

[jira] [Commented] (HDFS-1148) Convert FSDataset to ReadWriteLock

2015-02-12 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319397#comment-14319397 ] Yong Zhang commented on HDFS-1148: -- Hi everyone, what is the status for this improvement?

[jira] [Updated] (HDFS-7684) The host:port settings of the daemons should be trimmed before use

2015-02-12 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7684: Component/s: (was: namenode) Issue Type: Improvement (was: Bug) Summary: The

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319443#comment-14319443 ] Masatake Iwasaki commented on HDFS-7668: You can see the built doc at

[jira] [Commented] (HDFS-7711) Fix various typos in ClusterSetup.md

2015-02-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319415#comment-14319415 ] Brahma Reddy Battula commented on HDFS-7711: Thanks [~wheat9] !! Fix various

[jira] [Updated] (HDFS-7790) Do not create optional fields in DFSInputStream unless they are needed

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7790: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

  1   2   3   >