[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2015-02-11 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6133: -- Release Note: Add a feature for replica pinning so that when a replica is pinned in a

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-11 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317206#comment-14317206 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- Again I would appreciate examples

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

2015-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317213#comment-14317213 ] Chris Nauroth commented on HDFS-7430: - I didin't review this patch at all, but how are

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317251#comment-14317251 ] Ted Yu commented on HDFS-6133: -- In DFSOutputStream.java: {code} 1452

[jira] [Commented] (HDFS-3689) Add support for variable length block

2015-02-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317248#comment-14317248 ] Suresh Srinivas commented on HDFS-3689: --- [~jingzhao], can you please add a release

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317265#comment-14317265 ] Yongjun Zhang commented on HDFS-6133: - Hi [~tedyu], When targetPinnings is not null,

[jira] [Commented] (HDFS-3689) Add support for variable length block

2015-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317267#comment-14317267 ] Jing Zhao commented on HDFS-3689: - Thanks for the comments, Suresh! The current patch

[jira] [Commented] (HDFS-4685) Implementation of ACLs in HDFS

2015-02-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317272#comment-14317272 ] Yongjun Zhang commented on HDFS-4685: - Hi [~cnauroth], Thanks for your earlier work on

[jira] [Created] (HDFS-7779) Improve the HDFS Web UI browser to allow chowning / chmoding and setting replication

2015-02-11 Thread Ravi Prakash (JIRA)
Ravi Prakash created HDFS-7779: -- Summary: Improve the HDFS Web UI browser to allow chowning / chmoding and setting replication Key: HDFS-7779 URL: https://issues.apache.org/jira/browse/HDFS-7779

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317264#comment-14317264 ] Hadoop QA commented on HDFS-7713: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317354#comment-14317354 ] Allen Wittenauer commented on HDFS-7713: I think if the patch is generated with git

[jira] [Assigned] (HDFS-7781) Use block erasure coder in client stripping

2015-02-11 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo reassigned HDFS-7781: --- Assignee: Li Bo Use block erasure coder in client stripping ---

[jira] [Created] (HDFS-7781) Use block erasure coder in client stripping

2015-02-11 Thread Li Bo (JIRA)
Li Bo created HDFS-7781: --- Summary: Use block erasure coder in client stripping Key: HDFS-7781 URL: https://issues.apache.org/jira/browse/HDFS-7781 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317512#comment-14317512 ] Hadoop QA commented on HDFS-7686: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7778) Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2

2015-02-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317517#comment-14317517 ] Lei (Eddy) Xu commented on HDFS-7778: - [~cnauroth] Sure. It is no problem at all. I

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Attachment: HDFS-7686.003.patch Re-add rapid rescan of possibly corrupt block feature

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317521#comment-14317521 ] Andrew Wang commented on HDFS-7686: --- Just a little nit, the suspectBlocks check is copy

[jira] [Updated] (HDFS-7322) deprecate sbin/*.sh

2015-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7322: Component/s: scripts Assignee: Allen Wittenauer Hadoop Flags: Reviewed +1 for the

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317360#comment-14317360 ] Yi Liu commented on HDFS-7761: -- Thanks [~arpitagarwal] for taking a look. {quote} I did take

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317443#comment-14317443 ] Andrew Wang commented on HDFS-7411: --- bq. When a node have many small blocks, say 10m,

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317440#comment-14317440 ] Jing Zhao commented on HDFS-7613: - Thanks for sharing the thoughts, [~walter.k.su]! I think

[jira] [Commented] (HDFS-7780) Update use of Iterator to Iterable

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317507#comment-14317507 ] Hadoop QA commented on HDFS-7780: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317518#comment-14317518 ] Colin Patrick McCabe commented on HDFS-7763: I feel a bit confused here.

[jira] [Commented] (HDFS-4685) Implementation of ACLs in HDFS

2015-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317297#comment-14317297 ] Chris Nauroth commented on HDFS-4685: - bq. My question is, if we already have the

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317300#comment-14317300 ] Yi Liu commented on HDFS-7761: -- Hi [~arpitagarwal], would you like to help review? Since you

[jira] [Commented] (HDFS-7668) Convert site documentation from apt to markdown

2015-02-11 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317352#comment-14317352 ] Masatake Iwasaki commented on HDFS-7668: I am checking this and will update the 00

[jira] [Commented] (HDFS-7772) Document hdfs balancer -exclude/-include option in HDFSCommands.html

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317394#comment-14317394 ] Hadoop QA commented on HDFS-7772: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317393#comment-14317393 ] Arpit Agarwal commented on HDFS-7761: - You are right. I took a quick look at this call

[jira] [Updated] (HDFS-7781) Use block erasure coder in client stripping

2015-02-11 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7781: Fix Version/s: HDFS-EC Use block erasure coder in client stripping ---

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-11 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317494#comment-14317494 ] Li Bo commented on HDFS-7729: - Thanks [~zhz] for the more review. Thanks [~jingzhao] in advance

[jira] [Updated] (HDFS-7776) Adding additional unit tests for Quota By Storage Type

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7776: - Attachment: HDFS-7776.0.patch Attach a patch with 5 additional tests: * 3 additional cases for both

[jira] [Updated] (HDFS-7776) Adding additional unit tests for Quota By Storage Type

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7776: - Status: Patch Available (was: Open) Adding additional unit tests for Quota By Storage Type

[jira] [Commented] (HDFS-7772) Document hdfs balancer -exclude/-include option in HDFSCommands.html

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317340#comment-14317340 ] Xiaoyu Yao commented on HDFS-7772: -- Thanks [~aw] for reviewing the patch. Good catch on

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317347#comment-14317347 ] Ravi Prakash commented on HDFS-7713: The patch doesn't apply because its a binary patch

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317511#comment-14317511 ] Colin Patrick McCabe commented on HDFS-7686: bq. Unused Iterator import in the

[jira] [Updated] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7729: Attachment: HDFS-7729-007.patch Thanks Bo for the rev! Great work and I think we are almost there. I made a

[jira] [Commented] (HDFS-4685) Implementation of ACLs in HDFS

2015-02-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317321#comment-14317321 ] Yongjun Zhang commented on HDFS-4685: - HI Chirs, Thanks a lot for your quick answer.

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317343#comment-14317343 ] Arpit Agarwal commented on HDFS-7761: - Hi [~hitliuyi], thanks for posting this cleanup

[jira] [Updated] (HDFS-7772) Document hdfs balancer -exclude/-include option in HDFSCommands.html

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7772: - Attachment: HDFS-7772.1.screen.png HDFS-7772.1.patch Update the patch that * Fix the typo

[jira] [Updated] (HDFS-3689) Add support for variable length block

2015-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Release Note: 1. HDFS now can choose to append data to a new block instead of end of the last partial

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-02-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317424#comment-14317424 ] Walter Su commented on HDFS-7613: - The facebook version has two policies: 1st,

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317449#comment-14317449 ] Jing Zhao commented on HDFS-7729: - Thanks for working on this, Bo and Zhe! I will also take

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-02-11 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317457#comment-14317457 ] Kai Zheng commented on HDFS-7613: - I agree we start with the policy considering RS code at

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317523#comment-14317523 ] Colin Patrick McCabe commented on HDFS-7648: Thank you for sticking with this.

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317551#comment-14317551 ] Rakesh R commented on HDFS-7648: bq. Why don't you just log them as you go? I really see no

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317563#comment-14317563 ] Rakesh R commented on HDFS-4265: Thanks a lot [~umamaheswararao], [~ajisakaa], [~ikelly]

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317561#comment-14317561 ] Yi Liu commented on HDFS-7694: -- +1 pending Jenkins. Thanks Colin. FSDataInputStream should

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317632#comment-14317632 ] Uma Maheswara Rao G commented on HDFS-7703: --- This patch make sense. Thanks for

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-11 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317700#comment-14317700 ] zhaoyunjiong commented on HDFS-6133: Sorry, which question? I clicked the URL, but

[jira] [Updated] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7703: Issue Type: Improvement (was: Bug) Support favouredNodes for the append for new blocks

[jira] [Commented] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317752#comment-14317752 ] Hadoop QA commented on HDFS-7763: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7703) Support favouredNodes for the append for new blocks

2015-02-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317708#comment-14317708 ] Vinayakumar B commented on HDFS-7703: - Thanks [~umamaheswararao] and [~rakeshr] for

[jira] [Assigned] (HDFS-7784) load fsimage in parallel

2015-02-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su reassigned HDFS-7784: --- Assignee: Walter Su load fsimage in parallel Key:

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317731#comment-14317731 ] Tsz Wo Nicholas Sze commented on HDFS-7769: --- But the rule is the rule. If you

[jira] [Assigned] (HDFS-2821) Improve the Balancer to move data from over utilized nodes to under utilized nodes using balanced nodes

2015-02-11 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reassigned HDFS-2821: --- Assignee: (was: Devaraj K) Improve the Balancer to move data from over utilized nodes to under

[jira] [Updated] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-11 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7729: Attachment: HDFS-7729-006.patch add multiple block group test cases, fix bugs. Now all cases in

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315983#comment-14315983 ] Hudson commented on HDFS-7753: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #101 (See

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7723: - Attachment: HDFS-7723.5.patch The patch has small changes over V4 based on [~arpitagarwal]'s feedback. 1.

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315838#comment-14315838 ] Konstantin Shvachko commented on HDFS-7769: --- This should have been reviewed by a

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315797#comment-14315797 ] Xiaoyu Yao commented on HDFS-7723: -- Thanks [~arpitagarwal] again for the review. bq.

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7760: -- Attachment: HDFS-7760-02.patch Sorry, you are right, need to add newlength definition as

[jira] [Updated] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7753: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315985#comment-14315985 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #101 (See

[jira] [Updated] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7723: - Attachment: HDFS-7723.6.patch Update the patch to merge with the BackupImage changes. Quota By Storage

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315793#comment-14315793 ] Hadoop QA commented on HDFS-7753: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315847#comment-14315847 ] Hudson commented on HDFS-7753: -- FAILURE: Integrated in Hadoop-trunk-Commit #7067 (See

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315848#comment-14315848 ] Hadoop QA commented on HDFS-7723: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316007#comment-14316007 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Yarn-trunk #835 (See

[jira] [Commented] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316005#comment-14316005 ] Hudson commented on HDFS-7753: -- FAILURE: Integrated in Hadoop-Yarn-trunk #835 (See

[jira] [Commented] (HDFS-316) Balancer should run for a configurable # of iterations

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316042#comment-14316042 ] Hadoop QA commented on HDFS-316: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7760) Further update user doc for truncate

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316138#comment-14316138 ] Hadoop QA commented on HDFS-7760: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7760) Further update user doc for truncate

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316139#comment-14316139 ] Yi Liu commented on HDFS-7760: -- +1, Thanks [~shv] Further update user doc for truncate

[jira] [Commented] (HDFS-7723) Quota By Storage Type namenode implemenation

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316152#comment-14316152 ] Hadoop QA commented on HDFS-7723: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-6759) Namenode Web UI only display 1 datanode when multiple datanodes exist on same hostname under different ports

2015-02-11 Thread liu chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu chang reassigned HDFS-6759: --- Assignee: liu chang Namenode Web UI only display 1 datanode when multiple datanodes exist on same

[jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout

2015-02-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317651#comment-14317651 ] Zhe Zhang commented on HDFS-7729: - Thanks Bo. If possible please also check the code

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317676#comment-14317676 ] Konstantin Shvachko commented on HDFS-7769: --- Sorry you are referring to a 3-year

[jira] [Created] (HDFS-7784) load fsimage in parallel

2015-02-11 Thread Walter Su (JIRA)
Walter Su created HDFS-7784: --- Summary: load fsimage in parallel Key: HDFS-7784 URL: https://issues.apache.org/jira/browse/HDFS-7784 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7784) load fsimage in parallel

2015-02-11 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7784: Description: When single Namenode has huge amount of files, without using federation, the startup/restart

[jira] [Created] (HDFS-7785) Add detailed message for HttpPutFailedException

2015-02-11 Thread Chengbing Liu (JIRA)
Chengbing Liu created HDFS-7785: --- Summary: Add detailed message for HttpPutFailedException Key: HDFS-7785 URL: https://issues.apache.org/jira/browse/HDFS-7785 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7785) Add detailed message for HttpPutFailedException

2015-02-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7785: Assignee: Chengbing Liu Status: Patch Available (was: Open) Add detailed message for

[jira] [Updated] (HDFS-7785) Add detailed message for HttpPutFailedException

2015-02-11 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7785: Attachment: HDFS-7785.01.patch Add detailed message for HttpPutFailedException

[jira] [Commented] (HDFS-4685) Implementation of ACLs in HDFS

2015-02-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317691#comment-14317691 ] Chris Nauroth commented on HDFS-4685: - Actually, there is one more implementation

[jira] [Commented] (HDFS-7778) Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317537#comment-14317537 ] Hadoop QA commented on HDFS-7778: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7783) Support appending to a striping layout file

2015-02-11 Thread Li Bo (JIRA)
Li Bo created HDFS-7783: --- Summary: Support appending to a striping layout file Key: HDFS-7783 URL: https://issues.apache.org/jira/browse/HDFS-7783 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317588#comment-14317588 ] Haohui Mai commented on HDFS-7713: -- I don't see why this patch requires bringing in yet

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.005.patch FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: (was: HDFS-7694.005.patch) FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: HDFS-7763-002.txt How about v2, Colin? fix zkfc hung issue due to not catching exception in a

[jira] [Commented] (HDFS-7772) Document hdfs balancer -exclude/-include option in HDFSCommands.html

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317534#comment-14317534 ] Hadoop QA commented on HDFS-7772: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2015-02-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317541#comment-14317541 ] Uma Maheswara Rao G commented on HDFS-4265: --- +1 for the patch. Thanks Rakesh. I

[jira] [Comment Edited] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317588#comment-14317588 ] Haohui Mai edited comment on HDFS-7713 at 2/12/15 4:50 AM: --- Can

[jira] [Comment Edited] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-02-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317588#comment-14317588 ] Haohui Mai edited comment on HDFS-7713 at 2/12/15 4:49 AM: --- I

[jira] [Commented] (HDFS-7776) Adding additional unit tests for Quota By Storage Type

2015-02-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317616#comment-14317616 ] Hadoop QA commented on HDFS-7776: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.005.patch add a test of reading after calling unbuffer()

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317545#comment-14317545 ] Yi Liu commented on HDFS-7761: -- Thanks [~arpitagarwal] for the review, will commit it shortly.

[jira] [Commented] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-02-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317558#comment-14317558 ] Rakesh R commented on HDFS-6348: Appreciate any help in reviewing the scenario and the

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317571#comment-14317571 ] Uma Maheswara Rao G commented on HDFS-7694: --- Yes, this should be useful. +1

[jira] [Created] (HDFS-7782) Read a striping layout file from client side

2015-02-11 Thread Li Bo (JIRA)
Li Bo created HDFS-7782: --- Summary: Read a striping layout file from client side Key: HDFS-7782 URL: https://issues.apache.org/jira/browse/HDFS-7782 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317621#comment-14317621 ] Hudson commented on HDFS-7761: -- FAILURE: Integrated in Hadoop-trunk-Commit #7082 (See

<    1   2   3   >