[jira] [Commented] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508567#comment-13508567 ] Hadoop QA commented on HDFS-4240: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4231) Introduce HAState for BackupNode

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508641#comment-13508641 ] Hudson commented on HDFS-4231: -- Integrated in Hadoop-Yarn-trunk #55 (See

[jira] [Commented] (HDFS-3358) Specify explicitly that the NN UI status total is talking of persistent objects on heap.

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508642#comment-13508642 ] Hudson commented on HDFS-3358: -- Integrated in Hadoop-Yarn-trunk #55 (See

[jira] [Updated] (HDFS-4199) Provide test for HdfsVolumeId

2012-12-03 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated HDFS-4199: - Attachment: HDFS-4199--e.patch Patch HDFS-4199--e.patch addresses the last comment from

[jira] [Commented] (HDFS-3358) Specify explicitly that the NN UI status total is talking of persistent objects on heap.

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508707#comment-13508707 ] Hudson commented on HDFS-3358: -- Integrated in Hadoop-Hdfs-trunk #1245 (See

[jira] [Commented] (HDFS-4231) Introduce HAState for BackupNode

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508706#comment-13508706 ] Hudson commented on HDFS-4231: -- Integrated in Hadoop-Hdfs-trunk #1245 (See

[jira] [Commented] (HDFS-4231) Introduce HAState for BackupNode

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508745#comment-13508745 ] Hudson commented on HDFS-4231: -- Integrated in Hadoop-Mapreduce-trunk #1276 (See

[jira] [Commented] (HDFS-3358) Specify explicitly that the NN UI status total is talking of persistent objects on heap.

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508746#comment-13508746 ] Hudson commented on HDFS-3358: -- Integrated in Hadoop-Mapreduce-trunk #1276 (See

[jira] [Commented] (HDFS-4199) Provide test for HdfsVolumeId

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508749#comment-13508749 ] Hadoop QA commented on HDFS-4199: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4199) Provide test for HdfsVolumeId

2012-12-03 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508783#comment-13508783 ] Ivan A. Veselovsky commented on HDFS-4199: -- The test failure in of patch

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508798#comment-13508798 ] Steve Loughran commented on HDFS-3801: -- Patch-wise, looks OK to me -though I'll defer

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-12-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508869#comment-13508869 ] Chris Nauroth commented on HDFS-3990: - Daryn and Eli, we merged this change to

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-12-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508879#comment-13508879 ] Daryn Sharp commented on HDFS-3990: --- The check was floated up out of

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-12-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508889#comment-13508889 ] Chris Nauroth commented on HDFS-3990: - The problem I observe is that a server accepts a

[jira] [Commented] (HDFS-3153) For HA, a logical name is visible in URIs - add an explicit logical name

2012-12-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508905#comment-13508905 ] Daryn Sharp commented on HDFS-3153: --- Question: I'm concerned a bit over allowing

[jira] [Updated] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4243: Attachment: HDFS-4243.003.patch Add a new testcase in which we call setQuota (which calls

[jira] [Updated] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4243: Affects Version/s: 3.0.0 Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-4251) NN connections can use up all fds leaving none for rolling journal files

2012-12-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508951#comment-13508951 ] Kihwal Lee commented on HDFS-4251: -- We've another case that affects edit logging: The edit

[jira] [Commented] (HDFS-3680) Allow customized audit logging in HDFS FSNamesystem

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508960#comment-13508960 ] Aaron T. Myers commented on HDFS-3680: -- Suresh, any comments here?

[jira] [Commented] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508976#comment-13508976 ] Tsz Wo (Nicholas), SZE commented on HDFS-4243: -- Jing, thanks for working on

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508980#comment-13508980 ] Tsz Wo (Nicholas), SZE commented on HDFS-3875: -- The exception caught is not

[jira] [Commented] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508992#comment-13508992 ] Jing Zhao commented on HDFS-4243: - The INode#parent is mainly used by INode#getFullPathName

[jira] [Commented] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2012-12-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508994#comment-13508994 ] Jing Zhao commented on HDFS-4240: - +1 for the new patch. In

[jira] [Commented] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508993#comment-13508993 ] Colin Patrick McCabe commented on HDFS-4045: I think that Todd's idea of simply

[jira] [Created] (HDFS-4260) incorrect inclusion of drive spec in test root path causes multiple HDFS test failures on Windows

2012-12-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4260: --- Summary: incorrect inclusion of drive spec in test root path causes multiple HDFS test failures on Windows Key: HDFS-4260 URL: https://issues.apache.org/jira/browse/HDFS-4260

[jira] [Commented] (HDFS-4260) incorrect inclusion of drive spec in test root path causes multiple HDFS test failures on Windows

2012-12-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508997#comment-13508997 ] Chris Nauroth commented on HDFS-4260: - At least the following test suites (possibly

[jira] [Updated] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4234: - Attachment: h4234_20121128.patch Hi Junping, thanks for the review.

[jira] [Created] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4261: Summary: TestBalancerWithNodeGroup times out Key: HDFS-4261 URL: https://issues.apache.org/jira/browse/HDFS-4261 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509039#comment-13509039 ] Tsz Wo (Nicholas), SZE commented on HDFS-4234: -- When I manually ran

[jira] [Commented] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509041#comment-13509041 ] Hadoop QA commented on HDFS-4243: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509045#comment-13509045 ] Andy Isaacson commented on HDFS-3801: - Harsh, What is the use case for this config

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509073#comment-13509073 ] Harsh J commented on HDFS-3801: --- Thanks Steve and Andy! bq. What is the use case for this

[jira] [Updated] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-3801: -- Status: Open (was: Patch Available) Provide a way to disable browsing of files from the web UI

[jira] [Commented] (HDFS-4246) The exclude node list should be more forgiving, for each output stream

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509089#comment-13509089 ] Colin Patrick McCabe commented on HDFS-4246: This change makes a lot of sense

[jira] [Updated] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4240: - Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4249) Add status NameNode startup to webUI

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509109#comment-13509109 ] Colin Patrick McCabe commented on HDFS-4249: Seems like a good idea to me. It

[jira] [Commented] (HDFS-4246) The exclude node list should be more forgiving, for each output stream

2012-12-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509118#comment-13509118 ] Harsh J commented on HDFS-4246: --- Thanks Colin, I'll update the test with your comments and

[jira] [Updated] (HDFS-4246) The exclude node list should be more forgiving, for each output stream

2012-12-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-4246: -- Status: Open (was: Patch Available) The exclude node list should be more forgiving, for each output

[jira] [Commented] (HDFS-4240) In nodegroup-aware case, make sure nodes are avoided to place replica if some replica are already under the same nodegroup

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509125#comment-13509125 ] Hudson commented on HDFS-4240: -- Integrated in Hadoop-trunk-Commit #3086 (See

[jira] [Commented] (HDFS-4251) NN connections can use up all fds leaving none for rolling journal files

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509135#comment-13509135 ] Colin Patrick McCabe commented on HDFS-4251: This is a good find, Sanjay. One

[jira] [Updated] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4243: - Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509280#comment-13509280 ] Hadoop QA commented on HDFS-4234: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509281#comment-13509281 ] Colin Patrick McCabe commented on HDFS-4253: Good find, Andy! This issue could

[jira] [Commented] (HDFS-4256) Support for concatenation of files into a single file in branch-1

2012-12-03 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509283#comment-13509283 ] Sanjay Radia commented on HDFS-4256: Since this is an addition of a *new* rpc method in

[jira] [Commented] (HDFS-4243) INodeDirectory.replaceChild(..) does not update parent

2012-12-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509288#comment-13509288 ] Hudson commented on HDFS-4243: -- Integrated in Hadoop-trunk-Commit #3087 (See

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509294#comment-13509294 ] Andy Isaacson commented on HDFS-4253: - bq. I find it a little bit concerning that this

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-1.txt Uploading new patch using .equals rather than ==.

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509310#comment-13509310 ] Colin Patrick McCabe commented on HDFS-4253: More about that {{compare}}

[jira] [Commented] (HDFS-3970) BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file.

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509327#comment-13509327 ] Todd Lipcon commented on HDFS-3970: --- Hey Vinay. Sorry I missed the earlier upload. Any

[jira] [Assigned] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-4238: - Assignee: Todd Lipcon [HA] Standby namenode should not do purging of shared storage edits.

[jira] [Updated] (HDFS-4157) libhdfs: hdfsTell could be implemented a smarter than it is

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4157: --- Description: In libhdfs, {{hdfsTell}} currently makes a JNI call into {{DFSClient}}

[jira] [Commented] (HDFS-3153) For HA, a logical name is visible in URIs - add an explicit logical name

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509357#comment-13509357 ] Tsz Wo (Nicholas), SZE commented on HDFS-3153: -- Daryn, I agree that we should

[jira] [Commented] (HDFS-3153) For HA, a logical name is visible in URIs - add an explicit logical name

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509366#comment-13509366 ] Aaron T. Myers commented on HDFS-3153: -- Sanjay / Nicholas - could one of you please

[jira] [Updated] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4238: -- Attachment: hdfs-4238.txt [HA] Standby namenode should not do purging of shared storage edits.

[jira] [Updated] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4238: -- Status: Patch Available (was: Open) [HA] Standby namenode should not do purging of shared storage

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509374#comment-13509374 ] Andy Isaacson commented on HDFS-3801: - bq. There's been a general need to disable UI

[jira] [Commented] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509378#comment-13509378 ] Hadoop QA commented on HDFS-4238: - {color:red}-1 overall{color}. Here are the results of

[jira] [Reopened] (HDFS-3571) Allow EditLogFileInputStream to read from a remote URL

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-3571: --- Reopening for merge to branch-2 (this is needed for QJM in branch-2) Allow

[jira] [Updated] (HDFS-3571) Allow EditLogFileInputStream to read from a remote URL

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3571: -- Attachment: hdfs-3571-branch-2.txt Attached patch for branch-2. I ran the new unit test and it passed.

[jira] [Reopened] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-3049: --- Reopening for commit to branch-2 (this code is needed for QJM support). During the

[jira] [Updated] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3049: -- Attachment: hdfs-3049-branch-2.txt Attached patch applies to tip of branch-2. I ran the new tests and

[jira] [Updated] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3049: -- Target Version/s: 2.0.3-alpha (was: ) During the normal loading NN startup process, fall back on

[jira] [Reopened] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-3077: --- Reopening for merge to branch-2 Quorum-based protocol for reading and writing edit logs

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077-branch-2.txt This patch consists of the full merge for branch-2. There were a few

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509394#comment-13509394 ] Junping Du commented on HDFS-4234: -- Nicholas, the second patch looks the same as the first

[jira] [Updated] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4234: - Attachment: h4234_20121203.patch Oops, here is the right file.

[jira] [Updated] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4234: - Attachment: (was: h4234_20121128.patch) Use the generic code for

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509407#comment-13509407 ] Hadoop QA commented on HDFS-4253: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4238: -- Attachment: hdfs-4238.txt Woops, sorry, previous patch did not apply correctly. This one should apply

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509413#comment-13509413 ] Junping Du commented on HDFS-4234: -- +1. Patch looks good to me. Thanks for the patch to

[jira] [Updated] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4235: --- Attachment: HDFS-4235.001.patch here's a patch which contains unit tests which

[jira] [Updated] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4235: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) when

[jira] [Created] (HDFS-4262) Backport HTTPFS to Branch 1

2012-12-03 Thread Eric Yang (JIRA)
Eric Yang created HDFS-4262: --- Summary: Backport HTTPFS to Branch 1 Key: HDFS-4262 URL: https://issues.apache.org/jira/browse/HDFS-4262 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-4259) Improve pipeline DN replacement failure message

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509427#comment-13509427 ] Aaron T. Myers commented on HDFS-4259: -- +1, the patch looks good to me. I agree that

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509429#comment-13509429 ] Aaron T. Myers commented on HDFS-4261: -- Oof, we should really fix test-patch to notice

[jira] [Commented] (HDFS-3358) Specify explicitly that the NN UI status total is talking of persistent objects on heap.

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509434#comment-13509434 ] Aaron T. Myers commented on HDFS-3358: -- Harsh, mind committing this to branch-2 as

[jira] [Commented] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509445#comment-13509445 ] Andy Isaacson commented on HDFS-4045: - bq. Instead of the trick in decodeOp() where you

[jira] [Commented] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509449#comment-13509449 ] Aaron T. Myers commented on HDFS-4238: -- The latest patch looks good to me. +1 pending

[jira] [Commented] (HDFS-4199) Provide test for HdfsVolumeId

2012-12-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509454#comment-13509454 ] Aaron T. Myers commented on HDFS-4199: -- The latest patch looks pretty good to me. Two

[jira] [Commented] (HDFS-4234) Use the generic code for choosing datanode in Balancer

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509467#comment-13509467 ] Hadoop QA commented on HDFS-4234: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509473#comment-13509473 ] Hadoop QA commented on HDFS-4238: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509482#comment-13509482 ] Hadoop QA commented on HDFS-4235: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4262) Backport HTTPFS to Branch 1

2012-12-03 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509503#comment-13509503 ] Suresh Srinivas commented on HDFS-4262: --- +1. This feature is useful along with

[jira] [Commented] (HDFS-4238) [HA] Standby namenode should not do purging of shared storage edits.

2012-12-03 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509506#comment-13509506 ] Vinay commented on HDFS-4238: - Thanks Todd, patch looks good to me. +1. [HA]

[jira] [Updated] (HDFS-4263) DFSInputStream.reportCheckSumFailure do not report all corrupted blocks

2012-12-03 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-4263: Status: Patch Available (was: Open) DFSInputStream.reportCheckSumFailure do not report all

[jira] [Updated] (HDFS-4263) DFSInputStream.reportCheckSumFailure do not report all corrupted blocks

2012-12-03 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-4263: Attachment: HDFS-4263.patch DFSInputStream.reportCheckSumFailure do not report all corrupted

[jira] [Created] (HDFS-4263) DFSInputStream.reportCheckSumFailure do not report all corrupted blocks

2012-12-03 Thread Binglin Chang (JIRA)
Binglin Chang created HDFS-4263: --- Summary: DFSInputStream.reportCheckSumFailure do not report all corrupted blocks Key: HDFS-4263 URL: https://issues.apache.org/jira/browse/HDFS-4263 Project: Hadoop

[jira] [Updated] (HDFS-4263) DFSInputStream.reportCheckSumFailure do not report all corrupted blocks

2012-12-03 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated HDFS-4263: Resolution: Won't Fix Status: Resolved (was: Patch Available) SORRY, my mistake,

[jira] [Commented] (HDFS-4263) DFSInputStream.reportCheckSumFailure do not report all corrupted blocks

2012-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509552#comment-13509552 ] Hadoop QA commented on HDFS-4263: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4264) Update documentation for ZooKeeper Failover Controller

2012-12-03 Thread Daisuke Kobayashi (JIRA)
Daisuke Kobayashi created HDFS-4264: --- Summary: Update documentation for ZooKeeper Failover Controller Key: HDFS-4264 URL: https://issues.apache.org/jira/browse/HDFS-4264 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4199) Provide test for HdfsVolumeId

2012-12-03 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated HDFS-4199: - Attachment: HDFS-4199--f.patch Aaron, thanks for the review. The attached patch