[jira] [Updated] (HDFS-4459) command manual dfsadmin missing entry for restoreFailedStorage option

2013-02-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4459: Status: Patch Available (was: Open) command manual dfsadmin missing entry for

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569013#comment-13569013 ] Andy Isaacson commented on HDFS-4461: - bq. A server generally has a lot of String

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569083#comment-13569083 ] Andy Isaacson commented on HDFS-4461: - The actual OOM backtrace is on the DN thread:

[jira] [Assigned] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson reassigned HDFS-4460: --- Assignee: Andy Isaacson HDFS docs not linked from top level

[jira] [Commented] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568284#comment-13568284 ] Andy Isaacson commented on HDFS-4460: - Thomas, Can you confirm the build+stage

[jira] [Updated] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4460: Attachment: hdfs4460.txt Attaching patch to fix links in the navigation menu.

[jira] [Updated] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4460: Status: Patch Available (was: Open) HDFS docs not linked from top level

[jira] [Commented] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568401#comment-13568401 ] Andy Isaacson commented on HDFS-4460: - I'm sure I'm the one missing something, not you.

[jira] [Updated] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4460: Status: Open (was: Patch Available) HDFS docs not linked from top level

[jira] [Commented] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568416#comment-13568416 ] Andy Isaacson commented on HDFS-4460: - bq. after staging I just go to the link at

[jira] [Updated] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4460: Status: Patch Available (was: Open) HDFS docs not linked from top level

[jira] [Updated] (HDFS-4460) HDFS docs not linked from top level

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4460: Attachment: hdfs4460-1.txt This patch adds links to the following pages: {{NativeLibraries

[jira] [Assigned] (HDFS-4459) command manual dfsadmin missing entry for restoreFailedStorage option

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson reassigned HDFS-4459: --- Assignee: Andy Isaacson command manual dfsadmin missing entry for restoreFailedStorage

[jira] [Updated] (HDFS-4459) command manual dfsadmin missing entry for restoreFailedStorage option

2013-01-31 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4459: Attachment: hdfs4459.txt Fix the table and add restoreFailedStorage docs. I'm a bit concerned how

[jira] [Created] (HDFS-4439) umask-mode does not support 4-digit umask value

2013-01-24 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4439: --- Summary: umask-mode does not support 4-digit umask value Key: HDFS-4439 URL: https://issues.apache.org/jira/browse/HDFS-4439 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4438) TestDomainSocket fails when system umask is set to 0002

2013-01-24 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13561984#comment-13561984 ] Andy Isaacson commented on HDFS-4438: - LGTM. TestDomainSocket fails

[jira] [Commented] (HDFS-4344) dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number

2013-01-24 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13562224#comment-13562224 ] Andy Isaacson commented on HDFS-4344: - bq. Most of the constants at the top of

[jira] [Updated] (HDFS-4344) dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number

2013-01-24 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4344: Attachment: hdfs4344-1.txt Remove unused variables per ATM. I found that the test complexity is

[jira] [Updated] (HDFS-4344) dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number

2013-01-22 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4344: Attachment: hdfs4344.txt Fix bug, add tests and some new asserts. - DatanodeManager.java:

[jira] [Updated] (HDFS-4344) dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number

2013-01-22 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4344: Affects Version/s: 3.0.0 Status: Patch Available (was: Open) dfshealth.jsp

[jira] [Commented] (HDFS-4237) Add unit tests for HTTP-based filesystems against secure MiniDFSCluster

2013-01-22 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560236#comment-13560236 ] Andy Isaacson commented on HDFS-4237: - bq. BTW, what do you use to catch these spaces?

[jira] [Commented] (HDFS-4237) Add unit tests for HTTP-based filesystems against secure MiniDFSCluster

2013-01-22 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13560248#comment-13560248 ] Andy Isaacson commented on HDFS-4237: - patch.008 LGTM. +1 (non-binding).

[jira] [Updated] (HDFS-2554) Add separate metrics for missing blocks with desired replication level 1

2013-01-21 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-2554: Target Version/s: (was: ) Status: Open (was: Patch Available) Add separate

[jira] [Commented] (HDFS-4237) Add unit tests for HTTP-based filesystems against secure MiniDFSCluster

2013-01-21 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13559231#comment-13559231 ] Andy Isaacson commented on HDFS-4237: - {noformat} + String address = 127.0.0.1: +

[jira] [Assigned] (HDFS-4344) dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number

2013-01-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson reassigned HDFS-4344: --- Assignee: Andy Isaacson dfshealth.jsp throws NumberFormatException when

[jira] [Commented] (HDFS-4237) Add unit tests for HTTP-based filesystems against secure MiniDFSCluster

2013-01-10 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550736#comment-13550736 ] Andy Isaacson commented on HDFS-4237: - A few tab characters crept into your patch.

[jira] [Created] (HDFS-4387) test_libhdfs_threaded SEGV on OpenJDK 7

2013-01-10 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4387: --- Summary: test_libhdfs_threaded SEGV on OpenJDK 7 Key: HDFS-4387 URL: https://issues.apache.org/jira/browse/HDFS-4387 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-2745) unclear to users which command to use to access the filesystem

2013-01-09 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549225#comment-13549225 ] Andy Isaacson commented on HDFS-2745: - I don't think we should remove {{hdfs dfs}} on

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2013-01-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-6.txt Attaching new patch -6 with improved comment. block

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2013-01-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13543950#comment-13543950 ] Andy Isaacson commented on HDFS-4253: - bq. Just shuffle the array and then call

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2013-01-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-5.txt New patch implementing cmccabe's suggestion to presume stable search and

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-21 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13538593#comment-13538593 ] Andy Isaacson commented on HDFS-4253: - bq. There are shuffle methods in

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-21 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-4.txt block replica reads get hot-spots due to

[jira] [Created] (HDFS-4335) dfs -mkdir /foo reports / rather than /foo in error output

2012-12-21 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4335: --- Summary: dfs -mkdir /foo reports / rather than /foo in error output Key: HDFS-4335 URL: https://issues.apache.org/jira/browse/HDFS-4335 Project: Hadoop HDFS

[jira] [Created] (HDFS-4329) DFSShell issues with directories with spaces in name

2012-12-20 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4329: --- Summary: DFSShell issues with directories with spaces in name Key: HDFS-4329 URL: https://issues.apache.org/jira/browse/HDFS-4329 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-4329) DFSShell issues with directories with spaces in name

2012-12-20 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4329: Description: This bug was discovered by Casey Ching. The command {{dfs -put /foo/hello.txt dir}}

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-19 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13536610#comment-13536610 ] Andy Isaacson commented on HDFS-4140: - bq. Andy: it seems to me like Colin's latest

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-19 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-3.txt bq. Instead of generating random numbers, put all datanodes in an array,

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-14 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532779#comment-13532779 ] Andy Isaacson commented on HDFS-4253: - bq. The bug comes later, where you always return

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-14 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-2.txt Avoid extra a.equals(b) by checking {{aIsLocal bIsLocal}} instead. On

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-14 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532901#comment-13532901 ] Andy Isaacson commented on HDFS-4253: - bq. I don't see any reason why shuffle(a) could

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-13 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-10.txt Mark RedundantEditLogInputStream#getRawHeader as throws IOException.

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-13 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13531939#comment-13531939 ] Andy Isaacson commented on HDFS-4140: - interdiff says: {code} @@ -62,7 +62,9 @@ }

[jira] [Commented] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530282#comment-13530282 ] Andy Isaacson commented on HDFS-4307: - bq. {{+ private static long

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530473#comment-13530473 ] Andy Isaacson commented on HDFS-4140: - I like the cleanup, that part LGTM. I somewhat

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-9.txt New patch, -9. - throw IOException in EditLogInputStream#getRawHeader if

[jira] [Commented] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530532#comment-13530532 ] Andy Isaacson commented on HDFS-4307: - bq. HDFS-4307.002.patch LGTM! +1. Since the

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-10 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528212#comment-13528212 ] Andy Isaacson commented on HDFS-4140: - Agreed the TestEditLog failure is unrelated.

[jira] [Created] (HDFS-4284) BlockReaderLocal not notified of failed disks

2012-12-06 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4284: --- Summary: BlockReaderLocal not notified of failed disks Key: HDFS-4284 URL: https://issues.apache.org/jira/browse/HDFS-4284 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4239) Means of telling the datanode to stop using a sick disk

2012-12-06 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13525888#comment-13525888 ] Andy Isaacson commented on HDFS-4239: - I created HDFS-4284 to track the

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-06 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-8.txt New patch, -8. - Use readFully rather than read to address Findbugs

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-05 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-6.txt New patch: Improve handling of checksum in FSEditLogOp and remove

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-05 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510862#comment-13510862 ] Andy Isaacson commented on HDFS-4140: - LGTM, thanks for the cleanup! +1 pending jenkins

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-05 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-7.txt Attaching new patch, -7, which makes the new FSEditLogOp#rawBytes member

[jira] [Commented] (HDFS-4205) fsck fails with symlinks

2012-12-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509958#comment-13509958 ] Andy Isaacson commented on HDFS-4205: - bq. It seems to me that the symlink support is

[jira] [Commented] (HDFS-4205) fsck fails with symlinks

2012-12-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510002#comment-13510002 ] Andy Isaacson commented on HDFS-4205: - I would expect FileStatus to work, considering

[jira] [Commented] (HDFS-4239) Means of telling the datanode to stop using a sick disk

2012-12-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510181#comment-13510181 ] Andy Isaacson commented on HDFS-4239: - bq. What about stopping the datanode, chmod

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13510200#comment-13510200 ] Andy Isaacson commented on HDFS-4140: - Thanks for the cleanup in .005, Colin. The new

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-04 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-5.txt Thanks to Todd and Colin for the suggestions, this is much cleaner. I'm

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509045#comment-13509045 ] Andy Isaacson commented on HDFS-3801: - Harsh, What is the use case for this config

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509294#comment-13509294 ] Andy Isaacson commented on HDFS-4253: - bq. I find it a little bit concerning that this

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Attachment: hdfs4253-1.txt Uploading new patch using .equals rather than ==.

[jira] [Commented] (HDFS-3801) Provide a way to disable browsing of files from the web UI

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509374#comment-13509374 ] Andy Isaacson commented on HDFS-3801: - bq. There's been a general need to disable UI

[jira] [Commented] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-03 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13509445#comment-13509445 ] Andy Isaacson commented on HDFS-4045: - bq. Instead of the trick in decodeOp() where you

[jira] [Updated] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-11-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4253: Status: Patch Available (was: Open) block replica reads get hot-spots due to

[jira] [Commented] (HDFS-4239) Means of telling the datanode to stop using a sick disk

2012-11-29 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506758#comment-13506758 ] Andy Isaacson commented on HDFS-4239: - bq. would a umount -f let you force the unmount.

[jira] [Commented] (HDFS-4239) Means of telling the datanode to stop using a sick disk

2012-11-29 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506769#comment-13506769 ] Andy Isaacson commented on HDFS-4239: - bq. Would chmod 000 /path/to/data/dir do the

[jira] [Commented] (HDFS-4239) Means of telling the datanode to stop using a sick disk

2012-11-29 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13506791#comment-13506791 ] Andy Isaacson commented on HDFS-4239: - To expand on my previous comment: I tested on

[jira] [Commented] (HDFS-4178) shell scripts should not close stderr

2012-11-19 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13500496#comment-13500496 ] Andy Isaacson commented on HDFS-4178: - bq. (I was under the misimpression that fd 0-2

[jira] [Commented] (HDFS-4178) shell scripts should not close stderr

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499263#comment-13499263 ] Andy Isaacson commented on HDFS-4178: - [~daryn] I think this jira is ready to commit,

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Status: Open (was: Patch Available) SecondaryNameNode cannot read from QuorumJournal URI

[jira] [Created] (HDFS-4205) fsck fails with symlinks

2012-11-16 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4205: --- Summary: fsck fails with symlinks Key: HDFS-4205 URL: https://issues.apache.org/jira/browse/HDFS-4205 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Attachment: hdfs4045-4.txt hdfs4045-4.txt: new approach; streams edits from any JM via the NN

[jira] [Updated] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4045: Status: Patch Available (was: Open) SecondaryNameNode cannot read from QuorumJournal URI

[jira] [Commented] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499321#comment-13499321 ] Andy Isaacson commented on HDFS-4045: - Note for reviewers: I will add the missing

[jira] [Commented] (HDFS-4205) fsck fails with symlinks

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499322#comment-13499322 ] Andy Isaacson commented on HDFS-4205: - The following appeared in the NN log: {noformat}

[jira] [Commented] (HDFS-4205) fsck fails with symlinks

2012-11-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499323#comment-13499323 ] Andy Isaacson commented on HDFS-4205: - Attempting to delete the symlink with {{hdfs dfs

[jira] [Created] (HDFS-4197) SNN JMX is lacking checkpoint info

2012-11-15 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4197: --- Summary: SNN JMX is lacking checkpoint info Key: HDFS-4197 URL: https://issues.apache.org/jira/browse/HDFS-4197 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-4104) dfs -test -d prints inappropriate error on nonexistent directory

2012-11-14 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4104: Attachment: hdfs4104-4.txt add assertion of correct exit value for dfs -test -d. {code} @@ -459,6

[jira] [Commented] (HDFS-4178) shell scripts should not close stderr

2012-11-13 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13496622#comment-13496622 ] Andy Isaacson commented on HDFS-4178: - bq. The data corruption occurs when the process

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13495497#comment-13495497 ] Andy Isaacson commented on HDFS-4139: - bq. I tested this manually with some attempts to

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13495565#comment-13495565 ] Andy Isaacson commented on HDFS-4140: - LGTM, +1. fuse-dfs handles

[jira] [Created] (HDFS-4178) shell scripts should not close stderr

2012-11-12 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4178: --- Summary: shell scripts should not close stderr Key: HDFS-4178 URL: https://issues.apache.org/jira/browse/HDFS-4178 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-4178) shell scripts should not close stderr

2012-11-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4178: Status: Patch Available (was: Open) shell scripts should not close stderr

[jira] [Updated] (HDFS-4178) shell scripts should not close stderr

2012-11-12 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4178: Attachment: hdfs4178.txt Attaching patch to redirect to {{/dev/null}}. shell

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493393#comment-13493393 ] Andy Isaacson commented on HDFS-4140: - {code} + // The file exists, and has

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493470#comment-13493470 ] Andy Isaacson commented on HDFS-4140: - bq. Do you have an idea for how to solve this

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493474#comment-13493474 ] Andy Isaacson commented on HDFS-4140: - (user error truncated comment) ... Opening

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493545#comment-13493545 ] Andy Isaacson commented on HDFS-4140: - bq. provides correct semantics up until the

[jira] [Updated] (HDFS-3935) QJM: Add JournalNode to the start / stop scripts

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3935: Attachment: hdfs3935.txt Proposed changes to start-dfs.sh and stop-dfs.sh to find QJ nodes by

[jira] [Updated] (HDFS-3935) QJM: Add JournalNode to the start / stop scripts

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3935: Status: Patch Available (was: Open) QJM: Add JournalNode to the start / stop scripts

[jira] [Updated] (HDFS-3935) QJM: Add JournalNode to the start / stop scripts

2012-11-08 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3935: Attachment: hdfs3935-1.txt Updated version with cosmetic whitespace change. Manual testing

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-07 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13492885#comment-13492885 ] Andy Isaacson commented on HDFS-4139: - The change seems legit. Please update with

[jira] [Commented] (HDFS-4164) fuse_dfs: add -lrt to the compiler command line on Linux

2012-11-07 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13492887#comment-13492887 ] Andy Isaacson commented on HDFS-4164: - LGTM. +1. Does this fix a currently broken

[jira] [Commented] (HDFS-4153) Add START_MSG/SHUTDOWN_MSG for JournalNode

2012-11-06 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13491842#comment-13491842 ] Andy Isaacson commented on HDFS-4153: - The patch looks good to me, and I don't think it

[jira] [Updated] (HDFS-1331) dfs -test should work like /bin/test

2012-11-05 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-1331: Attachment: hdfs1331-3.txt dfs -test should work like /bin/test

[jira] [Commented] (HDFS-1331) dfs -test should work like /bin/test

2012-11-05 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13490831#comment-13490831 ] Andy Isaacson commented on HDFS-1331: - bq. follow the pattern for the usage of other

[jira] [Updated] (HDFS-1331) dfs -test should work like /bin/test

2012-11-05 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-1331: Attachment: hdfs1331-4.txt dfs -test should work like /bin/test

[jira] [Created] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-01 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4139: --- Summary: fuse-dfs RO mode still allows file truncation Key: HDFS-4139 URL: https://issues.apache.org/jira/browse/HDFS-4139 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489076#comment-13489076 ] Andy Isaacson commented on HDFS-4139: - This might be related to the fact that {{rw}}

  1   2   3   4   >