[jira] [Commented] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706684#comment-13706684 ] Jing Zhao commented on HDFS-4912: - The patch looks good to me. Only some minor: 1. In the

[jira] [Updated] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4912: -- Attachment: HDFS-4912.2.patch Jing, thanks for the comments. Updated patch to address the

[jira] [Commented] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706700#comment-13706700 ] Jing Zhao commented on HDFS-4912: - +1 for the new patch. Cleanup

[jira] [Commented] (HDFS-4968) Provide configuration option for FileSystem symlink resolution

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706702#comment-13706702 ] Hadoop QA commented on HDFS-4968: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan reassigned HDFS-4926: --- Assignee: Vivek Ganesan namenode webserver's page has a tooltip that is inconsistent

[jira] [Commented] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706754#comment-13706754 ] Hadoop QA commented on HDFS-4912: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4982) JournalNode should relogin from keytab before fetching logs from other JNs

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706792#comment-13706792 ] Hadoop QA commented on HDFS-4982: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706794#comment-13706794 ] Hadoop QA commented on HDFS-4912: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4980) Incorrect logging.properties file for hadoop-httpfs

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706851#comment-13706851 ] Hudson commented on HDFS-4980: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #268 (See

[jira] [Commented] (HDFS-4978) Make disallowSnapshot idempotent

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706856#comment-13706856 ] Hudson commented on HDFS-4978: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #268 (See

[jira] [Commented] (HDFS-4373) Add HTTP API for querying NameNode startup progress

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706853#comment-13706853 ] Hudson commented on HDFS-4373: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #268 (See

[jira] [Commented] (HDFS-4374) Display NameNode startup progress in UI

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706854#comment-13706854 ] Hudson commented on HDFS-4374: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #268 (See

[jira] [Commented] (HDFS-4980) Incorrect logging.properties file for hadoop-httpfs

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706920#comment-13706920 ] Hudson commented on HDFS-4980: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1458 (See

[jira] [Commented] (HDFS-4374) Display NameNode startup progress in UI

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706923#comment-13706923 ] Hudson commented on HDFS-4374: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1458 (See

[jira] [Commented] (HDFS-4978) Make disallowSnapshot idempotent

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706925#comment-13706925 ] Hudson commented on HDFS-4978: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1458 (See

[jira] [Commented] (HDFS-4373) Add HTTP API for querying NameNode startup progress

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706922#comment-13706922 ] Hudson commented on HDFS-4373: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1458 (See

[jira] [Commented] (HDFS-4978) Make disallowSnapshot idempotent

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706962#comment-13706962 ] Hudson commented on HDFS-4978: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1485 (See

[jira] [Commented] (HDFS-4374) Display NameNode startup progress in UI

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706960#comment-13706960 ] Hudson commented on HDFS-4374: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1485 (See

[jira] [Commented] (HDFS-4980) Incorrect logging.properties file for hadoop-httpfs

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706957#comment-13706957 ] Hudson commented on HDFS-4980: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1485 (See

[jira] [Commented] (HDFS-4373) Add HTTP API for querying NameNode startup progress

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706959#comment-13706959 ] Hudson commented on HDFS-4373: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1485 (See

[jira] [Commented] (HDFS-4366) Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks

2013-07-12 Thread Derek Dagit (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707064#comment-13707064 ] Derek Dagit commented on HDFS-4366: --- Anything else blocking this that I should look into?

[jira] [Commented] (HDFS-4794) Browsing filesystem via webui throws kerberos exception when NN service RPC is enabled in a secure cluster

2013-07-12 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707100#comment-13707100 ] Larry McCay commented on HDFS-4794: --- I agree with Jitendra. In my opinion we should

[jira] [Work started] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-4926 started by Vivek Ganesan. namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Affects Version/s: (was: 1.0.3) Status: Patch Available (was: In Progress)

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Attachment: hdfs-4926.patch Tooltip modification in links to nodes namenode

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Status: Open (was: Patch Available) namenode webserver's page has a tooltip that is

[jira] [Commented] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707133#comment-13707133 ] Vivek Ganesan commented on HDFS-4926: - {color:red}-1 overall{color}.

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Attachment: patchJavadocWarnings.txt Patch Javadoc warnings namenode webserver's

[jira] [Updated] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4912: -- Target Version/s: 2.1.0-beta Issue Type: Improvement (was: Bug) Cleanup

[jira] [Commented] (HDFS-4982) JournalNode should relogin from keytab before fetching logs from other JNs

2013-07-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707139#comment-13707139 ] Todd Lipcon commented on HDFS-4982: --- The release audit and eclipse errors are unrelated -

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4926: Status: Patch Available (was: Open) namenode webserver's page has a tooltip that is inconsistent with

[jira] [Commented] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707150#comment-13707150 ] Hadoop QA commented on HDFS-4926: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707151#comment-13707151 ] Vivek Ganesan commented on HDFS-4926: - Request review for the patch (following

[jira] [Commented] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707157#comment-13707157 ] Hudson commented on HDFS-4912: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4076 (See

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Attachment: (was: patchJavadocWarnings.txt) namenode webserver's page has a tooltip that

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Status: Open (was: Patch Available) autobuild system took the non-patch attachment. So, deleted

[jira] [Updated] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan updated HDFS-4926: Status: Patch Available (was: Open) resubmitting patch. Previous patch check failed because of an

[jira] [Commented] (HDFS-4982) JournalNode should relogin from keytab before fetching logs from other JNs

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707176#comment-13707176 ] Suresh Srinivas commented on HDFS-4982: --- Jenkins -1s are due to some Jenkins machine

[jira] [Commented] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707179#comment-13707179 ] Jing Zhao commented on HDFS-4926: - Hi Vivek, In NamenodeJspHelper#generateNodeData,

[jira] [Updated] (HDFS-4912) Cleanup FSNamesystem#startFileInternal

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4912: -- Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed

[jira] [Created] (HDFS-4984) Incorrect Quota counting in INodeFile

2013-07-12 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-4984: Summary: Incorrect Quota counting in INodeFile Key: HDFS-4984 URL: https://issues.apache.org/jira/browse/HDFS-4984 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-1775) getContentSummary should hold the FSNamesystem readlock

2013-07-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-1775. -- Resolution: Duplicate getContentSummary should hold the FSNamesystem readlock

[jira] [Commented] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707219#comment-13707219 ] Vivek Ganesan commented on HDFS-4926: - Hi Jing, I agree that we were showing some

[jira] [Commented] (HDFS-4977) Change Checkpoint Size of web ui of SecondaryNameNode

2013-07-12 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707231#comment-13707231 ] Shinichi Yamashita commented on HDFS-4977: -- Thank you for comment. The user of

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707230#comment-13707230 ] Andrew Purtell commented on HDFS-2832: -- Doesn't the above repurposing of this JIRA

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4953: --- Status: Patch Available (was: Open) enable HDFS local reads via mmap

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4953: --- Attachment: 0001-HDFS-4953.patch enable HDFS local reads via mmap

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707244#comment-13707244 ] Andrew Purtell commented on HDFS-2832: -- {quote} We will open Jiras to track these

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707249#comment-13707249 ] Hadoop QA commented on HDFS-4953: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707288#comment-13707288 ] Sanjay Radia commented on HDFS-4949: I think we can treat the RAM copies as replicas -

[jira] [Commented] (HDFS-4926) namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707301#comment-13707301 ] Hadoop QA commented on HDFS-4926: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4982) JournalNode should relogin from keytab before fetching logs from other JNs

2013-07-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4982: -- Resolution: Fixed Fix Version/s: 2.1.0-beta 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4982) JournalNode should relogin from keytab before fetching logs from other JNs

2013-07-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707359#comment-13707359 ] Hudson commented on HDFS-4982: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4077 (See

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707389#comment-13707389 ] Colin Patrick McCabe commented on HDFS-4949: I agree that there are some

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707388#comment-13707388 ] Nick Dimiduk commented on HDFS-2832: I wonder how these tiers interact with alternative

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707400#comment-13707400 ] Suresh Srinivas commented on HDFS-4672: --- bq. What is the difference between this

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4953: --- Attachment: (was: 0001-HDFS-4953.patch) enable HDFS local reads via mmap

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4953: --- Attachment: HDFS-4953.001.patch rebase on trunk enable HDFS local

[jira] [Commented] (HDFS-4947) Add NFS server export table to control export by hostname or IP range

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707404#comment-13707404 ] Hadoop QA commented on HDFS-4947: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707418#comment-13707418 ] Suresh Srinivas commented on HDFS-2832: --- bq. Many of the items on the above list

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707422#comment-13707422 ] Sanjay Radia commented on HDFS-2832: Andrew, I was always confused about the creation

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707430#comment-13707430 ] Suresh Srinivas commented on HDFS-2832: --- bq. I wonder how these tiers interact with

[jira] [Created] (HDFS-4986) Namenode webUI changes to incorporate storage type

2013-07-12 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4986: - Summary: Namenode webUI changes to incorporate storage type Key: HDFS-4986 URL: https://issues.apache.org/jira/browse/HDFS-4986 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-07-12 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4985: - Summary: Add storage type to the protocol and expose it in block report and block locations Key: HDFS-4985 URL: https://issues.apache.org/jira/browse/HDFS-4985

[jira] [Commented] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707433#comment-13707433 ] Suresh Srinivas commented on HDFS-4985: --- Storage type currently we are considering

[jira] [Created] (HDFS-4987) Namenode changes to track multiple storages

2013-07-12 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4987: - Summary: Namenode changes to track multiple storages Key: HDFS-4987 URL: https://issues.apache.org/jira/browse/HDFS-4987 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-4988) Datanode must support all the volumes as individual storages

2013-07-12 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4988: - Summary: Datanode must support all the volumes as individual storages Key: HDFS-4988 URL: https://issues.apache.org/jira/browse/HDFS-4988 Project: Hadoop HDFS

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707450#comment-13707450 ] Suresh Srinivas commented on HDFS-2832: --- I have created couple of jiras, thus dumping

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707455#comment-13707455 ] Colin Patrick McCabe commented on HDFS-4672: I think the progress on HDFS-2832

[jira] [Comment Edited] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-07-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707422#comment-13707422 ] Sanjay Radia edited comment on HDFS-2832 at 7/12/13 10:21 PM: --

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707467#comment-13707467 ] Andrew Wang commented on HDFS-4949: --- Sanjay, thanks for your comments! I need to look

[jira] [Updated] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-07-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4985: Assignee: Arpit Agarwal Add storage type to the protocol and expose it in block report and

[jira] [Created] (HDFS-4989) Balancer needs to consider storage type in balancing

2013-07-12 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4989: - Summary: Balancer needs to consider storage type in balancing Key: HDFS-4989 URL: https://issues.apache.org/jira/browse/HDFS-4989 Project: Hadoop HDFS

[jira] [Created] (HDFS-4990) Block placement for storage types

2013-07-12 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4990: - Summary: Block placement for storage types Key: HDFS-4990 URL: https://issues.apache.org/jira/browse/HDFS-4990 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-4942) Add retry cache support in Namenode

2013-07-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707492#comment-13707492 ] Konstantin Shvachko commented on HDFS-4942: --- I was thinking about it and I feel

[jira] [Updated] (HDFS-4968) Provide configuration option for FileSystem symlink resolution

2013-07-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4968: -- Attachment: hdfs-4968-2.patch Add license header Provide configuration option for

[jira] [Commented] (HDFS-2461) Support HDFS file name globbing in libhdfs

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707494#comment-13707494 ] Colin Patrick McCabe commented on HDFS-2461: there is already a libc method

[jira] [Resolved] (HDFS-1154) libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-1154. Resolution: Duplicate This was fixed in HDFS-3579. In that JIRA, we decided that

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-07-12 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707509#comment-13707509 ] Andrew Purtell commented on HDFS-4672: -- bq. Given poorly toned comments on HDFS-2832

[jira] [Commented] (HDFS-4672) Support tiered storage policies

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707530#comment-13707530 ] Suresh Srinivas commented on HDFS-4672: --- bq. Today the scope of HDFS-2832 was widened

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707536#comment-13707536 ] Suresh Srinivas commented on HDFS-4949: --- bq. However, tiered storage management

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707546#comment-13707546 ] Todd Lipcon commented on HDFS-4949: --- Hey folks. I agree that HSM is a much bigger task

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707559#comment-13707559 ] Hadoop QA commented on HDFS-4953: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4953: --- Attachment: HDFS-4953.002.patch * add support to libhdfs * some logging fixes *

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707566#comment-13707566 ] Vinod Kumar Vavilapalli commented on HDFS-4953: --- I guess it should be called

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707572#comment-13707572 ] Suresh Srinivas commented on HDFS-4949: --- The problem for partical cache is though,

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707573#comment-13707573 ] Colin Patrick McCabe commented on HDFS-4953: well... zero copy for remote

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-07-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707576#comment-13707576 ] Todd Lipcon commented on HDFS-4949: --- Yes, I think the explicit caching policies would

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4953: -- Attachment: benchmark.png Attached a benchmark plot I did in support of this work. The benchmark times

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707587#comment-13707587 ] Todd Lipcon commented on HDFS-4953: --- Oh, one other note about the benchmark graphs: you

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707589#comment-13707589 ] Hadoop QA commented on HDFS-4953: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4968) Provide configuration option for FileSystem symlink resolution

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707591#comment-13707591 ] Hadoop QA commented on HDFS-4968: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4849) Enable retries for create and append operations.

2013-07-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4849: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) As discussed at

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-07-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13707639#comment-13707639 ] Hadoop QA commented on HDFS-4953: - {color:red}-1 overall{color}. Here are the results of