[jira] [Commented] (HDFS-7433) Optimize performance of DatanodeManager's node map

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357154#comment-14357154 ] Hadoop QA commented on HDFS-7433: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7433) Optimize performance of DatanodeManager's node map

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7433: -- Attachment: HDFS-7433.patch Rebased due to decomm manager rewrite. No tests, but the change is now

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

2015-03-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357168#comment-14357168 ] Xiaoyu Yao commented on HDFS-7491: -- Thanks Ming for the contribution. The patch v4 looks

[jira] [Updated] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6658: -- Attachment: HDFS-6658.patch Sorry, last minute change to revert code back to as close as possible to

[jira] [Commented] (HDFS-7880) Remove the tests for legacy Web UI in branch-2

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357097#comment-14357097 ] Brahma Reddy Battula commented on HDFS-7880: will I raise another issue for

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357016#comment-14357016 ] Hudson commented on HDFS-7830: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #129 (See

[jira] [Assigned] (HDFS-7873) OIV webhdfs premature close channel issue

2015-03-11 Thread Benoit Perroud (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Perroud reassigned HDFS-7873: Assignee: (was: Benoit Perroud) OIV webhdfs premature close channel issue

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357045#comment-14357045 ] Hudson commented on HDFS-7830: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2079 (See

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356996#comment-14356996 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7435: -- Attachment: HDFS-7435.patch Test failed because I stubbed the simulated dataset to not return reports...

[jira] [Commented] (HDFS-6576) Datanode log is generating at root directory in security mode

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357507#comment-14357507 ] Allen Wittenauer commented on HDFS-6576: Actually, this is fixed in trunk so only

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357538#comment-14357538 ] Vinod Kumar Vavilapalli commented on HDFS-7748: --- [~wheat9], should 2.7 stop

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

2015-03-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357653#comment-14357653 ] Hudson commented on HDFS-7491: -- FAILURE: Integrated in Hadoop-trunk-Commit #7305 (See

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-11 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357646#comment-14357646 ] Sergey Shelukhin commented on HDFS-7878: [~cmccabe] ping? API - expose an unique

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-11 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357561#comment-14357561 ] Ryan Sasson commented on HDFS-5796: --- [~asuresh], your ticket brings up an important point

[jira] [Updated] (HDFS-6576) Datanode log is generating at root directory in security mode

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6576: --- Component/s: scripts Datanode log is generating at root directory in security mode

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.002.patch I added the log message. The test should now fail

[jira] [Updated] (HDFS-7491) Add incremental blockreport latency to DN metrics

2015-03-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7491: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357635#comment-14357635 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357652#comment-14357652 ] Daryn Sharp commented on HDFS-7435: --- Tests are passing for me. The grumbling about edit

[jira] [Commented] (HDFS-7491) Add incremental blockreport latency to DN metrics

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357503#comment-14357503 ] Hadoop QA commented on HDFS-7491: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6964) NN fails to fix under replication leading to data loss

2015-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-6964: -- Target Version/s: (was: 2.7.0) Moving this out of 2.7 as I see no activity

[jira] [Commented] (HDFS-2745) unclear to users which command to use to access the filesystem

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357599#comment-14357599 ] Allen Wittenauer commented on HDFS-2745: There has been a lot of changes since

[jira] [Updated] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6658: -- Attachment: New primative indexes.jpg Old triplets.jpg Excuse my bad whiteboard drawing

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357661#comment-14357661 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357666#comment-14357666 ] Jing Zhao commented on HDFS-7435: - Thanks for updating the patch, Daryn. The latest patch

[jira] [Updated] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7913: --- Description: The wrong variable is deprecated in hdfs-config.sh. It should be HDFS_LOG_DIR,

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357383#comment-14357383 ] Brahma Reddy Battula commented on HDFS-7913: Here I got confused, which is from

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357626#comment-14357626 ] Haohui Mai commented on HDFS-7748: -- Will take care of it in a day or two. Separate ECN

[jira] [Updated] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-11 Thread Rashmi Vinayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rashmi Vinayak updated HDFS-7715: - Description: [Hitchhiker |

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357683#comment-14357683 ] Daryn Sharp commented on HDFS-6658: --- I've added many preconditions, not asserts, to avoid

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357693#comment-14357693 ] Chris Nauroth commented on HDFS-7915: - Thanks for the patch, Colin. The change looks

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357484#comment-14357484 ] Hadoop QA commented on HDFS-7435: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with +

2015-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357491#comment-14357491 ] Vinod Kumar Vavilapalli commented on HDFS-7816: --- Bump. [~daryn] / [~kihwal] /

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357318#comment-14357318 ] Allen Wittenauer commented on HDFS-7913: Oh! Wait a sec. Let me update the

[jira] [Commented] (HDFS-7820) Client Write fails after rolling upgrade rollback with block_id already exist in finalized state

2015-03-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357386#comment-14357386 ] Arpit Agarwal commented on HDFS-7820: - Increasing the epoch bits to 5 or 6 will permit

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357317#comment-14357317 ] Allen Wittenauer commented on HDFS-7913: We basically don't ship one because all

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357356#comment-14357356 ] Allen Wittenauer commented on HDFS-7913: That's the problem: HADOOP_HDFS_LOG_DIR

[jira] [Assigned] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-7913: -- Assignee: Allen Wittenauer (was: Brahma Reddy Battula) HADOOP_HDFS_LOG_DIR should be

[jira] [Commented] (HDFS-7873) OIV webhdfs premature close channel issue

2015-03-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357471#comment-14357471 ] Haohui Mai commented on HDFS-7873: -- Can you please format the code with the compliance of

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357324#comment-14357324 ] Yongjun Zhang commented on HDFS-7915: - Hi [~cmccabe], Thanks for reporting the issue

[jira] [Commented] (HDFS-5823) Document async audit logging

2015-03-11 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357338#comment-14357338 ] Benoy Antony commented on HDFS-5823: [~daryn] Can't I achieve the same by configuring

[jira] [Comment Edited] (HDFS-7820) Client Write fails after rolling upgrade rollback with block_id already exist in finalized state

2015-03-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357386#comment-14357386 ] Arpit Agarwal edited comment on HDFS-7820 at 3/11/15 6:53 PM: --

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357309#comment-14357309 ] Brahma Reddy Battula commented on HDFS-7913: Yes,, [~aw] can you please

[jira] [Updated] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7913: --- Attachment: HDFS-7913.patch HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in

[jira] [Work started] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7913 started by Brahma Reddy Battula. -- HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357500#comment-14357500 ] Vinod Kumar Vavilapalli commented on HDFS-7587: --- [~kihwal] / [~daryn] /

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-11 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.001.patch @cmccabe, @stack, thanks for the review! bq. DFSClient.java: this

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357864#comment-14357864 ] Brahma Reddy Battula commented on HDFS-7913: should we change HADOOP_MAPRED to

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357758#comment-14357758 ] Hadoop QA commented on HDFS-7722: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357784#comment-14357784 ] Andrew Wang commented on HDFS-7285: --- I think we could pack all of this into a single

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-11 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357797#comment-14357797 ] Kai Zheng commented on HDFS-7285: - Thanks [~zhz] for the great post. This documents

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357754#comment-14357754 ] Zhe Zhang commented on HDFS-7285: - We have been discussing how to fit EC with other storage

[jira] [Created] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

2015-03-11 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7917: --- Summary: Use file to replace data dirs in test to simulate a disk failure. Key: HDFS-7917 URL: https://issues.apache.org/jira/browse/HDFS-7917 Project: Hadoop HDFS

[jira] [Updated] (HDFS-2842) fuse-dfs fails to build from source on recent versions of Ubuntu

2015-03-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2842: --- Resolution: Unresolved Status: Resolved (was: Patch Available) stale fuse-dfs fails

[jira] [Commented] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357875#comment-14357875 ] Brahma Reddy Battula commented on HDFS-7261: [~cmccabe] Kindly review the patch

[jira] [Commented] (HDFS-7838) Expose truncate API for libhdfs

2015-03-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357879#comment-14357879 ] Yi Liu commented on HDFS-7838: -- {quote} +1 once those are addressed. {quote} Hi, [~cmccabe],

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357719#comment-14357719 ] Hadoop QA commented on HDFS-7435: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357734#comment-14357734 ] Jing Zhao commented on HDFS-7435: - nit-pick: # s/blocksBuffer/blocksBuf/ in the javadoc

[jira] [Assigned] (HDFS-7068) Support multiple block placement policies

2015-03-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-7068: --- Assignee: Zhe Zhang (was: Walter Su) Support multiple block placement policies

[jira] [Assigned] (HDFS-7068) Support multiple block placement policies

2015-03-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-7068: --- Assignee: Walter Su (was: Zhe Zhang) Sorry, I clicked wrong button Support multiple block

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357821#comment-14357821 ] Zhe Zhang commented on HDFS-7285: - [~andrew.wang] Thanks for the comment. I forgot to

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357832#comment-14357832 ] Jing Zhao commented on HDFS-7285: - Thanks for the summary, Zhe! One question for the EC

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357845#comment-14357845 ] Jing Zhao commented on HDFS-7068: - I'm also +1 for #1. Support multiple block placement

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357870#comment-14357870 ] Brahma Reddy Battula commented on HDFS-7894: sure, I will update soon..thanks!!

[jira] [Comment Edited] (HDFS-7838) Expose truncate API for libhdfs

2015-03-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357879#comment-14357879 ] Yi Liu edited comment on HDFS-7838 at 3/12/15 12:40 AM: {quote} +1

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357899#comment-14357899 ] Hadoop QA commented on HDFS-7915: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7880) Remove the tests for legacy Web UI in branch-2

2015-03-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357925#comment-14357925 ] Akira AJISAKA commented on HDFS-7880: - bq. will I raise another issue for this removal

[jira] [Updated] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-11 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7435: -- Attachment: HDFS-7435.patch Yes, older is with relation to the future NN. I tried to clarify it in this

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357747#comment-14357747 ] Yongjun Zhang commented on HDFS-7915: - Hi [~cmccabe], Thanks for the updated patch,

[jira] [Commented] (HDFS-7369) Erasure coding: distribute block recovery work to DataNode

2015-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357774#comment-14357774 ] Jing Zhao commented on HDFS-7369: - Thanks for working on this, Zhe! The patch looks good to

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1435#comment-1435 ] Hadoop QA commented on HDFS-7722: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357806#comment-14357806 ] Zhe Zhang commented on HDFS-7068: - Very good thoughts [~walter.k.su]! And thanks Kai for

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357877#comment-14357877 ] Yi Liu commented on HDFS-7886: -- Yes Konst, I agree with you, thanks.

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-11 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7864: -- Attachment: HDFS-7864.2.patch safemode calculation has been modified for stripedBlock by checking wether the

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356413#comment-14356413 ] Rakesh R commented on HDFS-5356: Thanks [~cmccabe] for the explanation and helps to

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-11 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356421#comment-14356421 ] GAO Rui commented on HDFS-7864: --- [~jingzhao] Thanks for your comment, I have update a new

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-11 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7864: -- Status: Patch Available (was: Open) Erasure Coding: Update safemode calculation for striped blocks

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356440#comment-14356440 ] Vinayakumar B commented on HDFS-5356: - Hi [~rakeshr], thanks for the patch. Here are

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5356: --- Attachment: HDFS-5356-4.patch MiniDFSCluster shoud close all open FileSystems when shutdown()

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.001.patch Fix up the error handling in DataXceiver. A nested

[jira] [Issue Comment Deleted] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5356: Comment: was deleted (was: Hi [~rakeshr], thanks for the patch. Here are some comments. Here need

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356369#comment-14356369 ] Hadoop QA commented on HDFS-7864: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.001.patch The DataNode can sometimes allocate a ShortCircuitShm

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Status: Patch Available (was: Open) The DataNode can sometimes allocate a

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: (was: HDFS-7915.001.patch) The DataNode can sometimes allocate a

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356375#comment-14356375 ] Ming Ma commented on HDFS-7877: --- Thanks Eddy for the review and suggestions. Please find my

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356374#comment-14356374 ] Arun Suresh commented on HDFS-5796: --- Also, please consider using HADOOP-11702, which

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356370#comment-14356370 ] Arun Suresh commented on HDFS-5796: --- bq. I'm actually inclined to say no, since the

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356690#comment-14356690 ] Hadoop QA commented on HDFS-5356: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7916: Status: Patch Available (was: Open) 'reportBadBlocks' from datanodes to standby Node

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356724#comment-14356724 ] Rakesh R commented on HDFS-5356: Attached new patch addressing [~vinayrpet]'s comments.

[jira] [Commented] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356726#comment-14356726 ] Vinayakumar B commented on HDFS-7913: - I dont see any hdfs-env.sh in trunk. Will it be

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356687#comment-14356687 ] Vinayakumar B commented on HDFS-5356: - bq. It is failing when comparing

[jira] [Updated] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5356: --- Attachment: HDFS-5356-5.patch MiniDFSCluster shoud close all open FileSystems when shutdown()

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356696#comment-14356696 ] Rakesh R commented on HDFS-5356: OK. Do you agree to go ahead with the changes in

[jira] [Created] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-03-11 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-7916: --- Summary: 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop Key: HDFS-7916 URL: https://issues.apache.org/jira/browse/HDFS-7916

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356703#comment-14356703 ] Vinayakumar B commented on HDFS-5356: - Yes sure. MiniDFSCluster shoud close all open

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356698#comment-14356698 ] Vinayakumar B commented on HDFS-7916: - {{BPServiceActor#processQueueMessages()}} tries

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-03-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7916: Attachment: HDFS-7916-01.patch Attaching the patch for the same. 'reportBadBlocks' from datanodes

  1   2   >