[jira] [Updated] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-7875: Attachment: 0003-HDFS-7875.patch Improve log message when wrong value configured for

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352836#comment-14352836 ] Hudson commented on HDFS-7857: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #127 (See

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352834#comment-14352834 ] Hudson commented on HDFS-7411: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #127 (See

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352856#comment-14352856 ] Hudson commented on HDFS-7411: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #861 (See

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352858#comment-14352858 ] Hudson commented on HDFS-7857: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #861 (See

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352979#comment-14352979 ] Yi Liu commented on HDFS-7844: -- I think you can also address my new comments in following-on

[jira] [Updated] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-7875: Attachment: (was: 0003-HDFS-7875.patch) Improve log message when wrong value configured for

[jira] [Updated] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated HDFS-7875: Attachment: 0003-HDFS-7875.patch Updated for the comments. sorry for the simple mistake :) Improve log message

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352946#comment-14352946 ] Yi Liu commented on HDFS-7886: -- Thanks Konst for the detailed analyzing, also thanks Plamen.

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-09 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Status: Open (was: Patch Available) Code clean up for LocatedBlock

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-09 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Status: Patch Available (was: Open) Code clean up for LocatedBlock

[jira] [Updated] (HDFS-3325) When configuring dfs.namenode.safemode.threshold-pct to a value greater or equal to 1 there is mismatch in the UI report

2015-03-09 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-3325: - Attachment: HDFS-3325.1.patch Hi Brandon Li, I have attached a patch for this and assigned the issue to

[jira] [Assigned] (HDFS-3325) When configuring dfs.namenode.safemode.threshold-pct to a value greater or equal to 1 there is mismatch in the UI report

2015-03-09 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina reassigned HDFS-3325: Assignee: J.Andreina (was: Brandon Li) When configuring dfs.namenode.safemode.threshold-pct to a

[jira] [Comment Edited] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352946#comment-14352946 ] Yi Liu edited comment on HDFS-7886 at 3/9/15 1:05 PM: -- Thanks Konst

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-09 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Attachment: (was: HDFS-7829.2.patch) Code clean up for LocatedBlock

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-09 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Attachment: HDFS-7829.2.patch Code clean up for LocatedBlock --

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352830#comment-14352830 ] Hadoop QA commented on HDFS-7884: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-09 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352828#comment-14352828 ] nijel commented on HDFS-7875: - Build failure looks like not related to patch *cp: cannot stat

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352975#comment-14352975 ] Yi Liu commented on HDFS-7844: -- Thanks Colin for addressing the comments, it's cool and only

[jira] [Updated] (HDFS-7884) NullPointerException in BlockSender

2015-03-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7884: --- Status: Patch Available (was: Open) NullPointerException in BlockSender

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352826#comment-14352826 ] Brahma Reddy Battula commented on HDFS-7884: Thanks a lot for your detailed

[jira] [Updated] (HDFS-7884) NullPointerException in BlockSender

2015-03-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7884: --- Attachment: HDFS-7884.patch NullPointerException in BlockSender

[jira] [Commented] (HDFS-7875) Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352827#comment-14352827 ] Hadoop QA commented on HDFS-7875: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352862#comment-14352862 ] Hudson commented on HDFS-7411: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2059 (See

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352864#comment-14352864 ] Hudson commented on HDFS-7857: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2059 (See

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353028#comment-14353028 ] Hadoop QA commented on HDFS-7884: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353128#comment-14353128 ] Hudson commented on HDFS-7857: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2077 (See

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353126#comment-14353126 ] Hudson commented on HDFS-7411: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2077 (See

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353070#comment-14353070 ] Hudson commented on HDFS-7411: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353072#comment-14353072 ] Hudson commented on HDFS-7857: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #118 (See

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353086#comment-14353086 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353029#comment-14353029 ] Vinayakumar B commented on HDFS-7884: - I think some problem with the cleaning of the

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353073#comment-14353073 ] Hadoop QA commented on HDFS-7829: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353094#comment-14353094 ] Hudson commented on HDFS-7411: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #127 (See

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353096#comment-14353096 ] Hudson commented on HDFS-7857: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #127 (See

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353289#comment-14353289 ] Zhe Zhang commented on HDFS-7837: - HDFS-7411 has renamed and refactored

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353270#comment-14353270 ] Andrew Wang commented on HDFS-7411: --- Glad to see this committed, thanks Chris for the

[jira] [Commented] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353249#comment-14353249 ] Zhe Zhang commented on HDFS-7853: - Thanks Jing. There were some non-trivial conflicts when

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353294#comment-14353294 ] Hudson commented on HDFS-7898: -- FAILURE: Integrated in Hadoop-trunk-Commit #7287 (See

[jira] [Commented] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353264#comment-14353264 ] Jing Zhao commented on HDFS-7853: - Sure. Thanks a lot Zhe! Erasure coding: extend

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353297#comment-14353297 ] Jing Zhao commented on HDFS-7837: - Sure. Let me try to resolve the conflicts in the 7285

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353290#comment-14353290 ] Jing Zhao commented on HDFS-7068: - Hi [~walter.k.su], now Jenkins can only test against

[jira] [Created] (HDFS-7905) Refactor the checking the minimum replication logic in BlockManager

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7905: --- Summary: Refactor the checking the minimum replication logic in BlockManager Key: HDFS-7905 URL: https://issues.apache.org/jira/browse/HDFS-7905 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353262#comment-14353262 ] Jing Zhao commented on HDFS-7898: - +1. With the change we can now detect issue like

[jira] [Updated] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7898: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353579#comment-14353579 ] Sergey Shelukhin commented on HDFS-7878: ping? API - expose an unique file

[jira] [Updated] (HDFS-7908) Use larger value for fs.s3a.connection.timeout and change the unit to seconds.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7908: Status: Patch Available (was: Open) Use larger value for fs.s3a.connection.timeout and change the

[jira] [Commented] (HDFS-7908) Use larger value for fs.s3a.connection.timeout and change the unit to seconds.

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353611#comment-14353611 ] Hadoop QA commented on HDFS-7908: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353610#comment-14353610 ] Jing Zhao commented on HDFS-7829: - Thanks Takanobu. The current patch looks good to me. My

[jira] [Updated] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7722: Attachment: HDFS-7722.003.patch Thanks a lot for the comments, [~cnauroth]! bq. but I actually

[jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm

2015-03-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353702#comment-14353702 ] Zhe Zhang commented on HDFS-7715: - Some questions from understanding the current Hitchhiker

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1172: --- Fix Version/s: (was: 0.24.0) Blocks in newly completed files are considered

[jira] [Updated] (HDFS-1805) Some Tests in TestDFSShell can not shutdown the MiniDFSCluster on any exception/assertion failure. This will leads to fail other testcases.

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1805: --- Issue Type: Test (was: Bug) Some Tests in TestDFSShell can not shutdown the MiniDFSCluster

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2070: --- Fix Version/s: (was: 0.24.0) A lack of auto-test for FsShell getmerge in hdfs

[jira] [Updated] (HDFS-7847) Write a junit test to simulate a heavy BlockManager load

2015-03-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7847: Attachment: make_blocks.tar.gz Hi [~clamb], I have attached a couple of rudimentary scripts I used

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353555#comment-14353555 ] Lei (Eddy) Xu commented on HDFS-7830: - The failure is due to errors on jenkins server.

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353649#comment-14353649 ] Hadoop QA commented on HDFS-7722: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353698#comment-14353698 ] Hadoop QA commented on HDFS-7722: - {color:red}-1 overall{color}. Here are the results of

[jira] [Resolved] (HDFS-2224) The libhdfs test is broken

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-2224. Resolution: Fixed stale The libhdfs test is broken --

[jira] [Updated] (HDFS-1805) Some Tests in TestDFSShell can not shutdown the MiniDFSCluster on any exception/assertion failure. This will leads to fail other testcases.

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1805: --- Fix Version/s: (was: 0.24.0) Some Tests in TestDFSShell can not shutdown the

[jira] [Updated] (HDFS-2094) Add metrics for write pipeline failures

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2094: --- Fix Version/s: (was: 0.24.0) Add metrics for write pipeline failures

[jira] [Updated] (HDFS-2224) The libhdfs test is broken

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2224: --- Fix Version/s: (was: 0.24.0) The libhdfs test is broken --

[jira] [Updated] (HDFS-7908) Use larger value for fs.s3a.connection.timeout and change the unit to seconds.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7908: Attachment: HDFS-7908.000.patch Use larger value for fs.s3a.connection.timeout and change the unit

[jira] [Commented] (HDFS-5823) Document async audit logging

2015-03-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353731#comment-14353731 ] Benoy Antony commented on HDFS-5823: [~daryn] Is the async audit log feature feature

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353605#comment-14353605 ] Chris Nauroth commented on HDFS-7722: - Eddy, it looks good. I have just one minor nit.

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353672#comment-14353672 ] Lei (Eddy) Xu commented on HDFS-7877: - Hey [~mingma] Thanks a lot for working on this.

[jira] [Updated] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7722: Hadoop Flags: Reviewed +1 for the patch from me. It looks like this version addresses Colin's last

[jira] [Updated] (HDFS-1558) Optimize FSNamesystem.startFileInternal

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1558: --- Fix Version/s: (was: 0.24.0) Optimize FSNamesystem.startFileInternal

[jira] [Updated] (HDFS-898) Sequential generation of block ids

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-898: -- Fix Version/s: (was: 0.24.0) Sequential generation of block ids

[jira] [Created] (HDFS-7908) Use larger value for fs.s3a.connection.timeout and change the unit to seconds.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7908: --- Summary: Use larger value for fs.s3a.connection.timeout and change the unit to seconds. Key: HDFS-7908 URL: https://issues.apache.org/jira/browse/HDFS-7908 Project:

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353616#comment-14353616 ] Jing Zhao commented on HDFS-7878: - We also need a full javadoc for the new API. other than

[jira] [Commented] (HDFS-7893) Update the POM to create a separate hdfs-client jar

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353728#comment-14353728 ] Hadoop QA commented on HDFS-7893: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2070: --- Issue Type: Test (was: Improvement) A lack of auto-test for FsShell getmerge in hdfs

[jira] [Updated] (HDFS-2605) CHANGES.txt has two Release 0.21.1 sections

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2605: --- Fix Version/s: (was: 0.24.0) CHANGES.txt has two Release 0.21.1 sections

[jira] [Resolved] (HDFS-2605) CHANGES.txt has two Release 0.21.1 sections

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-2605. Resolution: Fixed stale CHANGES.txt has two Release 0.21.1 sections

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353386#comment-14353386 ] Charles Lamb commented on HDFS-7836: JOIN WEBEX MEETING

[jira] [Commented] (HDFS-7838) Expose truncate API for libhdfs

2015-03-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353421#comment-14353421 ] Colin Patrick McCabe commented on HDFS-7838: FileSystem.java says: {code} *

[jira] [Updated] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7830: Attachment: HDFS-7830.001.patch [~cmccabe] Thanks for the reviews. I updated the patch to address

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353531#comment-14353531 ] Jing Zhao commented on HDFS-7837: - I just resolved the conflicts and merged the trunk into

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-03-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7758: Attachment: HDFS-7758.002.patch Updated the patch to use a {{ReferredFsVolumeList}} to replace

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353396#comment-14353396 ] Colin Patrick McCabe commented on HDFS-7830: {code} 108 } finally { 109

[jira] [Created] (HDFS-7906) BlockReport of a RUR can have a FINALIZED original replica from Truncate

2015-03-09 Thread Plamen Jeliazkov (JIRA)
Plamen Jeliazkov created HDFS-7906: -- Summary: BlockReport of a RUR can have a FINALIZED original replica from Truncate Key: HDFS-7906 URL: https://issues.apache.org/jira/browse/HDFS-7906 Project:

[jira] [Created] (HDFS-7907) Update DecommissionManager to support striped blocks

2015-03-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7907: --- Summary: Update DecommissionManager to support striped blocks Key: HDFS-7907 URL: https://issues.apache.org/jira/browse/HDFS-7907 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-7905) Refactor the checking the minimum replication logic in BlockManager

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7905. - Resolution: Won't Fix Looks like instead of doing this refactoring in trunk, it is easier to keep the

[jira] [Updated] (HDFS-7906) BlockReport of a RUR can have a FINALIZED original replica from Truncate

2015-03-09 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-7906: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-7886) BlockReport of a RUR

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-09 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353400#comment-14353400 ] Plamen Jeliazkov commented on HDFS-7886: Hi Yi, I understand the problem a little

[jira] [Comment Edited] (HDFS-7847) Write a junit test to simulate a heavy BlockManager load

2015-03-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353434#comment-14353434 ] Arpit Agarwal edited comment on HDFS-7847 at 3/9/15 7:24 PM: -

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353455#comment-14353455 ] Charles Lamb commented on HDFS-7836: If you are planning on attending the meeting

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353517#comment-14353517 ] Kihwal Lee commented on HDFS-7894: -- I think you have to put the jira state to patch

[jira] [Commented] (HDFS-7830) DataNode does not release the volume lock when adding a volume fails.

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353523#comment-14353523 ] Hadoop QA commented on HDFS-7830: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353380#comment-14353380 ] Jing Zhao commented on HDFS-7837: - Looks like we need more work in the new

[jira] [Assigned] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-09 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov reassigned HDFS-7903: -- Assignee: Plamen Jeliazkov Cannot recover block after truncate and delete snapshot

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353776#comment-14353776 ] Jing Zhao commented on HDFS-7878: - Thanks for the comments, Colin. bq. What if the file is

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-09 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353783#comment-14353783 ] Plamen Jeliazkov commented on HDFS-7903: Hi Nicholas, I ran your patch locally and

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353791#comment-14353791 ] Colin Patrick McCabe commented on HDFS-7844: bq. Stack wrote: High level, any

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

2015-03-09 Thread Ryan Sasson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353889#comment-14353889 ] Ryan Sasson commented on HDFS-5796: --- It appears that HADOOP-10709 will not fix this

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353892#comment-14353892 ] Colin Patrick McCabe commented on HDFS-7847: DFSClient.java: this change adds

[jira] [Commented] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353931#comment-14353931 ] Zhe Zhang commented on HDFS-7853: - Thanks Jing. The 002 patch looks good to me. +1 for

[jira] [Resolved] (HDFS-7853) Erasure coding: extend LocatedBlocks to support reading from striped files

2015-03-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7853. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this.

[jira] [Assigned] (HDFS-7911) Buffer Overflow when running HBase on HDFS Encryption Zone

2015-03-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7911: Assignee: Yi Liu Buffer Overflow when running HBase on HDFS Encryption Zone

  1   2   3   >