[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961186#comment-14961186 ] Arpit Agarwal commented on HDFS-9254: - The test failures do seem to be caused by my patch, oddly. I'll

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961048#comment-14961048 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #542 (See

[jira] [Created] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

2015-10-16 Thread Rakesh R (JIRA)
Rakesh R created HDFS-9261: -- Summary: Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group Key: HDFS-9261 URL:

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-7435.002.patch Merged with latest head > Improve performance and GC

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961226#comment-14961226 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2443 (See

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS Block and Replica Management 20151013.pdf > Improve performance and GC

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961132#comment-14961132 ] Hadoop QA commented on HDFS-9208: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961217#comment-14961217 ] Haohui Mai commented on HDFS-8766: -- Thanks for updating the patch. Some comments: 1. Remove {[hdfs.h}},

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961110#comment-14961110 ] Mingliang Liu commented on HDFS-9129: - The failing tests can pass locally. Addressing the findbugs and

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961227#comment-14961227 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2443 (See

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961242#comment-14961242 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2492 (See

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961091#comment-14961091 ] Mingliang Liu commented on HDFS-9259: - Hi [~mingma], can I work on this, if we reach consensus on the

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9260: Assignee: Staffan Friberg > Improve performance and GC friendliness of startup and FBRs >

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9252: Summary: Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Component/s: erasure-coding > Erasure coding: emulate race conditions among striped streamers in write >

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Affects Version/s: 3.0.0 > Erasure coding: emulate race conditions among striped streamers in write >

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961210#comment-14961210 ] Hadoop QA commented on HDFS-9255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961221#comment-14961221 ] Hadoop QA commented on HDFS-9249: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.002.patch Attaching rev2. This patch adds a test case that verifies the

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9208: - Target Version/s: 2.8.0 Status: Patch Available (was: Open) > Disabling atime may fail

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS Block and Replica Management 20151013.pdf > Improve performance and GC

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: (was: HDFS Block and Replica Management 20151013.pdf) > Improve performance and

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961049#comment-14961049 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #542 (See

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961086#comment-14961086 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2491 (See

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961087#comment-14961087 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2491 (See

[jira] [Updated] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9253: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Comment Edited] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961182#comment-14961182 ] Haohui Mai edited comment on HDFS-9253 at 10/16/15 6:42 PM: I've committed the

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961317#comment-14961317 ] Hudson commented on HDFS-9257: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #506 (See

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961301#comment-14961301 ] Hudson commented on HDFS-9253: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #558 (See

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961316#comment-14961316 ] Hudson commented on HDFS-9205: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #506 (See

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Description: This is to reconfigure {code} dfs.datanode.lazywriter.interval.sec {code} without

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Description: This is to reconfigure dfs.datanode.lazywriter.interval.sec without restarting DN. >

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Affects Version/s: 2.7.0 > Reconfigure lazy writer interval on the fly >

[jira] [Updated] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9259: -- Assignee: Mingliang Liu Thanks [~liuml07]! I have assigned it to you. > Make SO_SNDBUF size configurable at

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961279#comment-14961279 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #543 (See

[jira] [Updated] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9259: -- Description: We recently found that cross-DC hdfs write could be really slow. Further investigation identified

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961338#comment-14961338 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1279 (See

[jira] [Commented] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961358#comment-14961358 ] Li Lu commented on HDFS-9245: - Yes I think using volatile here is appropriate. Findbugs also turned green for

[jira] [Created] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9262: --- Summary: Reconfigure lazy writer interval on the fly Key: HDFS-9262 URL: https://issues.apache.org/jira/browse/HDFS-9262 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961413#comment-14961413 ] Mingliang Liu commented on HDFS-9184: - The failing tests seem unrelated and can pass locally (Gentoo

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960263#comment-14960263 ] Hadoop QA commented on HDFS-9129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287.12.patch > DFSStripedOutputStream.writeChunk should not wait for writing parity >

[jira] [Updated] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9255: Attachment: HDFS-9255.01.patch > Consolidate block recovery related implementation into a single class >

[jira] [Updated] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9255: Status: Patch Available (was: Open) > Consolidate block recovery related implementation into a single class

[jira] [Created] (HDFS-9256) Erasure Coding: Improve failure handling of ECWorker striped block reconstruction

2015-10-16 Thread Rakesh R (JIRA)
Rakesh R created HDFS-9256: -- Summary: Erasure Coding: Improve failure handling of ECWorker striped block reconstruction Key: HDFS-9256 URL: https://issues.apache.org/jira/browse/HDFS-9256 Project: Hadoop

[jira] [Resolved] (HDFS-8398) Erasure Coding: Correctly calculate last striped block length in DFSStripedInputStream if it's under construction.

2015-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8398. -- Resolution: Duplicate > Erasure Coding: Correctly calculate last striped block length in >

[jira] [Created] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-16 Thread Walter Su (JIRA)
Walter Su created HDFS-9255: --- Summary: Consolidate block recovery related implementation into a single class Key: HDFS-9255 URL: https://issues.apache.org/jira/browse/HDFS-9255 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960284#comment-14960284 ] Hadoop QA commented on HDFS-9254: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

DFSClient got deadlock when close file and failed to renew lease

2015-10-16 Thread 邓飞
Hi,All We found a deadlock at our HBase(0.98) cluster(and the Hadoop Version is 2.2.0),and it should be HDFS BUG,at the time our network is not stable. below is the stack:

[jira] [Resolved] (HDFS-8059) Erasure coding: revisit how to store EC schema and cellSize in NameNode

2015-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8059. -- Resolution: Duplicate > Erasure coding: revisit how to store EC schema and cellSize in NameNode >

[jira] [Comment Edited] (HDFS-7964) Add support for async edit logging

2015-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960114#comment-14960114 ] Yi Liu edited comment on HDFS-7964 at 10/16/15 6:40 AM: Thanks [~daryn] for the

[jira] [Resolved] (HDFS-8087) Erasure Coding: Add more EC zone management APIs (get/list EC zone(s))

2015-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8087. -- Resolution: Invalid Now, getErasureCodingPolicies and getErasureCodingPolicy are implemented, so close it as

[jira] [Resolved] (HDFS-8376) Erasure Coding: Update last cellsize calculation according to whether the erasure codec has chunk boundary

2015-10-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HDFS-8376. -- Resolution: Invalid > Erasure Coding: Update last cellsize calculation according to whether the > erasure codec

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960230#comment-14960230 ] Jing Zhao commented on HDFS-9129: - Thanks for the work, Mingliang! Glad to hear that finally we're allowed

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960369#comment-14960369 ] Kai Sasaki commented on HDFS-8287: -- Thank you for letting me know. I rebased on trunk. >

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960427#comment-14960427 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960395#comment-14960395 ] Hadoop QA commented on HDFS-9255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960391#comment-14960391 ] Steve Loughran commented on HDFS-9249: -- Wei, in preparing for the next CDH release, you don't

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9249: - Affects Version/s: 2.7.1 Component/s: namenode > NPE thrown if an IOException is thrown

[jira] [Updated] (HDFS-8630) WebHDFS : Support get/setStoragePolicy

2015-10-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8630: - Attachment: HDFS-8630.005.patch Fixed second comment for

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Status: Open (was: Patch Available) > Allow fsck display pending replica location information for being-written

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Attachment: HDFS-9070-trunk.06.patch Hi [~jingzhao], [~andreina]. I have attached a new patch

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Status: Patch Available (was: Open) > Allow fsck display pending replica location information for being-written

[jira] [Updated] (HDFS-9255) Consolidate block recovery related implementation into a single class

2015-10-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9255: Attachment: HDFS-9255.02.patch > Consolidate block recovery related implementation into a single class >

[jira] [Commented] (HDFS-8650) Erasure Coding: use thread pool for StripedDataStreamer

2015-10-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960542#comment-14960542 ] GAO Rui commented on HDFS-8650: --- Hi [~walter.k.su], I'll try to work on this issue. Do you have any initial

[jira] [Created] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Marcell Szabo (JIRA)
Marcell Szabo created HDFS-9257: --- Summary: improve error message for "Absolute path required" in INode.java to contain the rejected path Key: HDFS-9257 URL: https://issues.apache.org/jira/browse/HDFS-9257

[jira] [Assigned] (HDFS-8650) Erasure Coding: use thread pool for StripedDataStreamer

2015-10-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui reassigned HDFS-8650: - Assignee: GAO Rui > Erasure Coding: use thread pool for StripedDataStreamer >

[jira] [Updated] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Marcell Szabo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcell Szabo updated HDFS-9257: Attachment: HDFS-9257.000.patch > improve error message for "Absolute path required" in INode.java

[jira] [Commented] (HDFS-8630) WebHDFS : Support get/setStoragePolicy

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960533#comment-14960533 ] Hadoop QA commented on HDFS-8630: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960552#comment-14960552 ] Brahma Reddy Battula commented on HDFS-8647: {{TestBalancer}} fails on specific machines where

[jira] [Updated] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Marcell Szabo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcell Szabo updated HDFS-9257: Status: Patch Available (was: Open) > improve error message for "Absolute path required" in

[jira] [Commented] (HDFS-8880) NameNode metrics logging

2015-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960683#comment-14960683 ] Steve Loughran commented on HDFS-8880: -- I'd be in favour of improving our own general metrics sinks,

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960660#comment-14960660 ] Wei-Chiu Chuang commented on HDFS-9249: --- Hi [~steve_l], thanks for the long and detailed guideline :)

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960721#comment-14960721 ] Daryn Sharp commented on HDFS-7964: --- # The thread is the only one calling the real logEdit so the lastest

[jira] [Assigned] (HDFS-9258) NN should indicate which nodes are stale

2015-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-9258: - Assignee: Kuhu Shukla > NN should indicate which nodes are stale >

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960884#comment-14960884 ] Rakesh R commented on HDFS-8287: Thank you [~kaisasak] for taking care this, latest patch mostly looks fine

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960901#comment-14960901 ] Arpit Agarwal commented on HDFS-9254: - Documentation-only patch, needs no new tests. Test failures are

[jira] [Created] (HDFS-9258) NN should indicate which nodes are stale

2015-10-16 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9258: - Summary: NN should indicate which nodes are stale Key: HDFS-9258 URL: https://issues.apache.org/jira/browse/HDFS-9258 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960854#comment-14960854 ] Harsh J commented on HDFS-9257: --- +1, failed tests are unrelated. Tests shouldn't be necessary for the trivial

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960870#comment-14960870 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-trunk-Commit #8650 (See

[jira] [Updated] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-9257: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960879#comment-14960879 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-trunk-Commit #8651 (See

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960776#comment-14960776 ] Kihwal Lee commented on HDFS-9239: -- It may not help much with the namenode side. Even on extremely busy

[jira] [Comment Edited] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960776#comment-14960776 ] Kihwal Lee edited comment on HDFS-9239 at 10/16/15 2:24 PM: It may not help

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

2015-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960788#comment-14960788 ] Hadoop QA commented on HDFS-9257: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

2015-10-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960823#comment-14960823 ] Ming Ma commented on HDFS-8898: --- Thanks [~kihwal]! I will update the patch with new unit tests. > Create API

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960785#comment-14960785 ] Steve Loughran commented on HDFS-9241: -- One other thing to consider is "would we expect thin clients

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960775#comment-14960775 ] Steve Loughran commented on HDFS-9249: -- don't worry about being new: welcome to the fun of debugging

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9208: - Attachment: HDFS-9208.patch The {{setTimes()}} call through {{getBlockLocations()}} does not force update,

[jira] [Created] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-16 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9259: - Summary: Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario Key: HDFS-9259 URL: https://issues.apache.org/jira/browse/HDFS-9259 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-16 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961543#comment-14961543 ] Tony Wu commented on HDFS-9236: --- checksyle and pre-patch error are not related to this patch. > Missing

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961557#comment-14961557 ] Mingliang Liu commented on HDFS-9241: - {quote} Old applications can still depend on hadoop-hdfs and

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-16 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961574#comment-14961574 ] Daniel Dai commented on HDFS-9184: -- If we want to impose a limitation on the length, it is better to

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961593#comment-14961593 ] Jing Zhao commented on HDFS-7964: - Thanks for rebasing the patch, Daryn. The patch looks good to me. Some

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Description: This patch changes the datastructures used for BlockInfos and Replicas to keep

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961530#comment-14961530 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2444 (See

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-16 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961540#comment-14961540 ] Jitendra Nath Pandey commented on HDFS-9239: bq. .. Well before node liveness is affected by

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-16 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961480#comment-14961480 ] Jitendra Nath Pandey commented on HDFS-9184: I will commit it to trunk if there are no

[jira] [Commented] (HDFS-9230) Report space overhead of unfinalized upgrade/rollingUpgrade

2015-10-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961561#comment-14961561 ] Andrew Wang commented on HDFS-9230: --- For hardlink upgrades, you could check the link count to see if a

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-16 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-7435.003.patch Add null check when creating iterator of storages > Improve

  1   2   >