[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952704#comment-14952704 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-trunk-Commit #8609 (See

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952702#comment-14952702 ] Hadoop QA commented on HDFS-9139: - (!) A patch to the files used for the QA process has been detected.

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9221: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952741#comment-14952741 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-trunk-Commit #8610 (See

[jira] [Updated] (HDFS-9224) TestFileTruncate fails intermittently

2015-10-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9224: --- Attachment: HDFS-9224-002.patch Firstly let's try default port,if not free,try for

[jira] [Updated] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8988: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8492) DN should notify NN when client requests a missing block

2015-10-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8492: Attachment: HDFS-8492.01.patch Uploaded the patch. Thanks [~daryn] for reporting this. > DN should notify

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952790#comment-14952790 ] Hadoop QA commented on HDFS-9139: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8492) DN should notify NN when client requests a missing block

2015-10-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8492: Assignee: Walter Su Status: Patch Available (was: Open) > DN should notify NN when client requests a

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952751#comment-14952751 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #511 (See

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952749#comment-14952749 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #511 (See

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952784#comment-14952784 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2457 (See

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952782#comment-14952782 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2457 (See

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952724#comment-14952724 ] Yi Liu commented on HDFS-8988: -- Thanks [~umamaheswararao] for the review, the test failure are not related and

[jira] [Resolved] (HDFS-8426) Namenode shutdown for "ReplicationMonitor thread received Runtime exception"

2015-10-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8426. - Resolution: Cannot Reproduce > Namenode shutdown for "ReplicationMonitor thread received Runtime

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-10-12 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952895#comment-14952895 ] Kanaka Kumar Avvaru commented on HDFS-8836: --- Hi [~ajisakaa] I think it is reasonable to provide

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952817#comment-14952817 ] Hadoop QA commented on HDFS-9226: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952877#comment-14952877 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1249 (See

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952804#comment-14952804 ] Walter Su commented on HDFS-9079: - In 01 patch, {{DNFailureEvent}} is emitted by the failed streamer

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952888#comment-14952888 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2421 (See

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952893#comment-14952893 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #483 (See

[jira] [Commented] (HDFS-8492) DN should notify NN when client requests a missing block

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952921#comment-14952921 ] Hadoop QA commented on HDFS-8492: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Assigned] (HDFS-9152) Get input/output error while copying 800 small files to NFS Gateway mount point

2015-10-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-9152: - Assignee: Weiwei Yang > Get input/output error while copying 800 small files to NFS Gateway mount

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952805#comment-14952805 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1248 (See

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952838#comment-14952838 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #523 (See

[jira] [Commented] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952836#comment-14952836 ] Hudson commented on HDFS-9221: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #523 (See

[jira] [Created] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-12 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-9229: --- Summary: Expose size of NameNode directory as a metric Key: HDFS-9229 URL: https://issues.apache.org/jira/browse/HDFS-9229 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9119) Discrepancy between edit log tailing interval and RPC timeout for transitionToActive

2015-10-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9119: Attachment: HDFS-9119.00.patch > Discrepancy between edit log tailing interval and RPC timeout for >

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953238#comment-14953238 ] Hadoop QA commented on HDFS-9139: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9228) Retry failed NN requests

2015-10-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953270#comment-14953270 ] Arpit Agarwal commented on HDFS-9228: - Hi [~bobhansen], DFS client retry policies are configurable with

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953305#comment-14953305 ] Masatake Iwasaki commented on HDFS-9226: bq. There is no guard to keep someone from adding code

[jira] [Comment Edited] (HDFS-9228) Retry failed NN requests

2015-10-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953270#comment-14953270 ] Arpit Agarwal edited comment on HDFS-9228 at 10/12/15 4:22 PM: --- Hi

[jira] [Updated] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-1172: --- Attachment: HDFS-1172.014.patch attaching the same file again to kick jenkins. > Blocks in

[jira] [Commented] (HDFS-9224) TestFileTruncate fails intermittently

2015-10-12 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953253#comment-14953253 ] Brahma Reddy Battula commented on HDFS-9224: {{Test Case failures}} and {{Release Audit

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953290#comment-14953290 ] Masatake Iwasaki commented on HDFS-9226: Hmm... Though [test artifacts are intended to be

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953003#comment-14953003 ] Kai Sasaki commented on HDFS-8287: -- Thanks you [~szetszwo] so much. Is there any comment on this patch,

[jira] [Commented] (HDFS-9224) TestFileTruncate fails intermittently

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953048#comment-14953048 ] Hadoop QA commented on HDFS-9224: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953107#comment-14953107 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2422 (See

[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953117#comment-14953117 ] Hudson commented on HDFS-8988: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #484 (See

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953144#comment-14953144 ] Hadoop QA commented on HDFS-9139: - (!) A patch to the files used for the QA process has been detected.

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953151#comment-14953151 ] Vinayakumar B commented on HDFS-9139: - I think, from recent runs, parallel-test runs looks to be quite

[jira] [Resolved] (HDFS-8707) Implement an async pure c++ HDFS client

2015-10-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen resolved HDFS-8707. -- Resolution: Duplicate Let's roll the implementation of this into HDFS-9144 > Implement an async pure

[jira] [Reopened] (HDFS-8707) Implement an async pure c++ HDFS client

2015-10-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reopened HDFS-8707: -- Oops. Closed the wrong issue. > Implement an async pure c++ HDFS client >

[jira] [Created] (HDFS-9227) Check block checksums for integrity

2015-10-12 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9227: Summary: Check block checksums for integrity Key: HDFS-9227 URL: https://issues.apache.org/jira/browse/HDFS-9227 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9228) Retry failed NN requests

2015-10-12 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9228: Summary: Retry failed NN requests Key: HDFS-9228 URL: https://issues.apache.org/jira/browse/HDFS-9228 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9119) Discrepancy between edit log tailing interval and RPC timeout for transitionToActive

2015-10-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9119: Status: Patch Available (was: Open) Submitting initial patch to trigger Jenkins. Will add a new test in the

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953424#comment-14953424 ] James Clampffer commented on HDFS-9207: --- Looks like a pretty simple patch to me, just a couple

[jira] [Assigned] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-9229: Assignee: Surendra Singh Lilhore > Expose size of NameNode directory as a

[jira] [Updated] (HDFS-9167) Update pom.xml in other modules to depend on hdfs-client instead of hdfs

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9167: Status: Open (was: Patch Available) > Update pom.xml in other modules to depend on hdfs-client

[jira] [Updated] (HDFS-9167) Update pom.xml in other modules to depend on hdfs-client instead of hdfs

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9167: Status: Patch Available (was: Open) > Update pom.xml in other modules to depend on hdfs-client

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953464#comment-14953464 ] Haohui Mai commented on HDFS-9207: -- It'll be done via rebase. bq. Will there be a simple way to disable

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-10-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953483#comment-14953483 ] Rakesh R commented on HDFS-8941: Thank you [~andrew.wang] for reviewing and committing the patch! >

[jira] [Commented] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953388#comment-14953388 ] Zhe Zhang commented on HDFS-9229: - [~surendrasingh] Thanks for the interest in this issue! I haven't

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953475#comment-14953475 ] Anu Engineer commented on HDFS-4015: Release audit, checkstyle and test failures are not related to

[jira] [Commented] (HDFS-9229) Expose size of NameNode directory as a metric

2015-10-12 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953382#comment-14953382 ] Surendra Singh Lilhore commented on HDFS-9229: -- Please feel free to reassign if you started

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-10-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953493#comment-14953493 ] Yongjun Zhang commented on HDFS-7916: - Hi [~shahrs87] and [~vinayrpet], Thanks for your earlier work

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953510#comment-14953510 ] Bob Hansen commented on HDFS-9207: -- If we can have HDFS-8766 landed before we do the rebase, it will save

[jira] [Assigned] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-9117: Assignee: Bob Hansen > Config file reader / options classes for libhdfs++ >

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953604#comment-14953604 ] Hadoop QA commented on HDFS-1172: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953652#comment-14953652 ] Zhe Zhang commented on HDFS-9079: - Thanks for the comments Walter! It's a very good point that the current

[jira] [Commented] (HDFS-9119) Discrepancy between edit log tailing interval and RPC timeout for transitionToActive

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953672#comment-14953672 ] Hadoop QA commented on HDFS-9119: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser updated HDFS-9226: - Attachment: HDFS-9226.004.patch > MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils >

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953601#comment-14953601 ] Josh Elser commented on HDFS-9226: -- bq. The class name InternalDataNodeTestUtils is not clear because test

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953640#comment-14953640 ] Rushabh S Shah commented on HDFS-7916: -- [~yzhangal] {quote}We deployed this fix to one of our cluster

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9223: Attachment: HDFS-9223.001.patch Thanks for the review, Nicholas! Update patch to address your comments. Also

[jira] [Commented] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953715#comment-14953715 ] Jing Zhao commented on HDFS-9223: - For {{heartbeatCheck}}, currently the {{dead}} node object is retrieved

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953717#comment-14953717 ] Jing Zhao commented on HDFS-1172: - +1 for the 014 patch. I will commit it later today or early tomorrow if

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953725#comment-14953725 ] Haohui Mai commented on HDFS-9207: -- bq. If we can have HDFS-8766 landed before we do the rebase, it will

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-12 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-9184: --- Status: Open (was: Patch Available) > Logging HDFS operation's caller context into

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953734#comment-14953734 ] Haohui Mai commented on HDFS-9139: -- bq. I think its okay to commit current changes and fix further random

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-12 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-9184: --- Status: Patch Available (was: Open) > Logging HDFS operation's caller context into

[jira] [Updated] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9215: - Status: Patch Available (was: Reopened) > Suppress the RAT warnings in hdfs-native-client module >

[jira] [Updated] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9215: - Attachment: HDFS-9215.addendum.004.patch > Suppress the RAT warnings in hdfs-native-client module >

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953755#comment-14953755 ] Jing Zhao commented on HDFS-9145: - The patch looks good to me. One minor optional thing to do is to use a

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.005.patch Added basic error checking tests in gmock. They use

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953935#comment-14953935 ] Haohui Mai commented on HDFS-9215: -- Sorry for the typos in the earlier fixes. Thanks Andrew again for the

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953933#comment-14953933 ] Hadoop QA commented on HDFS-8766: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954156#comment-14954156 ] Jing Zhao commented on HDFS-8287: - I'm very sorry I missed this jira in my radar.. Could you please rebase

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954158#comment-14954158 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1251 (See

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client

2015-10-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954188#comment-14954188 ] Andrew Wang commented on HDFS-9170: --- Okay, if this just changing 2.8 to 2.6, let's get the trivial patch

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954199#comment-14954199 ] Hadoop QA commented on HDFS-9184: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.004.patch The v4 patch fixes the audit log format, separating the caller

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953998#comment-14953998 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-trunk-Commit #8613 (See

[jira] [Commented] (HDFS-9167) Update pom.xml in other modules to depend on hdfs-client instead of hdfs

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954020#comment-14954020 ] Mingliang Liu commented on HDFS-9167: - As I can run the "findbugs" locally and pass the unit tests, I

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.005.patch Thanks for your comment [~leftnoteasy]. it makes perfect sense to me

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954091#comment-14954091 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #514 (See

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954147#comment-14954147 ] Jing Zhao commented on HDFS-9205: - # Nit: need to fix the javadoc of {{UnderReplicatedBlocks}},

[jira] [Updated] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9145: Attachment: HDFS-9145.003.patch Thank you [~jingzhao] for your review. The v3 patch addresses the

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954169#comment-14954169 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #526 (See

[jira] [Commented] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954230#comment-14954230 ] Hadoop QA commented on HDFS-9226: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954235#comment-14954235 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

2015-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Attachment: HDFS-7087.002.patch > Ability to list /.reserved > -- > >

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953815#comment-14953815 ] Xiao Chen commented on HDFS-7087: - Thanks a lot Andrew for the review and comments! I have attached patch

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.003.patch The failing tests seem unrelated. While the "cancel patch" and

[jira] [Commented] (HDFS-9006) Provide BlockPlacementPolicy that supports upgrade domain

2015-10-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954023#comment-14954023 ] Ming Ma commented on HDFS-9006: --- Thanks [~eddyxu] and [~ctrezzo]! > Provide BlockPlacementPolicy that

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954187#comment-14954187 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2460 (See

[jira] [Commented] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954228#comment-14954228 ] Hadoop QA commented on HDFS-9223: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

2015-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Status: Open (was: Patch Available) > Ability to list /.reserved > -- > >

[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module

2015-10-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953786#comment-14953786 ] Andrew Wang commented on HDFS-9215: --- My earlier +1 was pending Jenkins, this is another +1 pending

[jira] [Commented] (HDFS-9167) Update pom.xml in other modules to depend on hdfs-client instead of hdfs

2015-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953970#comment-14953970 ] Hadoop QA commented on HDFS-9167: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

  1   2   >