[jira] [Updated] (HDFS-7663) Erasure Coding: Append on striped file

2015-09-29 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7663: Summary: Erasure Coding: Append on striped file (was: Erasure Coding: lease recovery / append on striped

[jira] [Commented] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934747#comment-14934747 ] Rakesh R commented on HDFS-9172: Great, that looks fine to me. > Erasure Coding: Move DFSStripedIO stream

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934768#comment-14934768 ] Uma Maheswara Rao G commented on HDFS-8859: --- Thanks Yi, +1 on the latest patch > Improve

[jira] [Updated] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2015-09-29 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8449: Attachment: HDFS-8449-002.patch reduce metrics number from 3 to 2. The count of failed tasks can be calculated by

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934693#comment-14934693 ] Rakesh R commented on HDFS-8632: [~zhz], any more comments, would you please review the latest patch

[jira] [Comment Edited] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934689#comment-14934689 ] Yi Liu edited comment on HDFS-9053 at 9/29/15 6:18 AM: --- [~jingzhao], you have given a

[jira] [Updated] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8941: --- Attachment: HDFS-8941-03.patch Rebased the patch and attached to the jira, as HDFS-8740 has moved the

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934836#comment-14934836 ] Yi Liu commented on HDFS-8859: -- Thanks Uma, since the new patch only removes the unused import, based on the

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934677#comment-14934677 ] Hudson commented on HDFS-9092: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #432 (See

[jira] [Commented] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934740#comment-14934740 ] Zhe Zhang commented on HDFS-9172: - Thanks for initiating the work Rakesh. I'm doing a 'git merge' with

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934782#comment-14934782 ] Colin Patrick McCabe commented on HDFS-9170: I don't have any objections to moving libhdfs,

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934826#comment-14934826 ] Hadoop QA commented on HDFS-1172: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Attachment: HDFS-8859.006.patch Update patch to remove unnecessary import. > Improve DataNode ReplicaMap memory

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934697#comment-14934697 ] Yi Liu commented on HDFS-8859: -- Thanks Uma. There is an unused import, I will remove it in the new version

[jira] [Created] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-09-29 Thread Walter Su (JIRA)
Walter Su created HDFS-9173: --- Summary: Erasure Coding: Lease recovery for striped file Key: HDFS-9173 URL: https://issues.apache.org/jira/browse/HDFS-9173 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Comment Edited] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934689#comment-14934689 ] Yi Liu edited comment on HDFS-9053 at 9/29/15 6:55 AM: --- [~jingzhao], you have given a

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration

2015-09-29 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8676: Attachment: HDFS-8676.01.patch > Delayed rolling upgrade finalization can cause heartbeat expiration >

[jira] [Commented] (HDFS-9159) [OIV] : return value of the command is not correct if invalid value specified in "-p (processor)" option

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934702#comment-14934702 ] Hadoop QA commented on HDFS-9159: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Comment Edited] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934689#comment-14934689 ] Yi Liu edited comment on HDFS-9053 at 9/29/15 6:20 AM: --- [~jingzhao], you have given a

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration

2015-09-29 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8676: Assignee: Walter Su Status: Patch Available (was: Open) > Delayed rolling upgrade finalization can

[jira] [Updated] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9141: -- Status: Patch Available (was: Open) > Thread leak in Datanode#refreshVolumes >

[jira] [Updated] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9141: -- Attachment: HDFS-9141.00.patch Updated the patch to handle this. > Thread leak in

[jira] [Commented] (HDFS-7663) Erasure Coding: Append on striped file

2015-09-29 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935119#comment-14935119 ] Walter Su commented on HDFS-7663: - Thank you for your detail information. Extending writeBlock is a good

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Status: Open (was: Patch Available) > HDFS Balancer does not respect

[jira] [Updated] (HDFS-9114) NameNode and DataNode metric log file name should follow the other log file name format.

2015-09-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9114: - Attachment: HDFS-9114-trunk.02.patch HDFS-9114-branch-2.02.patch

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934689#comment-14934689 ] Yi Liu commented on HDFS-9053: -- [~jingzhao], you have given a good review, and it hits the two places I ever

[jira] [Commented] (HDFS-9166) Move hftp / hsftp filesystem to hfds-client

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934691#comment-14934691 ] Hadoop QA commented on HDFS-9166: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934783#comment-14934783 ] Yi Liu commented on HDFS-9141: -- +1 pending Jenkins, Thanks Uma. > Thread leak in Datanode#refreshVolumes >

[jira] [Commented] (HDFS-9158) [OEV-Doc] : Document does not mention about "-f" and "-r" options

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934839#comment-14934839 ] Hadoop QA commented on HDFS-9158: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934852#comment-14934852 ] Hadoop QA commented on HDFS-9151: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935117#comment-14935117 ] Daniel Templeton commented on HDFS-9151: +1 (non-binding) > Mover should print the exit

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935212#comment-14935212 ] Yi Liu commented on HDFS-9053: -- The three test failures are not related. > Support large directories

[jira] [Created] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
Yi Liu created HDFS-9174: Summary: Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread Key: HDFS-9174 URL: https://issues.apache.org/jira/browse/HDFS-9174

[jira] [Created] (HDFS-9175) Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public

2015-09-29 Thread Santhosh G Nayak (JIRA)
Santhosh G Nayak created HDFS-9175: -- Summary: Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public Key: HDFS-9175 URL:

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935101#comment-14935101 ] Hadoop QA commented on HDFS-9053: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9174: - Attachment: HDFS-9174.001.patch > Fix the latest findbugs of FSOutputSummer.tracer and >

[jira] [Updated] (HDFS-9175) Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public

2015-09-29 Thread Santhosh G Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh G Nayak updated HDFS-9175: --- Attachment: HDFS-9175.1.patch Attaching a patch containing the proposed changes. > Change

[jira] [Updated] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9174: - Status: Patch Available (was: Open) > Fix the latest findbugs of FSOutputSummer.tracer and >

[jira] [Created] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Yi Liu (JIRA)
Yi Liu created HDFS-9176: Summary: TestDirectoryScanner#testThrottling often fails. Key: HDFS-9176 URL: https://issues.apache.org/jira/browse/HDFS-9176 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Component/s: tracing > update htrace version to 4.0.1 > --

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934922#comment-14934922 ] Hadoop QA commented on HDFS-9141: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Attachment: HDFS-9053.003.patch > Support large directories efficiently using B-Tree >

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934862#comment-14934862 ] Yi Liu commented on HDFS-9053: -- Update the patch to address Jing's comments: 1. Call {{addOrReplace}} directly

[jira] [Commented] (HDFS-9165) Move the rest of the entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934875#comment-14934875 ] Hadoop QA commented on HDFS-9165: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934926#comment-14934926 ] Hadoop QA commented on HDFS-8676: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Resolved] (HDFS-8603) in NN WEBUI,some point which show time is using the system local language.in Chinese env,will have Chinese in NN UI

2015-09-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore resolved HDFS-8603. -- Resolution: Implemented This is fixed as part of HDFS-8388 > in NN WEBUI,some

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934958#comment-14934958 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1196 (See

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934986#comment-14934986 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2401 (See

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935046#comment-14935046 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #433 (See

[jira] [Commented] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Zhe Zhang (JIRA)
-7285-20150929 I think we can use this JIRA to track some non-ideal code changes. For example, I added {{StripedBlockUtil#getBlockIndex}} to avoid creating a whole new {{BlockIdManagerClient}} just for this method. Another case is in {{ErasureCodingWorker#newBlockReader}}, I hard-coded tracer

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934904#comment-14934904 ] Hadoop QA commented on HDFS-8941: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934861#comment-14934861 ] Hudson commented on HDFS-8859: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8538 (See

[jira] [Commented] (HDFS-9114) NameNode and DataNode metric log file name should follow the other log file name format.

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934870#comment-14934870 ] Hadoop QA commented on HDFS-9114: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935071#comment-14935071 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2373 (See

[jira] [Updated] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934863#comment-14934863 ] Yi Liu commented on HDFS-8859: -- Committed to trunk and branch-2, thanks [~szetszwo], [~umamaheswararao],

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934933#comment-14934933 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #465 (See

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934931#comment-14934931 ] Rakesh R commented on HDFS-8449: Nice work, thanks [~libo-intel] for the patch. I've few comments, please

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935008#comment-14935008 ] Hudson commented on HDFS-8859: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #458 (See

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Attachment: HDFS-9100.003.patch > HDFS Balancer does not respect

[jira] [Commented] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935304#comment-14935304 ] Yongjun Zhang commented on HDFS-9100: - Thanks [~caseyjbrotherton]. +1 on rev3 pending jenkins test.

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935327#comment-14935327 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1197 (See

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935228#comment-14935228 ] Yi Liu commented on HDFS-9141: -- The test failures are unrelated, and checkstyle is about the file contains too

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935239#comment-14935239 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-trunk-Commit #8539 (See

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935275#comment-14935275 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #466 (See

[jira] [Assigned] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-9176: -- Assignee: Daniel Templeton > TestDirectoryScanner#testThrottling often fails. >

[jira] [Updated] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9141: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9100) HDFS Balancer does not respect dfs.client.use.datanode.hostname

2015-09-29 Thread Casey Brotherton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Casey Brotherton updated HDFS-9100: --- Status: Patch Available (was: Open) > HDFS Balancer does not respect

[jira] [Commented] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935305#comment-14935305 ] Daniel Templeton commented on HDFS-9176: It's probably the timing-based nature of the test. I'll

[jira] [Commented] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-09-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935281#comment-14935281 ] Yongjun Zhang commented on HDFS-8384: - HI [~szetszwo], [~jingzhao] , Thanks for your earlier work on

[jira] [Updated] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9165: - Summary: Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client (was: Move the rest of the

[jira] [Updated] (HDFS-9172) Erasure Coding: Move DFSStripedIO stream related classes to hadoop-hdfs-client

2015-09-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9172: --- Assignee: Zhe Zhang (was: Rakesh R) > Erasure Coding: Move DFSStripedIO stream related classes to

[jira] [Commented] (HDFS-9141) Thread leak in Datanode#refreshVolumes

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935346#comment-14935346 ] Hudson commented on HDFS-9141: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #459 (See

[jira] [Commented] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935392#comment-14935392 ] Hadoop QA commented on HDFS-9174: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935427#comment-14935427 ] Haohui Mai commented on HDFS-9165: -- +1 > Move entries in META-INF/services/o.a.h.fs.FileSystem to

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935455#comment-14935455 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-trunk-Commit #8541 (See

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935404#comment-14935404 ] Haohui Mai commented on HDFS-9170: -- The main benefit that (2) offers is that the implementation and the

[jira] [Updated] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9165: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935450#comment-14935450 ] Surendra Singh Lilhore commented on HDFS-9151: -- Thanks [~templedf] for reviews. [~szetszwo]

[jira] [Commented] (HDFS-9166) Move hftp / hsftp filesystem to hfds-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935451#comment-14935451 ] Haohui Mai commented on HDFS-9166: -- +1. Looks like test-patch somehow fails to recognizes the name of the

[jira] [Created] (HDFS-9177) TestTextCommand: use mkdirs rather than mkdir to create test directory

2015-09-29 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9177: -- Summary: TestTextCommand: use mkdirs rather than mkdir to create test directory Key: HDFS-9177 URL: https://issues.apache.org/jira/browse/HDFS-9177

[jira] [Updated] (HDFS-9166) Move hftp / hsftp filesystem to hfds-client

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9166: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935832#comment-14935832 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2375 (See

[jira] [Commented] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935843#comment-14935843 ] Daniel Templeton commented on HDFS-9174: The changes look good to me. +1 (non-binding) > Fix the

[jira] [Commented] (HDFS-9165) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935928#comment-14935928 ] Hudson commented on HDFS-9165: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #435 (See

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935932#comment-14935932 ] Xiaobing Zhou commented on HDFS-8696: - Checked the test failures are not related. > Reduce the

[jira] [Updated] (HDFS-9174) Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9174: - Summary: Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

[jira] [Updated] (HDFS-4015) Safemode should count and report orphaned blocks

2015-09-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-4015: --- Attachment: HDFS-4015.001.patch > Safemode should count and report orphaned blocks >

[jira] [Commented] (HDFS-8696) Make the lower and higher watermark in the DN Netty server configurable

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936006#comment-14936006 ] Haohui Mai commented on HDFS-8696: -- +1 > Make the lower and higher watermark in the DN Netty server

[jira] [Updated] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8971: Attachment: HDFS-8971.001.patch The v1 patch addresses the whitespace and checkstyle warnings. Some

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936105#comment-14936105 ] Hadoop QA commented on HDFS-4015: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9174) Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936154#comment-14936154 ] Yi Liu commented on HDFS-9174: -- Thanks [~wheat9] and [~templedf] for the review, and thanks Haohui for the

[jira] [Comment Edited] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-29 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935973#comment-14935973 ] Jing Zhao edited comment on HDFS-1172 at 9/29/15 9:56 PM: -- Thanks for updating the

[jira] [Commented] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935889#comment-14935889 ] Hadoop QA commented on HDFS-8971: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8971) Remove guards when calling LOG.debug() and LOG.trace() in client package

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935894#comment-14935894 ] Haohui Mai commented on HDFS-8971: -- The patch looks good to me. +1 after fixing the checkstyle /

[jira] [Updated] (HDFS-8696) Make the lower and higher watermark in the DN Netty server configurable

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8696: - Summary: Make the lower and higher watermark in the DN Netty server configurable (was: Reduce the

[jira] [Commented] (HDFS-8873) Allow the directoryScanner to be rate-limited

2015-09-29 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935933#comment-14935933 ] Haohui Mai commented on HDFS-8873: -- It looks like that this patch introduces a new findbugs warning in

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.007.patch > Webhdfs client leaks active NameNode connections >

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-09-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936086#comment-14936086 ] Arpit Agarwal commented on HDFS-4015: - Hi [~anu], thanks for this improvement. Few comments below, I

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-09-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14936147#comment-14936147 ] Anu Engineer commented on HDFS-4015: Hi [~arpitagarwal], thanks for the review and comments. I will

  1   2   3   >