[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-02-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153893#comment-15153893 ] Brahma Reddy Battula commented on HDFS-9530: [~Qiuzhuang] this issue is tracked in HDFS-9038..

[jira] [Commented] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153958#comment-15153958 ] Tsuyoshi Ozawa commented on HDFS-9084: -- [~raviprak] thank you for the very neat feature! It works well

[jira] [Comment Edited] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153958#comment-15153958 ] Tsuyoshi Ozawa edited comment on HDFS-9084 at 2/19/16 9:10 AM: --- [~raviprak]

[jira] [Comment Edited] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153958#comment-15153958 ] Tsuyoshi Ozawa edited comment on HDFS-9084 at 2/19/16 9:13 AM: --- [~raviprak]

[jira] [Updated] (HDFS-9832) Erasure Coding: Improve exception handling in ErasureCodingWorker#ReconstructAndTransferBlock

2016-02-19 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9832: Description: There are three places in {{ErasureCodingWorker#ReconstructAndTransferBlock}} that I think can

[jira] [Updated] (HDFS-9832) Erasure Coding: Improve exception handling in ErasureCodingWorker#ReconstructAndTransferBlock

2016-02-19 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9832: Description: There are three places in {{ErasureCodingWorker#ReconstructAndTransferBlock}} that I think can

[jira] [Updated] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-19 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7661: -- Attachment: HDFS-7661-wip.01.patch > Erasure coding: support hflush and hsync >

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-02-19 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154002#comment-15154002 ] GAO Rui commented on HDFS-7661: --- [~zhz] good idea to use {{FsDatasetImpl#truncateBlock}} to overwrite parity

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-02-19 Thread Qiuzhuang Lian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154036#comment-15154036 ] Qiuzhuang Lian commented on HDFS-9530: -- @Brahma Reddy Battula, thanks. For now we restart all

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154107#comment-15154107 ] Hadoop QA commented on HDFS-9816: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154129#comment-15154129 ] Rui Li commented on HDFS-9816: -- Test failures cannot be reproduced locally. > Erasure Coding: allow to use

[jira] [Commented] (HDFS-9591) FSImage.loadEdits threw NullPointerException

2016-02-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154252#comment-15154252 ] Wei-Chiu Chuang commented on HDFS-9591: --- It looks to me an issue with Mockito, and not with the code

[jira] [Updated] (HDFS-9591) FSImage.loadEdits threw NullPointerException

2016-02-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9591: -- Priority: Minor (was: Major) > FSImage.loadEdits threw NullPointerException >

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154288#comment-15154288 ] Kuhu Shukla commented on HDFS-9395: --- Thanks [~vinayrpet] for the comments. {{setErasureCodingPolicy}}

[jira] [Commented] (HDFS-9828) Change all read only operation audit log to debug level

2016-02-19 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154394#comment-15154394 ] Yong Zhang commented on HDFS-9828: -- Hi [~kihwal], thanks for your comment, but what are certain read

[jira] [Commented] (HDFS-9828) Change all read only operation audit log to debug level

2016-02-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154458#comment-15154458 ] Kihwal Lee commented on HDFS-9828: -- For one, open (i.e. getBlockLocations) is usually considered important

[jira] [Updated] (HDFS-9395) Make HDFS audit logging consistant

2016-02-19 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Attachment: HDFS-9395.007.patch I have updated the patch per comments from Vinayakumar which fixes the

[jira] [Commented] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154495#comment-15154495 ] Haohui Mai commented on HDFS-9084: -- The issue is that the LISTSTATUS API of WebHDFS can only return the

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-02-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154524#comment-15154524 ] Rakesh R commented on HDFS-7955: Thanks a lot [~zhz] and [~andrew.wang] for the suggestions and advice. I

[jira] [Commented] (HDFS-8757) OzoneHandler : Add localStorageHandler support for Buckets

2016-02-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154540#comment-15154540 ] Anu Engineer commented on HDFS-8757: Test failures are not related to this patch. > OzoneHandler : Add

[jira] [Updated] (HDFS-9764) DistCp doesn't print value for several arguments including -numListstatusThreads

2016-02-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9764: Summary: DistCp doesn't print value for several arguments including -numListstatusThreads (was:

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154590#comment-15154590 ] Chris Nauroth commented on HDFS-9395: - {{getAclStatus}} looks correct in patch v007. Thanks! > Make

[jira] [Updated] (HDFS-8757) OzoneHandler : Add localStorageHandler support for Buckets

2016-02-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8757: Hadoop Flags: Reviewed +1 for the patch. This looks good. Thank you, Anu. The Findbugs warnings

[jira] [Updated] (HDFS-8757) OzoneHandler : Add localStorageHandler support for Buckets

2016-02-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8757: --- Resolution: Fixed Status: Resolved (was: Patch Available) [~cnauroth] Thanks for the review.

[jira] [Updated] (HDFS-9764) DistCp doesn't print value for several arguments including -numListstatusThreads

2016-02-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9764: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9829) Erasure Coding: Improve few exception handling logic of ErasureCodingWorker

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9829: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154636#comment-15154636 ] Rakesh R commented on HDFS-9818: Thanks [~jingzhao] for the patch. Overall patch looks good, I've just a

[jira] [Commented] (HDFS-9829) Erasure Coding: Improve few exception handling logic of ErasureCodingWorker

2016-02-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154640#comment-15154640 ] Rakesh R commented on HDFS-9829: Thank you [~jingzhao] for reviewing and committing the patch! > Erasure

[jira] [Commented] (HDFS-9829) Erasure Coding: Improve few exception handling logic of ErasureCodingWorker

2016-02-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154644#comment-15154644 ] Hudson commented on HDFS-9829: -- FAILURE: Integrated in Hadoop-trunk-Commit #9330 (See

[jira] [Commented] (HDFS-9764) DistCp doesn't print value for several arguments including -numListstatusThreads

2016-02-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154645#comment-15154645 ] Hudson commented on HDFS-9764: -- FAILURE: Integrated in Hadoop-trunk-Commit #9330 (See

[jira] [Assigned] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

2016-02-19 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9831: --- Assignee: Xiaobing Zhou > Document webhdfs retry configuration keys introduced by

[jira] [Updated] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-9084: --- Attachment: Screenshot HD-9084.jpg Thanks for pointing out HDFS-9366. It'd be useful to page server

[jira] [Commented] (HDFS-9366) Webhdfs support set result size and cursor value in op=LISTSTATUS

2016-02-19 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154669#comment-15154669 ] Ravi Prakash commented on HDFS-9366: Thanks for the patch Yong Zhang! This would be useful for the NN

[jira] [Updated] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9818: Attachment: HDFS-9818.004.patch Thanks for the review, [~rakeshr]! Update the patch to address your

[jira] [Created] (HDFS-9834) OzoneHandler : Enable MiniDFSCluster based testing for Ozone

2016-02-19 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9834: -- Summary: OzoneHandler : Enable MiniDFSCluster based testing for Ozone Key: HDFS-9834 URL: https://issues.apache.org/jira/browse/HDFS-9834 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9834) OzoneHandler : Enable MiniDFSCluster based testing for Ozone

2016-02-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9834: --- Attachment: HDFS-9834-HDFS-7240.001.patch > OzoneHandler : Enable MiniDFSCluster based testing for

[jira] [Updated] (HDFS-9834) OzoneHandler : Enable MiniDFSCluster based testing for Ozone

2016-02-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9834: --- Status: Patch Available (was: Open) > OzoneHandler : Enable MiniDFSCluster based testing for Ozone >

[jira] [Updated] (HDFS-8306) Outputs Xattr in OIV XML format

2016-02-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Summary: Outputs Xattr in OIV XML format (was: Generate ACL and Xattr outputs in OIV XML outputs)

[jira] [Updated] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9716: Component/s: erasure-coding > o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk >

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154840#comment-15154840 ] Mingliang Liu commented on HDFS-9716: - Is it my imagination or the test is missing in trunk? If you're

[jira] [Created] (HDFS-9835) OIV: add ReverseXML processor which reconstructs an fsimage from an XML file

2016-02-19 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9835: -- Summary: OIV: add ReverseXML processor which reconstructs an fsimage from an XML file Key: HDFS-9835 URL: https://issues.apache.org/jira/browse/HDFS-9835

[jira] [Updated] (HDFS-9835) OIV: add ReverseXML processor which reconstructs an fsimage from an XML file

2016-02-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9835: --- Issue Type: New Feature (was: Bug) > OIV: add ReverseXML processor which reconstructs

[jira] [Updated] (HDFS-9835) OIV: add ReverseXML processor which reconstructs an fsimage from an XML file

2016-02-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9835: --- Attachment: HDFS-9835.001.patch This is a preliminary version. I need to add some

[jira] [Updated] (HDFS-9835) OIV: add ReverseXML processor which reconstructs an fsimage from an XML file

2016-02-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9835: --- Status: Patch Available (was: Open) > OIV: add ReverseXML processor which

[jira] [Created] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
Guocui Mi created HDFS-9836: --- Summary: RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler Key: HDFS-9836 URL: https://issues.apache.org/jira/browse/HDFS-9836

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9836: Description: RequestHedgingInvocationHandler cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9836: Description: RequestHedgingInvocationHandler cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler

[jira] [Updated] (HDFS-8306) Outputs Xattr in OIV XML format

2016-02-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.009.patch Updated the patch to * Rebase to trunk * Remove ACL outputs part

[jira] [Commented] (HDFS-8306) Outputs Xattr in OIV XML format

2016-02-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154876#comment-15154876 ] Colin Patrick McCabe commented on HDFS-8306: {code} FileSummary summary =

[jira] [Commented] (HDFS-9835) OIV: add ReverseXML processor which reconstructs an fsimage from an XML file

2016-02-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154887#comment-15154887 ] Colin Patrick McCabe commented on HDFS-9835: Edit: I need to undo the effects of

[jira] [Updated] (HDFS-9710) Change DN to send block receipt IBRs in batches

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9710: -- Attachment: h9710_20160219.patch h9710_20160219.patch: fixes test failures. > Change DN

[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: HDFS-9688-branch-2.7.04.patch Attaching a duplicate patch as {{HDFS-9688-branch-2.7.03.patch}}.

[jira] [Created] (HDFS-9837) BlockManager#countNodes should be able to detect duplicated internal blocks

2016-02-19 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9837: --- Summary: BlockManager#countNodes should be able to detect duplicated internal blocks Key: HDFS-9837 URL: https://issues.apache.org/jira/browse/HDFS-9837 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9837) BlockManager#countNodes should be able to detect duplicated internal blocks

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9837: Status: Patch Available (was: Open) > BlockManager#countNodes should be able to detect duplicated internal

[jira] [Updated] (HDFS-9837) BlockManager#countNodes should be able to detect duplicated internal blocks

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9837: Attachment: HDFS-9837.000.patch Upload a patch to fix. > BlockManager#countNodes should be able to detect

[jira] [Updated] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9530: -- Description: i think there are bugs in HDFS

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155090#comment-15155090 ] Zhe Zhang commented on HDFS-9816: - Thanks Rui for the update. I just realized that

[jira] [Commented] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155114#comment-15155114 ] Colin Patrick McCabe commented on HDFS-9549: Thanks, [~xiaochen]. {code} if

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155123#comment-15155123 ] Tsz Wo Nicholas Sze commented on HDFS-9818: --- +1 on the latest patch. > Correctly handle EC

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9836: Attachment: HDFS-9836-000.patch Please let me if you have any concerns about this fix. >

[jira] [Commented] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155189#comment-15155189 ] Guocui Mi commented on HDFS-9836: - [~asuresh], could you please take a look? >

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9836: -- Status: Patch Available (was: Open) > RequestHedgingInvocationHandler can't be cast to >

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-9836: -- Assignee: Guocui Mi Status: In Progress (was: Patch Available) > RequestHedgingInvocationHandler

[jira] [Updated] (HDFS-9837) BlockManager#countNodes should be able to detect duplicated internal blocks

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9837: Attachment: HDFS-9837.001.patch The 001 patch does some code refactoring for {{countNodes}} and also avoids

[jira] [Updated] (HDFS-9427) HDFS should not default to ephemeral ports

2016-02-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9427: -- Priority: Critical (was: Major) > HDFS should not default to ephemeral ports >

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155271#comment-15155271 ] Hadoop QA commented on HDFS-9688: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

2016-02-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9549: Attachment: HDFS-9549.04.patch Thank you [~cmccabe]. You're right, I should not have made such assumption.

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9836: Attachment: HDFS-9836-001.patch > RequestHedgingInvocationHandler can't be cast to >

[jira] [Updated] (HDFS-9836) RequestHedgingInvocationHandler can't be cast to org.apache.hadoop.ipc.RpcInvocationHandler

2016-02-19 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9836: Fix Version/s: 3.0.0 Status: Patch Available (was: In Progress) >

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155310#comment-15155310 ] Hadoop QA commented on HDFS-9818: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9818: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) The failed

[jira] [Commented] (HDFS-9366) Webhdfs support set result size and cursor value in op=LISTSTATUS

2016-02-19 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155343#comment-15155343 ] Yong Zhang commented on HDFS-9366: -- Thanks for you comment [~raviprak]! but I have no idea for global

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155344#comment-15155344 ] Hudson commented on HDFS-9818: -- FAILURE: Integrated in Hadoop-trunk-Commit #9334 (See

[jira] [Commented] (HDFS-9837) BlockManager#countNodes should be able to detect duplicated internal blocks

2016-02-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155346#comment-15155346 ] Jing Zhao commented on HDFS-9837: - The current patch has an bug that it causes NN to ignore over-replicated

[jira] [Updated] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9716: Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) HDFS-9755 covers the same fix.

[jira] [Updated] (HDFS-9838) Refactor the excessReplicateMap to a class

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9838: -- Attachment: h9838_20160219.patch h9838_20160219.patch: 1st patch. > Refactor the

[jira] [Created] (HDFS-9838) Refactor the excessReplicateMap to a class

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9838: - Summary: Refactor the excessReplicateMap to a class Key: HDFS-9838 URL: https://issues.apache.org/jira/browse/HDFS-9838 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9838) Refactor the excessReplicateMap to a class

2016-02-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9838: -- Status: Patch Available (was: Open) > Refactor the excessReplicateMap to a class >

[jira] [Commented] (HDFS-9803) Proactively refresh ShortCircuitCache entries to avoid latency spikes

2016-02-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155386#comment-15155386 ] Walter Su commented on HDFS-9803: - Is it related to HDFS-5637? Which version of hdfs-client module you use?

[jira] [Commented] (HDFS-9812) Streamer threads leak if failure happens when closing the dfsoutputstream

2016-02-19 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155411#comment-15155411 ] Lin Yiqun commented on HDFS-9812: - [~ajisakaa], can you please see see this patch, thanks. > Streamer

[jira] [Commented] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155434#comment-15155434 ] Tsuyoshi Ozawa commented on HDFS-9084: -- [~raviprak] I found mysterious behaviour: if the number of

[jira] [Comment Edited] (HDFS-9084) Pagination, sorting and filtering of files/directories in the HDFS Web UI

2016-02-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155434#comment-15155434 ] Tsuyoshi Ozawa edited comment on HDFS-9084 at 2/20/16 6:48 AM: --- [~raviprak] I