[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218148#comment-16218148 ] Xiao Chen commented on HDFS-12482: -- Thanks for the new rev Eddy! We can use preconditions which will

[jira] [Comment Edited] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218129#comment-16218129 ] Virajith Jalaparti edited comment on HDFS-11902 at 10/25/17 5:42 AM: -

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218136#comment-16218136 ] Hadoop QA commented on HDFS-12482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.010.patch Posting a new patch which moves the

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-12532) DN Reg can Fail when principal doesn't contain hostname and floatingIP is configured.

2017-10-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12532: Status: Patch Available (was: In Progress) > DN Reg can Fail when principal

[jira] [Updated] (HDFS-12532) DN Reg can Fail when principal doesn't contain hostname and floatingIP is configured.

2017-10-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12532: Attachment: HDFS-12532.patch Attaching patch with above approach.Kindly review. >

[jira] [Work started] (HDFS-12532) DN Reg can Fail when principal doesn't contain hostname and floatingIP is configured.

2017-10-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12532 started by Brahma Reddy Battula. --- > DN Reg can Fail when principal doesn't contain hostname and

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218115#comment-16218115 ] Hadoop QA commented on HDFS-12482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (HDFS-12532) DN Reg can Fail when principal doesn't contain hostname and floatingIP is configured.

2017-10-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reopened HDFS-12532: - Assignee: Brahma Reddy Battula > DN Reg can Fail when principal doesn't contain

[jira] [Commented] (HDFS-12532) DN Reg can Fail when principal doesn't contain hostname and floatingIP is configured.

2017-10-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218114#comment-16218114 ] Brahma Reddy Battula commented on HDFS-12532: - bq.I recommend either switching your interface

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.04.patch > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-12708) Fix hdfs haadmin usage

2017-10-24 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-12708: --- Affects Version/s: 3.0.0-alpha4 Status: Patch Available (was: Open) > Fix hdfs

[jira] [Updated] (HDFS-12708) Fix hdfs haadmin usage

2017-10-24 Thread fang zhenyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fang zhenyi updated HDFS-12708: --- Attachment: HDFS-12708.001.patch > Fix hdfs haadmin usage > --- > >

[jira] [Created] (HDFS-12708) Fix hdfs haadmin usage

2017-10-24 Thread fang zhenyi (JIRA)
fang zhenyi created HDFS-12708: -- Summary: Fix hdfs haadmin usage Key: HDFS-12708 URL: https://issues.apache.org/jira/browse/HDFS-12708 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218045#comment-16218045 ] Hadoop QA commented on HDFS-12544: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218037#comment-16218037 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218021#comment-16218021 ] Yiqun Lin commented on HDFS-11468: -- Thanks [~xyao] for the comments, I will take care of remaining work

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218016#comment-16218016 ] Xiaoyu Yao commented on HDFS-11468: --- Thanks [~linyiqun] for the contribution and [~cheersyang] for the

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218005#comment-16218005 ] Xiaoyu Yao commented on HDFS-12521: --- Thanks [~ljain] for working on this. The patch v5 looks good to me

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217996#comment-16217996 ] Yiqun Lin commented on HDFS-11468: -- Will commit this shortly, thanks [~cheersyang]. > Ozone: SCM: Add

[jira] [Commented] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217994#comment-16217994 ] Nanda kumar commented on HDFS-12705: Thanks [~hanishakoneru] for taking it up. Instead of setting

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217987#comment-16217987 ] Hadoop QA commented on HDFS-12697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217973#comment-16217973 ] SammiChen commented on HDFS-12686: -- Hi [~jojochuang], this JIRA is closely related with HDFS-12682. I was

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217962#comment-16217962 ] Virajith Jalaparti commented on HDFS-12665: --- bq. Sure. This means all the classes used by fs2img

[jira] [Comment Edited] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217953#comment-16217953 ] Yongjun Zhang edited comment on HDFS-12544 at 10/25/17 1:13 AM: Thanks for

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217953#comment-16217953 ] Yongjun Zhang commented on HDFS-12544: -- Thanks for the updated patch [~manojg], +1 on rev05. As we

[jira] [Updated] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12482: - Attachment: HDFS-12482.03.patch thanks for the suggestions, [~xiaochen] Add checks as you

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

2017-10-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217928#comment-16217928 ] Lei (Eddy) Xu commented on HDFS-12682: -- Thanks for reporting this and working on this, [~xiaochen] *

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217907#comment-16217907 ] Hadoop QA commented on HDFS-12697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2017-10-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217904#comment-16217904 ] Arpit Agarwal commented on HDFS-10659: -- bq. During transition to active state, Namenode crashes if a

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217901#comment-16217901 ] Hudson commented on HDFS-12502: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13131 (See

[jira] [Updated] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-24 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12544: -- Attachment: HDFS-12544.05.patch Attached v05 patch with test updated to cover more

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217862#comment-16217862 ] Wei Yan commented on HDFS-12502: {quote} We should probably also extend fair call queue to consider the

[jira] [Updated] (HDFS-12707) Ozone: start-all script is missing ozone start

2017-10-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12707: Summary: Ozone: start-all script is missing ozone start (was: start-all script is missing ozone

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.009.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.009.patch) > [READ] Merge

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217844#comment-16217844 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12707) start-all script is missing ozone start

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12707: - Assignee: Bharat Viswanadham > start-all script is missing ozone start >

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217837#comment-16217837 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Indeed, we have a few options here: #

[jira] [Updated] (HDFS-12707) start-all script is missing ozone start

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12707: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > start-all script is

[jira] [Created] (HDFS-12707) start-all script is missing ozone start

2017-10-24 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12707: - Summary: start-all script is missing ozone start Key: HDFS-12707 URL: https://issues.apache.org/jira/browse/HDFS-12707 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11807) libhdfs++: Get minidfscluster tests running under valgrind

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217834#comment-16217834 ] Hadoop QA commented on HDFS-11807: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-3296) Running libhdfs tests in mac fails

2017-10-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217817#comment-16217817 ] John Zhuge commented on HDFS-3296: -- TestDomainSocket#testAsyncCloseDuringWrite failure: {noformat}

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217815#comment-16217815 ] Tsz Wo Nicholas Sze commented on HDFS-12594: [~shashikant], thanks for updating the patch.

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217811#comment-16217811 ] Hadoop QA commented on HDFS-12702: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217794#comment-16217794 ] Bharat Viswanadham commented on HDFS-12697: --- [~anu] Yes both are same. > Ozone services must

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217788#comment-16217788 ] Anu Engineer commented on HDFS-12697: - +1 for version 4 in the review board. is the V2 patch here the

[jira] [Updated] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12502: - Fix Version/s: (was: 3.1.0) (was: 3.0.0) (was: 2.8.3)

[jira] [Comment Edited] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1621#comment-1621 ] Zhe Zhang edited comment on HDFS-12502 at 10/24/17 10:07 PM: - For some reason

[jira] [Reopened] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-12502: -- > nntop should support a category based on FilesInGetListingOps >

[jira] [Updated] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12502: - Fix Version/s: (was: 2.7.5) > nntop should support a category based on FilesInGetListingOps >

[jira] [Comment Edited] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1621#comment-1621 ] Zhe Zhang edited comment on HDFS-12502 at 10/24/17 9:59 PM: For some reason we

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1621#comment-1621 ] Zhe Zhang commented on HDFS-12502: -- For some reason we were getting over 600k~700k FilesInGetListing per

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217763#comment-16217763 ] Hadoop QA commented on HDFS-12702: -- (!) A patch to the testing environment has been detected.

[jira] [Comment Edited] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217755#comment-16217755 ] Bharat Viswanadham edited comment on HDFS-12697 at 10/24/17 9:42 PM: -

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217755#comment-16217755 ] Bharat Viswanadham commented on HDFS-12697: --- Addressed review comments from [~anu] in the

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-12697-HDFS-7240.02.patch > Ozone services must stay disabled in secure

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217740#comment-16217740 ] Daryn Sharp commented on HDFS-12502: I'd prefer to see it reverted while we figure out how to add it

[jira] [Updated] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12705: -- Attachment: HDFS-12705.001.patch Thanks Daryn for filing the bug. Uploaded a simple patch to

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217729#comment-16217729 ] Hadoop QA commented on HDFS-12482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-3296) Running libhdfs tests in mac fails

2017-10-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-3296: - Attachment: HDFS-3296.004.patch I'd like to share a patch I have been using. Not totally polished or

[jira] [Updated] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12702: Attachment: HDFS-12702-HDFS-7240.002.patch Final patch is uploaded. The previous one worked well

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217704#comment-16217704 ] Zhe Zhang commented on HDFS-12502: -- Thanks [~daryn], I agree that the name {{NNTopUserOpCounts}} has an

[jira] [Commented] (HDFS-12653) Implement toArray() and subArray() for ReadOnlyList

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217697#comment-16217697 ] Daryn Sharp commented on HDFS-12653: How do you intend to use this with the inode attr provider? It

[jira] [Resolved] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-12686. -- Resolution: Duplicate Since HDFS-12682 should be able to handle this, and it's pretty hard to split

[jira] [Commented] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217588#comment-16217588 ] Wei-Chiu Chuang commented on HDFS-12686: Missed target version for this ec blocker. [~Sammi]

[jira] [Updated] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

2017-10-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12686: --- Target Version/s: 3.0.0 > Erasure coding system policy state is not correctly saved and

[jira] [Created] (HDFS-12706) Allow overriding HADOOP_SHELL_EXECNAME

2017-10-24 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-12706: Summary: Allow overriding HADOOP_SHELL_EXECNAME Key: HDFS-12706 URL: https://issues.apache.org/jira/browse/HDFS-12706 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217479#comment-16217479 ] Hadoop QA commented on HDFS-12702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-12697-HDFS-7240.01.patch > Ozone services must stay disabled in secure

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.01.patch) > Ozone services must stay

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.00.patch) > Ozone services must stay

[jira] [Assigned] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-12705: - Assignee: Hanisha Koneru > WebHdfsFileSystem exceptions should retain the caused by

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217465#comment-16217465 ] Hadoop QA commented on HDFS-12697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Patch Available (was: Open) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Open (was: Patch Available) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-24 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217402#comment-16217402 ] Daryn Sharp commented on HDFS-12638: Might want to investigate the lifecycle handling of

[jira] [Commented] (HDFS-12700) Fix datanode link that can not be accessed in dfshealth.html

2017-10-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217397#comment-16217397 ] Arpit Agarwal commented on HDFS-12700: -- Hi [~zhenyi], it's generally better to use hostnames as they

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-24 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217386#comment-16217386 ] Manoj Govindassamy commented on HDFS-12544: --- [~yzhangal], 1. Yes, just like the files moved out

[jira] [Created] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12705: -- Summary: WebHdfsFileSystem exceptions should retain the caused by exception Key: HDFS-12705 URL: https://issues.apache.org/jira/browse/HDFS-12705 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217361#comment-16217361 ] Xiao Chen commented on HDFS-12482: -- Thanks Eddy for the new rev. Doc example looks great! Agree {{<=0}}

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.01.patch > Ozone services must stay disabled in secure

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.01.patch) > Ozone services must stay

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: (was: HDFS-7240-HDFS-12697.01.patch) > Ozone services must stay

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.01.patch > Ozone services must stay disabled in secure

[jira] [Commented] (HDFS-11807) libhdfs++: Get minidfscluster tests running under valgrind

2017-10-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217316#comment-16217316 ] James Clampffer commented on HDFS-11807: Most recent change fixes the hang, thanks. Some

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.01.patch > Ozone services must stay disabled in secure

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Status: Patch Available (was: In Progress) > Ozone services must stay disabled in

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-24 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-7240-HDFS-12697.00.patch > Ozone services must stay disabled in secure

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217252#comment-16217252 ] Íñigo Goiri commented on HDFS-12699: The failed unit tests is not related. branch-2 didn't build but

[jira] [Commented] (HDFS-12704) FBR may corrupt block state

2017-10-24 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217230#comment-16217230 ] Daryn Sharp commented on HDFS-12704: During a decomm of a faulty nodem the NNs frequently reported

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217222#comment-16217222 ] Hadoop QA commented on HDFS-12702: -- (!) A patch to the testing environment has been detected.

[jira] [Created] (HDFS-12704) FBR may corrupt block state

2017-10-24 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12704: -- Summary: FBR may corrupt block state Key: HDFS-12704 URL: https://issues.apache.org/jira/browse/HDFS-12704 Project: Hadoop HDFS Issue Type: Bug

  1   2   >