[jira] [Comment Edited] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219991#comment-16219991 ] Xiao Chen edited comment on HDFS-12682 at 10/26/17 5:33 AM: Th

[jira] [Comment Edited] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219991#comment-16219991 ] Xiao Chen edited comment on HDFS-12682 at 10/26/17 5:32 AM: Th

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219991#comment-16219991 ] Xiao Chen commented on HDFS-12682: -- Thanks [~rakeshr] for the review and comment. bq. Ca

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Summary: ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED (was: ECAdm

[jira] [Commented] (HDFS-12532) DN Reg can Fail when principal doesn't contain hostname and floatingIP is configured.

2017-10-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219966#comment-16219966 ] Vinayakumar B commented on HDFS-12532: -- bq. see. You want to sacrifice security for

Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-25 Thread Xie Gang
Hi, We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain socket is disabled when datanode throw block invalid exception. The block is invalidated for some reason on datanote and it's OK. Then DFSClient tries to access this block on this datanode via domain socket. This triggers a

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219923#comment-16219923 ] Manoj Govindassamy commented on HDFS-12544: --- The build failure doesn't look rela

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219814#comment-16219814 ] Hudson commented on HDFS-12544: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12579) JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url

2017-10-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219816#comment-16219816 ] Hudson commented on HDFS-12579: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Attachment: HDFS-9240.001.patch >From this description, I don't think this JIRA is related

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Patch Available (was: Open) > Use Builder pattern for BlockLocation constructors >

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-10-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219762#comment-16219762 ] Wei Yan commented on HDFS-11384: For the following changes in the diff, why we set dSec to

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219766#comment-16219766 ] Bharat Viswanadham commented on HDFS-12582: --- Attached patch v04 to address revie

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12582: -- Attachment: HDFS-12582.04.patch > Replace HdfsFileStatus constructor with a builder patt

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219757#comment-16219757 ] Allen Wittenauer commented on HDFS-12711: - Ok, at least locally, YETUS-561.04 is s

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219732#comment-16219732 ] Xiao Chen commented on HDFS-12618: -- Hi [~daryn], Thanks for the comment. I surely learne

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219730#comment-16219730 ] Hadoop QA commented on HDFS-7240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Attachment: HDFS-9914.002.patch Rebase to latest trunk. > Fix configurable WebhDFS connect/read timeout >

[jira] [Created] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-25 Thread Joe McDonnell (JIRA)
Joe McDonnell created HDFS-12714: Summary: Hadoop 3 missing fix for HDFS-5169 Key: HDFS-12714 URL: https://issues.apache.org/jira/browse/HDFS-12714 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219694#comment-16219694 ] Daryn Sharp commented on HDFS-12618: I understand the problem, but as soon as you upda

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-25 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219673#comment-16219673 ] Íñigo Goiri commented on HDFS-7878: --- I'm going through the HDFS code itself and it might

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219657#comment-16219657 ] Chris Douglas commented on HDFS-12681: -- [~andrew.wang] Would it be possible to run v0

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219641#comment-16219641 ] Allen Wittenauer commented on HDFS-12711: - lol yeah, that's... too many. OK, I kn

[jira] [Comment Edited] (HDFS-7878) API - expose an unique file identifier

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219632#comment-16219632 ] Chris Douglas edited comment on HDFS-7878 at 10/25/17 10:09 PM: -

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.18.patch Thanks, [~goiri]. I added more comments to the contract test and expan

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219627#comment-16219627 ] Istvan Fajth commented on HDFS-12710: - Hi [~jzhuge], thank you once again for checkin

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219626#comment-16219626 ] Virajith Jalaparti commented on HDFS-12665: --- [~ehiggs], can we move the part on

[jira] [Created] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-10-25 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12713: - Summary: [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata Key: HDFS-12713 URL: https://issues.apache.org/jira/bro

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219624#comment-16219624 ] Arpit Agarwal commented on HDFS-10528: -- +1 pending Jenkins. > Add logging to success

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10528: - Status: Patch Available (was: Open) > Add logging to successful standby checkpointing > -

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10528: - Status: Open (was: Patch Available) > Add logging to successful standby checkpointing > -

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219618#comment-16219618 ] Íñigo Goiri commented on HDFS-12711: Almost a hundred java processes hanging around.

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9914: Priority: Blocker (was: Major) > Fix configurable WebhDFS connect/read timeout > ---

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9914: Fix Version/s: 3.0.0 > Fix configurable WebhDFS connect/read timeout > --

[jira] [Comment Edited] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219587#comment-16219587 ] Allen Wittenauer edited comment on HDFS-12711 at 10/25/17 9:41 PM: -

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219587#comment-16219587 ] Allen Wittenauer commented on HDFS-12711: - See how many java processes are on that

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219573#comment-16219573 ] Íñigo Goiri commented on HDFS-12711: [~aw] just to confirm, I just run the unit tests

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-25 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219549#comment-16219549 ] Íñigo Goiri commented on HDFS-7878: --- Thanks [~chris.douglas] for this. I went over the pa

[jira] [Updated] (HDFS-12579) JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12579: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolv

[jira] [Commented] (HDFS-12579) JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219541#comment-16219541 ] Arpit Agarwal commented on HDFS-12579: -- +1. The test failure looks unrelated and pass

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.17.patch I updated the contract test with a similar method. Doing this fixed a

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219512#comment-16219512 ] Allen Wittenauer commented on HDFS-12711: - For reference: {code} $ free -h

[jira] [Updated] (HDFS-11858) JN httpServerUri should be set to hostname when using Default Http Address

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11858: - Status: Open (was: Patch Available) > JN httpServerUri should be set to hostname when using Defau

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219501#comment-16219501 ] Allen Wittenauer commented on HDFS-12711: - OK, I just hit it here. On my laptop's

[jira] [Comment Edited] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219498#comment-16219498 ] Arpit Agarwal edited comment on HDFS-10659 at 10/25/17 8:58 PM:

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219498#comment-16219498 ] Arpit Agarwal commented on HDFS-10659: -- Reviewed the v04 patch. Minor point - it's pr

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219479#comment-16219479 ] Hadoop QA commented on HDFS-12618: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219475#comment-16219475 ] Allen Wittenauer commented on HDFS-12711: - pono just provided this ps from one of

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-25 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Attachment: HDFS-12667-001.patch attaching a preliminary patch. By no means it is a committable

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-25 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Status: Patch Available (was: Open) > KMSClientProvider#ValueQueue does synchronous fetch of ed

[jira] [Commented] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-25 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219422#comment-16219422 ] Nanda kumar commented on HDFS-12678: [~ljain], thanks for working on this. Overall the

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219416#comment-16219416 ] Allen Wittenauer commented on HDFS-12711: - FYI: Reducing the number of nodes that

[jira] [Updated] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-10-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated HDFS-11754: -- Fix Version/s: (was: 2.9.0) > Make FsServerDefaults cache configurable. > --

[jira] [Commented] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-25 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219403#comment-16219403 ] Íñigo Goiri commented on HDFS-12607: LGTM. +1. > [READ] Even one dead datanode with P

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-10-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Attachment: HDFS-12106-HDFS-10285-01.patch Attached initial patch... Please revi

[jira] [Updated] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-10-25 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12106: -- Status: Patch Available (was: Open) > [SPS]: Improve storage policy satisfier c

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219380#comment-16219380 ] John Zhuge commented on HDFS-12710: --- Tested the patch in a pseudo distributed cluster. I

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219365#comment-16219365 ] Allen Wittenauer commented on HDFS-12711: - Something else worth mentioning that I

[jira] [Comment Edited] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219353#comment-16219353 ] Allen Wittenauer edited comment on HDFS-12711 at 10/25/17 7:27 PM: -

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219353#comment-16219353 ] Allen Wittenauer commented on HDFS-12711: - Re-launched the agent using the Jenkins

[jira] [Updated] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-25 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12521: --- Attachment: HDFS-12521-HDFS-7240.007.patch I have uploaded v7 patch to preserve the old json format. I

[jira] [Updated] (HDFS-12712) [9806] Code style cleanup

2017-10-25 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12712: --- Description: The code for HDFS-9806 could use some style cleaning before merging. > [9806] Code style

[jira] [Created] (HDFS-12712) [9806] Code style cleanup

2017-10-25 Thread JIRA
Íñigo Goiri created HDFS-12712: -- Summary: [9806] Code style cleanup Key: HDFS-12712 URL: https://issues.apache.org/jira/browse/HDFS-12712 Project: Hadoop HDFS Issue Type: Sub-task Re

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219295#comment-16219295 ] Allen Wittenauer commented on HDFS-12711: - Uh that was unexpected. Accord

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Patch Available (was: Open) > [READ] FsVolumeImpl exception when scanning Provi

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219285#comment-16219285 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Attachment: HDFS-12685-HDFS-9806.001.patch Posting a patch that fixes the construction o

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.06.patch v06 proposes to move the check for {{instanceof LocatedFileStatus}

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219278#comment-16219278 ] Anu Engineer commented on HDFS-12702: - is there a reason to use curl and install inste

[jira] [Updated] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HDFS-12711: --- Affects Version/s: 2.8.2 2.9.0 > deadly hdfs test > > >

[jira] [Updated] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated HDFS-12711: --- Priority: Critical (was: Major) > deadly hdfs test > > > Key: HDFS-1

[jira] [Commented] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219271#comment-16219271 ] Anu Engineer commented on HDFS-12678: - [~elek] Let us track this even if this is not a

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219250#comment-16219250 ] Anu Engineer commented on HDFS-12521: - bq. I can just include the pipeline itself and

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-25 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219246#comment-16219246 ] Lokesh Jain commented on HDFS-12521: I can just include the pipeline itself and ignore

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219243#comment-16219243 ] Allen Wittenauer commented on HDFS-12711: - OK, messing with OOM from the docker pe

[jira] [Updated] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12544: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Av

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

2017-10-25 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219224#comment-16219224 ] Manoj Govindassamy commented on HDFS-12544: --- Thanks for the review [~yzhangal].

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219220#comment-16219220 ] Chris Douglas commented on HDFS-12681: -- The head of my dev branch wasn't the latest v

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.05.patch > Fold HdfsLocatedFileStatus into HdfsFileStatus > ---

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Attachment: HDFS-12607-HDFS-9806.002.patch Posting a new patch based on [~goiri]'s comme

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Patch Available (was: Open) > [READ] Even one dead datanode with PROVIDED stora

[jira] [Comment Edited] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219181#comment-16219181 ] Istvan Fajth edited comment on HDFS-12710 at 10/25/17 5:57 PM: -

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219181#comment-16219181 ] Istvan Fajth commented on HDFS-12710: - Hi [~jzhuge], Thank you for checking into this

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219178#comment-16219178 ] stack commented on HDFS-12711: -- Rah rah [~aw]! Thanks for digging in. > deadly hdfs test > -

[jira] [Updated] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12482: - Attachment: HDFS-12482.05.patch Update to fix checkstyle warnings. > Provide a configuration to a

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219170#comment-16219170 ] Hadoop QA commented on HDFS-12710: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12641) Backport HDFS-11755 into branch-2.7 to fix a regression in HDFS-11445

2017-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219162#comment-16219162 ] Arpit Agarwal commented on HDFS-12641: -- Hi [~jojochuang], thanks for reporting this.

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

2017-10-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219155#comment-16219155 ] Rakesh R commented on HDFS-12682: - [~xiaochen] Good catch! Thanks for the quick updates.

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219150#comment-16219150 ] Anu Engineer commented on HDFS-12521: - Thanks for updating the patch. Can you please r

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and FileRegionPr

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Open (was: Patch Available) > [READ] Even one dead datanode with PROVIDED stora

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-25 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and FileRegionPr

[jira] [Updated] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-25 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12521: --- Attachment: HDFS-12521-HDFS-7240.006.patch Thanks for the review [~xyao] and [~anu]. v6 patch addresse

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219130#comment-16219130 ] John Zhuge commented on HDFS-12710: --- [~pifta] Thanks for the contribution! Is this a bu

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219103#comment-16219103 ] Allen Wittenauer commented on HDFS-12711: - Total run time was a bit over an hour.

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219099#comment-16219099 ] Allen Wittenauer commented on HDFS-12711: - Hooray it crashed! > deadly hdfs test

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

2017-10-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.03.patch Thanks for the review Eddy! Had some offline discussions with Eddy to cla

[jira] [Commented] (HDFS-12648) DN should provide feedback to NN for throttling commands

2017-10-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219082#comment-16219082 ] Daryn Sharp commented on HDFS-12648: Yes, today commands are processed synchronously w

[jira] [Updated] (HDFS-4493) webhdfs fails after SPNEGO token expires

2017-10-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4493: -- Release Note: (was: This issue was fixed years ago when authenticated url was removed from webhdfs.) >

[jira] [Resolved] (HDFS-4493) webhdfs fails after SPNEGO token expires

2017-10-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4493. --- Resolution: Works for Me Release Note: This issue was fixed years ago when authenticated url was

  1   2   >