[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944751#comment-16944751 ] Erik Krogen commented on HDFS-14245: Backported to 3.2 and 3.1, but this depends on H

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945995#comment-16945995 ] Erik Krogen commented on HDFS-14655: Got it. +1 from me on the branch-2 patch but can

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Status: Patch Available (was: Reopened) > Balancer should work with ObserverNode > -

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947051#comment-16947051 ] Erik Krogen commented on HDFS-14655: Thanks [~ayushtkn]! > [SBN Read] Namenode crash

[jira] [Commented] (HDFS-15323) StandbyNode fails transition to active due to insufficient transaction tailing

[ https://issues.apache.org/jira/browse/HDFS-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099021#comment-17099021 ] Erik Krogen commented on HDFS-15323: +1 pretty simple fix, LGTM. > StandbyNode fails

[jira] [Commented] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

[ https://issues.apache.org/jira/browse/HDFS-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099220#comment-17099220 ] Erik Krogen commented on HDFS-13904: Hi [~umamaheswararao], I'm not actively working

[jira] [Commented] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

[ https://issues.apache.org/jira/browse/HDFS-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17100870#comment-17100870 ] Erik Krogen commented on HDFS-13904: Looks like I must have confused {{getReadHoldCou

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113269#comment-17113269 ] Erik Krogen commented on HDFS-15368: cc [~vagarychen] and [~shv] > TestBalancerWithH

[jira] [Assigned] (HDFS-14084) Need for more stats in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14084: -- Assignee: (was: Erik Krogen) > Need for more stats in DFSClient >

[jira] [Commented] (HDFS-14084) Need for more stats in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203485#comment-17203485 ] Erik Krogen commented on HDFS-14084: Hey [~sodonnell], thanks for the ping. Internall

[jira] [Commented] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854726#comment-16854726 ] Erik Krogen commented on HDFS-14528: I'm not too familiar with ZKFC so would prefer t

[jira] [Comment Edited] (HDFS-14528) [SBN Read]Failover from Active to Standby Failed

[ https://issues.apache.org/jira/browse/HDFS-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854726#comment-16854726 ] Erik Krogen edited comment on HDFS-14528 at 6/3/19 3:38 PM: T

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854937#comment-16854937 ] Erik Krogen commented on HDFS-12979: Hey [~vagarychen], the new test case LGTM, altho

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855129#comment-16855129 ] Erik Krogen commented on HDFS-14090: [~crh], I took a look at the design document and

[jira] [Created] (HDFS-14539) Remove Dynamometer's reliance on the tar utility

Erik Krogen created HDFS-14539: -- Summary: Remove Dynamometer's reliance on the tar utility Key: HDFS-14539 URL: https://issues.apache.org/jira/browse/HDFS-14539 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855156#comment-16855156 ] Erik Krogen commented on HDFS-12345: Dropped this for a while, but would really like

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes.

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855160#comment-16855160 ] Erik Krogen commented on HDFS-14090: Is it possible to at least make it a subclass of

[jira] [Commented] (HDFS-14537) Journaled Edits Cache is not cleared when formatting the JN

[ https://issues.apache.org/jira/browse/HDFS-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855850#comment-16855850 ] Erik Krogen commented on HDFS-14537: Thanks for the ping [~brahmareddy]! Instead of u

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Attachment: HDFS-14403.008.patch > Cost-Based RPC FairCallQueue > > >

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860476#comment-16860476 ] Erik Krogen commented on HDFS-14403: Thanks a lot for the review [~csun]. These are a

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16862277#comment-16862277 ] Erik Krogen commented on HDFS-14547: [~LiJinglun], thanks for taking this up, it seem

[jira] [Commented] (HDFS-14537) Journaled Edits Cache is not cleared when formatting the JN

[ https://issues.apache.org/jira/browse/HDFS-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863161#comment-16863161 ] Erik Krogen commented on HDFS-14537: +1 from me as well, thanks [~RANith] and [~brahm

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Attachment: HDFS-14403.009.patch > Cost-Based RPC FairCallQueue > > >

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866024#comment-16866024 ] Erik Krogen commented on HDFS-14403: Just attached v009 patch. The v008 -> v009 chang

[jira] [Commented] (HDFS-14573) Backport Standby Read to branch-3

[ https://issues.apache.org/jira/browse/HDFS-14573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16867744#comment-16867744 ] Erik Krogen commented on HDFS-14573: For both this and HDFS-14204, let's make sure th

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868004#comment-16868004 ] Erik Krogen commented on HDFS-14403: Thanks [~csun]! # Yeah, it works the same as all

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Attachment: HDFS-14403.010.patch > Cost-Based RPC FairCallQueue > > >

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Attachment: HDFS-14403.011.patch > Cost-Based RPC FairCallQueue > > >

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868614#comment-16868614 ] Erik Krogen commented on HDFS-14403: Forgot to update {{TestProcessingDetails}} when

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12345: --- Attachment: HDFS-12345.007.patch > Scale testing HDFS NameNode with real metadata and workloads (Dyna

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868718#comment-16868718 ] Erik Krogen commented on HDFS-12345: Attached v007 patch which: * Adds assumptions ab

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868819#comment-16868819 ] Erik Krogen commented on HDFS-14403: Shoot... I did indeed think you were a committer

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868939#comment-16868939 ] Erik Krogen commented on HDFS-14403: Hey [~elgoiri], interesting question... I haven'

[jira] [Commented] (HDFS-14588) Client retries Standby NN continuously even if Active NN is available (WebHDFS)

[ https://issues.apache.org/jira/browse/HDFS-14588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16868968#comment-16868968 ] Erik Krogen commented on HDFS-14588: Seems like bad behavior. Am I correct in saying

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869723#comment-16869723 ] Erik Krogen commented on HDFS-14034: We want to tackle it pretty soon, but if you hav

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Attachment: HDFS-14403.012.patch > Cost-Based RPC FairCallQueue > > >

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869737#comment-16869737 ] Erik Krogen commented on HDFS-14403: Thanks [~elgoiri]! Great suggestions. I have app

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869780#comment-16869780 ] Erik Krogen commented on HDFS-12345: Thanks [~jojochuang], that's a great catch. I ch

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12345: --- Attachment: HDFS-12345.008.patch > Scale testing HDFS NameNode with real metadata and workloads (Dyna

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12345: --- Attachment: HDFS-12345.009.patch > Scale testing HDFS NameNode with real metadata and workloads (Dyna

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16869951#comment-16869951 ] Erik Krogen commented on HDFS-12345: Attached v009 fixing a few of the last remaining

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871256#comment-16871256 ] Erik Krogen commented on HDFS-12345: I think this is ready to be committed, for follo

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871395#comment-16871395 ] Erik Krogen commented on HDFS-14547: Thanks for the ping, I will try to review this w

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Attachment: HDFS-14403.013.patch > Cost-Based RPC FairCallQueue > > >

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871396#comment-16871396 ] Erik Krogen commented on HDFS-14403: Thanks [~elgoiri]! Attached v13 without the unus

[jira] [Commented] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871702#comment-16871702 ] Erik Krogen commented on HDFS-14403: Just committed this to trunk. Thanks for the rev

[jira] [Commented] (HDFS-12748) NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

[ https://issues.apache.org/jira/browse/HDFS-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16871776#comment-16871776 ] Erik Krogen commented on HDFS-12748: [~cheersyang] are you still interested in workin

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) > C

[jira] [Updated] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12345: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) > S

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872433#comment-16872433 ] Erik Krogen commented on HDFS-12345: I just committed this to trunk. Huge thank you t

[jira] [Commented] (HDFS-14410) Make Dynamometer documentation properly compile onto the Hadoop site

[ https://issues.apache.org/jira/browse/HDFS-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16872435#comment-16872435 ] Erik Krogen commented on HDFS-14410: We can start from the README of the Dynamometer

[jira] [Assigned] (HDFS-14410) Make Dynamometer documentation properly compile onto the Hadoop site

[ https://issues.apache.org/jira/browse/HDFS-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14410: -- Assignee: Erik Krogen > Make Dynamometer documentation properly compile onto the Hadoop site >

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874282#comment-16874282 ] Erik Krogen commented on HDFS-14611: Hi [~vagarychen], I haven't yet taken a look at

[jira] [Commented] (HDFS-14611) Move handshake secret field from Token to BlockAccessToken

[ https://issues.apache.org/jira/browse/HDFS-14611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874357#comment-16874357 ] Erik Krogen commented on HDFS-14611: Makes sense, thank you for the detailed explanat

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874493#comment-16874493 ] Erik Krogen commented on HDFS-14547: [~LiJinglun] I just took a look, thanks a lot fo

[jira] [Comment Edited] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16874493#comment-16874493 ] Erik Krogen edited comment on HDFS-14547 at 6/27/19 8:41 PM: -

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875022#comment-16875022 ] Erik Krogen commented on HDFS-14547: [~LiJinglun], the new patch looks really good, I

[jira] [Commented] (HDFS-11069) Tighten the authorization of datanode RPC

[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146182#comment-16146182 ] Erik Krogen commented on HDFS-11069: Hey [~kihwal], it looks like you missed some fix

[jira] [Commented] (HDFS-11069) Tighten the authorization of datanode RPC

[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16147611#comment-16147611 ] Erik Krogen commented on HDFS-11069: Ah, thank you for the context, Kihwal. I am too n

[jira] [Work started] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12323 started by Erik Krogen. -- > NameNode terminates after full GC thinking QJM unresponsive if full GC is > much l

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Status: Patch Available (was: In Progress) > NameNode terminates after full GC thinking QJM unrespons

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Attachment: HDFS-12323.000.patch Attaching v000 patch which solves the issue by measuring the estimate

[jira] [Reopened] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reopened HDFS-12131: > Add some of the FSNamesystem JMX values as metrics > -

[jira] [Updated] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12131: --- Status: Patch Available (was: Reopened) > Add some of the FSNamesystem JMX values as metrics > --

[jira] [Updated] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12131: --- Attachment: HDFS-12131-branch-2.7.006.patch Reopening to attach branch-2.7 patch as well. It required

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Attachment: HDFS-12323.001.patch Attaching v001 patch which now does include the unit test. > NameNod

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156146#comment-16156146 ] Erik Krogen commented on HDFS-12131: Thank you Konstantin! > Add some of the FSNamesy

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16159381#comment-16159381 ] Erik Krogen commented on HDFS-12323: TestLeaseRecoveryStriped is failing for me with o

[jira] [Created] (HDFS-12421) Balancer to emit standard metrics

Erik Krogen created HDFS-12421: -- Summary: Balancer to emit standard metrics Key: HDFS-12421 URL: https://issues.apache.org/jira/browse/HDFS-12421 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16163146#comment-16163146 ] Erik Krogen commented on HDFS-12323: Thanks for the review [~shv]! Actually it is not

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Attachment: HDFS-12323.002.patch Alright, seems fair. Attaching v002 patch; only difference is the add

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Target Version/s: 2.7.5 > NameNode terminates after full GC thinking QJM unresponsive if full GC is >

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Attachment: HDFS-12323.003.patch Thanks Konstantin. Fixed the whitespace issue and an unused import is

[jira] [Updated] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12323: --- Attachment: HDFS-12323.004.patch Right. v004 patch adds {{final}} to solve Java 7 compilation issues.

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168543#comment-16168543 ] Erik Krogen commented on HDFS-12323: Thank you [~shv]! Should this also go in branch-3

[jira] [Created] (HDFS-12533) NNThroughputBenchmark threads get stuck on UGI.getCurrentUser()

Erik Krogen created HDFS-12533: -- Summary: NNThroughputBenchmark threads get stuck on UGI.getCurrentUser() Key: HDFS-12533 URL: https://issues.apache.org/jira/browse/HDFS-12533 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12533) NNThroughputBenchmark threads get stuck on UGI.getCurrentUser()

[ https://issues.apache.org/jira/browse/HDFS-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12533: --- Description: In {{NameNode#getRemoteUser()}}, it first attempts to fetch from the RPC user (not a syn

[jira] [Commented] (HDFS-12533) NNThroughputBenchmark threads get stuck on UGI.getCurrentUser()

[ https://issues.apache.org/jira/browse/HDFS-12533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181275#comment-16181275 ] Erik Krogen commented on HDFS-12533: Hm yes, HADOOP-9747 should definitely help the is

[jira] [Commented] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193437#comment-16193437 ] Erik Krogen commented on HDFS-12502: Hey [~zhz], seems a good improvement. One minor n

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198813#comment-16198813 ] Erik Krogen commented on HDFS-11707: I agree with you, thanks [~ehiggs]. Closing out a

[jira] [Resolved] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-11707. Resolution: Duplicate > TestDirectoryScanner#testThrottling fails on OSX > -

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16199141#comment-16199141 ] Erik Krogen commented on HDFS-12621: {{addDelegationTokens}} had to be added to accomm

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206309#comment-16206309 ] Erik Krogen commented on HDFS-12621: I don't think Option 2 is the right approach; thi

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212782#comment-16212782 ] Erik Krogen commented on HDFS-12621: Hm... There is some reference in the design docum

[jira] [Created] (HDFS-12746) DataNode Audit Logger

Erik Krogen created HDFS-12746: -- Summary: DataNode Audit Logger Key: HDFS-12746 URL: https://issues.apache.org/jira/browse/HDFS-12746 Project: Hadoop HDFS Issue Type: Improvement Compo

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225664#comment-16225664 ] Erik Krogen commented on HDFS-12746: Thanks for the feedback [~anu]! I agree with you

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12219: --- Target Version/s: 3.1.0 > Javadoc for FSNamesystem#getMaxObjects is incorrect > --

[jira] [Commented] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227459#comment-16227459 ] Erik Krogen commented on HDFS-12219: Hey [~ajisakaa], I am not a committer, care to pu

[jira] [Comment Edited] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227459#comment-16227459 ] Erik Krogen edited comment on HDFS-12219 at 10/31/17 8:25 PM: --

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12219: --- Fix Version/s: 3.1.0 > Javadoc for FSNamesystem#getMaxObjects is incorrect > -

[jira] [Updated] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

[ https://issues.apache.org/jira/browse/HDFS-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12219: --- Fix Version/s: (was: 3.1.0) > Javadoc for FSNamesystem#getMaxObjects is incorrect > --

[jira] [Resolved] (HDFS-12803) We should not lock FsNamesystem even we operate a sub directory, we should refinement the lock

[ https://issues.apache.org/jira/browse/HDFS-12803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-12803. Resolution: Duplicate This is a longstanding request tracked in HDFS-5453 > We should not lock FsNa

[jira] [Work started] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12818 started by Erik Krogen. -- > Support multiple storages in DataNodeCluster / SimulatedFSDataset > ---

[jira] [Created] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

Erik Krogen created HDFS-12818: -- Summary: Support multiple storages in DataNodeCluster / SimulatedFSDataset Key: HDFS-12818 URL: https://issues.apache.org/jira/browse/HDFS-12818 Project: Hadoop HDFS

[jira] [Created] (HDFS-12817) Support multiple storages in DataNodeCluster / SimulatedFSDataset

Erik Krogen created HDFS-12817: -- Summary: Support multiple storages in DataNodeCluster / SimulatedFSDataset Key: HDFS-12817 URL: https://issues.apache.org/jira/browse/HDFS-12817 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12818: --- Status: Patch Available (was: In Progress) > Support multiple storages in DataNodeCluster / Simulated

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12818: --- Attachment: HDFS-12818.000.patch Attaching v000 patch. {{SimulatedFSDataset}} now stores a list of {{

[jira] [Commented] (HDFS-12817) Support multiple storages in DataNodeCluster / SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-12817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253953#comment-16253953 ] Erik Krogen commented on HDFS-12817: Thanks [~jlowe], don't know what happened here.

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12818: --- Attachment: HDFS-12818.001.patch Attaching v001 patch to address license issues. Looked through the t

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12818: --- Attachment: (was: HDFS-12818.001.patch) > Support multiple storages in DataNodeCluster / Simulated

<    1   2   3   4   5   6   7   8   9   10   >