[jira] [Updated] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

2023-03-03 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16923: --- Fix Version/s: 3.3.5 > The getListing RPC will throw NPE if the path does not exist >

[jira] [Updated] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

2023-03-03 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16923: --- Fix Version/s: (was: 3.3.6) > The getListing RPC will throw NPE if the path does not exist >

[jira] [Updated] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

2023-03-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16923: --- Fix Version/s: 3.4.0 3.3.6 > The getListing RPC will throw NPE if the path does

[jira] [Resolved] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

2023-03-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16923. Resolution: Fixed > The getListing RPC will throw NPE if the path does not exist >

[jira] [Updated] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

2023-03-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16923: --- Priority: Critical (was: Major) > The getListing RPC will throw NPE if the path does not exist >

[jira] [Resolved] (HDFS-16764) ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2023-01-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16764. Resolution: Fixed > ObserverNamenode handles addBlock rpc and throws a FileNotFoundException >

[jira] [Updated] (HDFS-16764) ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2023-01-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16764: --- Fix Version/s: 3.3.9 (was: 3.3.6) > ObserverNamenode handles addBlock rpc and

[jira] [Updated] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2023-01-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16872: --- Fix Version/s: 3.3.9 (was: 3.3.6) > Fix log throttling by declaring

[jira] [Resolved] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2023-01-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16872. Resolution: Fixed > Fix log throttling by declaring LogThrottlingHelper as static members >

[jira] [Updated] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

2023-01-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16872: --- Fix Version/s: 3.4.0 3.2.5 3.3.6 > Fix log throttling by

[jira] [Resolved] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

2022-12-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16689. Resolution: Fixed > Standby NameNode crashes when transitioning to Active with in-progress tailer

[jira] [Commented] (HDFS-16853) The UT TestLeaseRecovery2#testHardLeaseRecoveryAfterNameNodeRestart failed because HADOOP-18324

2022-12-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17650959#comment-17650959 ] Erik Krogen commented on HDFS-16853: [~omalley]  any thoughts on the PR?  > The UT

[jira] [Updated] (HDFS-16764) ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

2022-12-20 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16764: --- Fix Version/s: 3.4.0 3.3.6 > ObserverNamenode handles addBlock rpc and throws a

[jira] [Resolved] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2022-12-16 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16852. Resolution: Fixed > Register the shutdown hook only when not in shutdown for KeyProviderCache >

[jira] [Updated] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2022-12-16 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16852: --- Fix Version/s: 2.10.3 > Register the shutdown hook only when not in shutdown for KeyProviderCache >

[jira] [Updated] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2022-12-16 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16852: --- Fix Version/s: 3.3.6 (was: 3.3.5) > Register the shutdown hook only when not

[jira] [Updated] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2022-12-16 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16852: --- Fix Version/s: 3.3.5 > Register the shutdown hook only when not in shutdown for KeyProviderCache >

[jira] [Updated] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

2022-12-16 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16852: --- Fix Version/s: 3.4.0 > Register the shutdown hook only when not in shutdown for KeyProviderCache >

[jira] [Resolved] (HDFS-16550) [SBN read] Improper cache-size for journal node may cause cluster crash

2022-11-30 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16550. Fix Version/s: 3.4.0 Resolution: Fixed > [SBN read] Improper cache-size for journal node

[jira] [Commented] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17636809#comment-17636809 ] Erik Krogen commented on HDFS-16832: Merged to branch-3.3 as well since that has HDFS-16732 also. >

[jira] [Resolved] (HDFS-16547) [SBN read] Namenode in safe mode should not be transfered to observer state

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16547. Resolution: Fixed > [SBN read] Namenode in safe mode should not be transfered to observer state >

[jira] [Updated] (HDFS-16547) [SBN read] Namenode in safe mode should not be transfered to observer state

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16547: --- Fix Version/s: 3.4.0 > [SBN read] Namenode in safe mode should not be transfered to observer state >

[jira] [Resolved] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16832. Resolution: Fixed > [SBN READ] Fix NPE when check the block location of empty directory >

[jira] [Updated] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16832: --- Fix Version/s: 3.3.5 > [SBN READ] Fix NPE when check the block location of empty directory >

[jira] [Commented] (HDFS-16732) [SBN READ] Avoid get location from observer when the block report is delayed.

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17636765#comment-17636765 ] Erik Krogen commented on HDFS-16732: Note that a bug with this change was reported, and now fixed, in

[jira] [Updated] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

2022-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16832: --- Fix Version/s: 3.4.0 > [SBN READ] Fix NPE when check the block location of empty directory >

[jira] [Commented] (HDFS-13791) Limit logging frequency of edit tail related statements

2022-11-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17635998#comment-17635998 ] Erik Krogen commented on HDFS-13791: Hi [~chengbing.liu], good callout. I would be supportive of

[jira] [Commented] (HDFS-16771) JN should tersely print logs about NewerTxnIdException

2022-10-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620476#comment-17620476 ] Erik Krogen commented on HDFS-16771: Thanks for catching my mistake [~ferhui] ! > JN should tersely

[jira] [Commented] (HDFS-16682) [SBN Read] make estimated transactions configurable

2022-09-20 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607344#comment-17607344 ] Erik Krogen commented on HDFS-16682: I remember at the time we built this feature, [~shv]  had

[jira] [Updated] (HDFS-16771) JN should tersely print logs about NewerTxnIdException

2022-09-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16771: --- Fix Version/s: 3.4.0 > JN should tersely print logs about NewerTxnIdException >

[jira] [Resolved] (HDFS-16659) JournalNode should throw NewerTxnIdException if SinceTxId is bigger than HighestWrittenTxId

2022-09-06 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16659. Fix Version/s: 3.4.0 Resolution: Fixed > JournalNode should throw NewerTxnIdException if

[jira] [Resolved] (HDFS-16732) [SBN READ] Avoid get location from observer when the block report is delayed.

2022-08-25 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16732. Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed Merged PR 4756 to trunk and

[jira] [Commented] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572562#comment-17572562 ] Erik Krogen commented on HDFS-13522: Thanks for sharing [~xuzq_zander], very interesting! {quote} I

[jira] [Comment Edited] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572562#comment-17572562 ] Erik Krogen edited comment on HDFS-13522 at 7/28/22 5:01 PM: - Thanks for

[jira] [Commented] (HDFS-16696) NameNode supports a new MsyncRPCServer to handle msync() RPC separately

2022-07-27 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572023#comment-17572023 ] Erik Krogen commented on HDFS-16696: Generally +1 from me as long as we can get it done without

[jira] [Comment Edited] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-27 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572017#comment-17572017 ] Erik Krogen edited comment on HDFS-13522 at 7/27/22 4:27 PM: - [~xuzq_zander]

[jira] [Commented] (HDFS-13522) RBF: Support observer node from Router-Based Federation

2022-07-27 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572017#comment-17572017 ] Erik Krogen commented on HDFS-13522: [~xuzq_zander] I'm curious to learn more about your use case. I

[jira] [Commented] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-04-14 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522432#comment-17522432 ] Erik Krogen commented on HDFS-16507: Sounds good, thanks for that context. > [SBN read] Avoid

[jira] [Commented] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-04-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521809#comment-17521809 ] Erik Krogen commented on HDFS-16507: {quote} Do you mean, if the situation arises that `

[jira] [Commented] (HDFS-16507) [SBN read] Avoid purging edit log which is in progress

2022-04-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521381#comment-17521381 ] Erik Krogen commented on HDFS-16507: [~tomscut] -- thanks for changing the assert to a

[jira] [Commented] (HDFS-16493) [SBN Read]When fast path tail enabled, standby or observer namenode may read uncommitted data

2022-03-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501435#comment-17501435 ] Erik Krogen commented on HDFS-16493: Thanks for reporting [~liutongwei]! I guess this is a

[jira] [Resolved] (HDFS-16181) [SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN

2021-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16181. Fix Version/s: 3.1.5 3.2.4 3.3.2 2.10.2

[jira] [Updated] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-24 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-16233: --- Fix Version/s: 3.3.2 3.2.3 2.10.2 3.4.0

[jira] [Resolved] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-24 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16233. Resolution: Fixed > Do not use exception handler to implement copy-on-write for EnumCounters >

[jira] [Commented] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

2021-09-24 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419878#comment-17419878 ] Erik Krogen commented on HDFS-16233: Merged to {{trunk}} and backported to branch-3.3, branch-3.2,

[jira] [Commented] (HDFS-13150) [Edit Tail Fast Path] Allow SbNN to tail in-progress edits from JN via RPC

2021-09-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415662#comment-17415662 ] Erik Krogen commented on HDFS-13150: [~liutongwei] thanks for sharing your concern! I don't quite

[jira] [Commented] (HDFS-16181) [SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN

2021-09-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415645#comment-17415645 ] Erik Krogen commented on HDFS-16181: Committed to trunk via PR #3317 and backported to branch-3.3,

[jira] [Commented] (HDFS-15808) Add metrics for FSNamesystem read/write lock hold long time

2021-02-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287156#comment-17287156 ] Erik Krogen commented on HDFS-15808: I agree with [~tomscut] here, as long as the metric is marked as

[jira] [Commented] (HDFS-15808) Add metrics for FSNamesystem read/write lock warnings

2021-02-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282570#comment-17282570 ] Erik Krogen commented on HDFS-15808: Hi [~tomscut], the proposal looks pretty reasonable to me from a

[jira] [Assigned] (HDFS-10873) Add histograms for FSNamesystemLock Metrics

2021-02-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-10873: -- Assignee: (was: Erik Krogen) > Add histograms for FSNamesystemLock Metrics >

[jira] [Commented] (HDFS-13609) [Edit Tail Fast Path Pt 3] NameNode-side changes to support tailing edits via RPC

2021-02-03 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278150#comment-17278150 ] Erik Krogen commented on HDFS-13609: Thanks for the detailed explanation and example [~xuzq_zander]!

[jira] [Commented] (HDFS-13609) [Edit Tail Fast Path Pt 3] NameNode-side changes to support tailing edits via RPC

2021-02-02 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277250#comment-17277250 ] Erik Krogen commented on HDFS-13609: Hi [~xuzq_zander], thanks for taking a look. {quote} when

[jira] [Commented] (HDFS-14084) Need for more stats in DFSClient

2020-09-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203485#comment-17203485 ] Erik Krogen commented on HDFS-14084: Hey [~sodonnell], thanks for the ping. Internally we decided to

[jira] [Assigned] (HDFS-14084) Need for more stats in DFSClient

2020-09-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14084: -- Assignee: (was: Erik Krogen) > Need for more stats in DFSClient >

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113269#comment-17113269 ] Erik Krogen commented on HDFS-15368: cc [~vagarychen] and [~shv] >

[jira] [Commented] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

2020-05-06 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100870#comment-17100870 ] Erik Krogen commented on HDFS-13904: Looks like I must have confused {{getReadHoldCount()}} and

[jira] [Commented] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

2020-05-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099220#comment-17099220 ] Erik Krogen commented on HDFS-13904: Hi [~umamaheswararao], I'm not actively working on this. I don't

[jira] [Commented] (HDFS-15323) StandbyNode fails transition to active due to insufficient transaction tailing

2020-05-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099021#comment-17099021 ] Erik Krogen commented on HDFS-15323: +1 pretty simple fix, LGTM. > StandbyNode fails transition to

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2020-03-23 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065103#comment-17065103 ] Erik Krogen commented on HDFS-14442: Apologies, I was on leave when pinged earlier. Thanks a lot for

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998387#comment-16998387 ] Erik Krogen commented on HDFS-14519: Awesome, thanks [~ayushtkn]! > NameQuota is not update after

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994870#comment-16994870 ] Erik Krogen commented on HDFS-14519: Thanks for the update :) I am +1 on the backport as long as the

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994820#comment-16994820 ] Erik Krogen commented on HDFS-14519: Hi [~ayushtkn], it looks like the {{branch-2.10-003}} patch you

[jira] [Updated] (HDFS-15044) [Dynamometer] Show the line of audit log when parsing it unsuccessfully

2019-12-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15044: --- Resolution: Fixed Status: Resolved (was: Patch Available) > [Dynamometer] Show the line of

[jira] [Updated] (HDFS-15044) [Dynamometer] Show the line of audit log when parsing it unsuccessfully

2019-12-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15044: --- Fix Version/s: 3.3.0 > [Dynamometer] Show the line of audit log when parsing it unsuccessfully >

[jira] [Commented] (HDFS-15044) [Dynamometer] Show the line of audit log when parsing it unsuccessfully

2019-12-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994803#comment-16994803 ] Erik Krogen commented on HDFS-15044: Just committed this to trunk. Thanks for the contribution

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Resolution: Fixed Status: Resolved (was: Patch Available) Just committed this to trunk ~

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Fix Version/s: 2.10.1 3.2.2 3.1.4 3.3.0 >

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993718#comment-16993718 ] Erik Krogen commented on HDFS-14519: Hi [~ayushtkn], just want to check if you still plan to work on

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992999#comment-16992999 ] Erik Krogen commented on HDFS-15032: I'm not seeing the test failures locally and it looks like the

[jira] [Comment Edited] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992719#comment-16992719 ] Erik Krogen edited comment on HDFS-15032 at 12/10/19 4:35 PM: -- Thanks for

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992719#comment-16992719 ] Erik Krogen commented on HDFS-15032: Thanks for the info [~shv], good to know. I've removed the

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.005.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Issue Comment Deleted] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991822#comment-16991822 ] Erik Krogen commented on HDFS-15032: It looks like Yetus was trying to pick up the image as a patch:

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.004.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991806#comment-16991806 ] Erik Krogen commented on HDFS-15032: Hey [~shv], that's a great question. In many cases, only a

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: debugger_with_tostring.png > Balancer crashes when it fails to contact an unavailable NN

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: debugger_without_tostring.png > Balancer crashes when it fails to contact an unavailable

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.003.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-06 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989926#comment-16989926 ] Erik Krogen commented on HDFS-15032: [~shv] can you take a look at the v2 patch when you have a

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989125#comment-16989125 ] Erik Krogen commented on HDFS-15032: The new test case was failing due to interference between the

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.002.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.001.patch > Balancer crashes when it fails to contact an unavailable NN via

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

2019-12-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Summary: Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider

2019-12-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Attachment: HDFS-15032.000.patch > Balancer crashes when it fails to contact an NN via

[jira] [Updated] (HDFS-15032) Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider

2019-12-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-15032: --- Status: Patch Available (was: Open) > Balancer crashes when it fails to contact an NN via

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider

2019-12-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988094#comment-16988094 ] Erik Krogen commented on HDFS-15032: This was caused because the {{RpcInvocationHandler}} defined as

[jira] [Commented] (HDFS-15032) Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider

2019-12-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988082#comment-16988082 ] Erik Krogen commented on HDFS-15032: You'll get an exception like: {code} 19/12/04 18:17:44 ERROR

[jira] [Created] (HDFS-15032) Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider

2019-12-04 Thread Erik Krogen (Jira)
Erik Krogen created HDFS-15032: -- Summary: Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider Key: HDFS-15032 URL: https://issues.apache.org/jira/browse/HDFS-15032 Project:

[jira] [Commented] (HDFS-14519) NameQuota is not update after concat operation, so namequota is wrong

2019-12-03 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987291#comment-16987291 ] Erik Krogen commented on HDFS-14519: [~RANith] or [~ayushtkn], are you interested in putting together

[jira] [Commented] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-12-02 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986173#comment-16986173 ] Erik Krogen commented on HDFS-14969: I linked HDFS-15024 which describes a similar issue. I think the

[jira] [Commented] (HDFS-15024) [SBN read] In FailoverOnNetworkExceptionRetry , Number of NameNodes as a condition of calculation of sleep time

2019-12-02 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986171#comment-16986171 ] Erik Krogen commented on HDFS-15024: This seems fairly closely related to HDFS-14969. Both issues are

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-26 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983042#comment-16983042 ] Erik Krogen commented on HDFS-14973: Just committed v005 to branch-2 (and branch-2.10 for good

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-26 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Balancer getBlocks RPC

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-26 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Fix Version/s: 2.11.0 2.10.1 > Balancer getBlocks RPC dispersal does not function

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-26 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982721#comment-16982721 ] Erik Krogen commented on HDFS-14973: Thanks for the review [~shv]! I addressed your comments in

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-26 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973-branch-2.005.patch > Balancer getBlocks RPC dispersal does not function

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979612#comment-16979612 ] Erik Krogen commented on HDFS-14884: Changing the assignee back to [~msingh] just to reflect that

[jira] [Assigned] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-11-21 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14884: -- Assignee: Mukul Kumar Singh (was: Yuval Degani) > Add sanity check that zone key equals

[jira] [Commented] (HDFS-14991) Backport HDFS-14346 Better time precision in getTimeDuration to branch-2

2019-11-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976991#comment-16976991 ] Erik Krogen commented on HDFS-14991: I don't think we'll backport HDFS-9847 -- as noted in some of

  1   2   3   4   5   6   7   8   9   10   >