Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

Hi folks, apologies for being late to the release conversation, but I think we need to get HDFS-16923 into 3.3.5. HDFS-16732 , which also went into 3.3.5, introduced an issue whereby Observer NameNo

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

Thanks Steve. I see now that the branch cut was way back in October so I definitely understand your frustration here! This made me realize that HDFS-16832 , which resolves a very similar issue as the aforementioned HDFS-16923, is also missing from

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

ct were able to get completed > > within timeout). > > > > > > On Sat, Mar 4, 2023 at 4:29 AM Steve Loughran > > > > > wrote: > > > > > On Sat, 4 Mar 2023 at 01:47, Erik Krogen wrote: > > > > > > > Thanks Steve. I see no

Re: [ANNOUNCE] New Hadoop Committer - Simbarashe Dzinamarira

Congratulations Simba! Thanks for the great work you've done on making HDFS more scalable! On Mon, Oct 2, 2023 at 4:31 PM Iñigo Goiri wrote: > I am pleased to announce that Simbarashe Dzinamarira has been elected as a > committer on the Apache Hadoop project. > We appreciate all of Simbarashe's

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

Thanks for putting this together, Jonathan! I noticed that the RELEASENOTES.md makes no mention of any of the major features you mentioned in your email about the RC. Is this expected? I guess it is caused by the lack of a release note on the JIRAs for those features. I also noticed that buildi

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC1)

Sounds good to me, thank you for addressing the concerns Jonathan. +1 from me. From: Masatake Iwasaki Sent: Monday, October 28, 2019 7:52 AM To: Jonathan Hung ; Hdfs-dev ; mapreduce-dev ; yarn-dev ; Hadoop Common Subject: Re: [VOTE] Release Apache Hadoop 2.10.

Re: [DISCUSS] Making 2.10 the last minor 2.x release

I'm in support of this. The current scheme is confusing, and as you mentioned, is making the backport strategy less clear. It reminds me of the branch-2.8 vs. branch-2 (destined for 2.9) days when various fixes would make it into one or the other. One other action item would be to do a quick verif

Re: VOTE] Release Apache Hadoop 2.7.5 (RC0)

+1 (non-binding) - Verified signatures, MD5, RMD160, SHA* for bin and src tarballs - Built from source on macOS 10.12.6 and RHEL 6.6 - Ran local HDFS cluster, ran basic commands, verified read and write capability. - Ran 3000 node cluster via Dynamometer and do not see significant performance va

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

+1 (non-binding) • Verified that the missed JIRAs now show up in the release notes • Clicked around the documentation included in the bin tarball • Verified hashes and signatures for the bin and src tarball • Built from source on RHEL 6.6 • Ran small HDFS cluster, executed basic commands, poked aro

Announcing Dynamometer Open Sourcing for HDFS Scale Testing

contributions and feedback. Thanks, Erik Krogen HDFS @ LinkedIn [1]: https://github.com/linkedin/dynamometer [2]: https://engineering.linkedin.com/blog/2018/02/dynamometer--scale-testing-hdfs-on-minimal-hardware-with-maximum

Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

Thanks putting this together, Konstantin. +1 (non-binding) * Verified signatures, MD5, and SHA-* checksums for bin and src tarball * Started 2-node HDFS and 1-node YARN clusters * Tested basic file operations, copy(To/From)Local, mkdir, ls, etc. via hdfs and webhdfs protocol * Verified Web UIs *

Re: About 2.7.4 Release

List LGTM Konstantin! Let's say that we will only create a new tracking JIRA for patches which do not backport cleanly, to avoid having too many lying around. Otherwise we can directly attach to old ticket. If a clean backport does happen to break a test the nightly build will help us catch it. E

Re: Support for Erasure Coding for Hadoop 2.7

Erasure Coding is a pretty massive feature; I would not expect it to be feasible at all to backport. Erik On Tue, Jun 27, 2017 at 11:42 AM, Rahul Shrivastava < rshrivast...@salesforce.com> wrote: > Hi All, > > I am trying to find out if erasure coding is possible for Hadoop 2.7 ( even > with a b

LinkedIn Dynamometer Tool (was About 2.7.4 Release)

>>>>>> HDFS-9311 <https://issues.apache.org/jira/browse/HDFS-9311> >>> >>>>>>>> Seems like a new feature. It helps failover to standby node when >>> >>>>>>>> primary >>> >>>&

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

ow the “fake out DNs into thinking they are storing > data” — works? Or I can be patient and read your blog post too. > > Thanks > Anu > > > > > > > On 7/20/17, 10:42 AM, "Erik Krogen" wrote: > > >forking off of the 2.7.4 release thread to answer

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

thanks sanjay > On Jul 20, 2017, at 10:42 AM, Erik Krogen wrote: > > forking off of the 2.7.4 release thread to answer this question about > Dynamometer > > Dynamometer is a tool developed at LinkedIn for scale testing HDFS, > specifically the

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) - Verified checksum and signature of source and binary tarballs - Built from source, macOS Sierra 10.12.3 and RHEL 6.6, Oracle JDK 1.8.0_72 - Ran basic HDFS commands and some MR example jobs (using 2.7.4 client) against a 2.6.1 cluster - Started MiniCluster, ran basic HDFS comman

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

not see any noticeable performance regressions as compared to previous releases. Erik On 8/4/17, 11:38 AM, "Erik Krogen" wrote: +1 (non-binding) - Verified checksum and signature of source and binary tarballs - Built from source, macOS Sierra 10.12.3 and RHEL 6.6,

Re: Why aren't delegation token operations audit logged?

Given that the current audit log also includes the majority of read-only operations (getfileinfo, liststatus, etc.) it seems to me that the audit log's purpose has changed to be more of a record of both modifications and queries against the file system's metadata. The delegation token related op

Re: [DISCUSS] Hadoop RPC encryption performance improvements

sults from RPCCallBenchmark. Clearly the performance of the approach is crucial in making the decision and we should ensure that any comparisons made are apples-to-apples with the same test setup. Thanks, Erik Krogen LinkedIn From: Wei-Chiu Chuang Sent: Wednesday, Octobe

Re: [VOTE - 2] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

+1 (non-binding) from me I've been a part of the development of this feature throughout its existence, and have reviewed most of the code committed to the branch. The implementation has been conducted carefully and thoughtfully, and tested at a variety of sites. This feature has no potential n

Hadoop Contributor Meetup Hosted by LinkedIn

Hello fellow Hadoopers! LinkedIn is pleased to be hosting an all-day meetup event for Hadoop contributors and community members to gather together to share information and insights on the present, past and future of the Hadoop software we all know and love. The day will begin with a series of

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

+1 thanks for initiating an official vote Wangda! From: Jonathan Eagles Sent: Wednesday, August 21, 2019 8:22 AM To: Sunil Govindan Cc: Wangda Tan ; yarn-dev ; Hdfs-dev ; mapreduce-dev ; Hadoop Common Subject: Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL +1

[jira] [Resolved] (HDFS-16233) Do not use exception handler to implement copy-on-write for EnumCounters

[ https://issues.apache.org/jira/browse/HDFS-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16233. Resolution: Fixed > Do not use exception handler to implement copy-on-write for EnumCount

[jira] [Resolved] (HDFS-16181) [SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN

[ https://issues.apache.org/jira/browse/HDFS-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16181. Fix Version/s: 3.1.5 3.2.4 3.3.2 2.10.2

[jira] [Resolved] (HDFS-16732) [SBN READ] Avoid get location from observer when the block report is delayed.

[ https://issues.apache.org/jira/browse/HDFS-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16732. Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed Merged PR 4756 to trunk and

[jira] [Resolved] (HDFS-16659) JournalNode should throw NewerTxnIdException if SinceTxId is bigger than HighestWrittenTxId

[ https://issues.apache.org/jira/browse/HDFS-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16659. Fix Version/s: 3.4.0 Resolution: Fixed > JournalNode should throw NewerTxnIdException

[jira] [Resolved] (HDFS-16832) [SBN READ] Fix NPE when check the block location of empty directory

[ https://issues.apache.org/jira/browse/HDFS-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16832. Resolution: Fixed > [SBN READ] Fix NPE when check the block location of empty direct

[jira] [Resolved] (HDFS-16547) [SBN read] Namenode in safe mode should not be transfered to observer state

[ https://issues.apache.org/jira/browse/HDFS-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16547. Resolution: Fixed > [SBN read] Namenode in safe mode should not be transfered to observer st

[jira] [Resolved] (HDFS-16550) [SBN read] Improper cache-size for journal node may cause cluster crash

[ https://issues.apache.org/jira/browse/HDFS-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16550. Fix Version/s: 3.4.0 Resolution: Fixed > [SBN read] Improper cache-size for journal n

[jira] [Resolved] (HDFS-16852) Register the shutdown hook only when not in shutdown for KeyProviderCache constructor

[ https://issues.apache.org/jira/browse/HDFS-16852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16852. Resolution: Fixed > Register the shutdown hook only when not in shutdown for KeyProviderCa

[jira] [Resolved] (HDFS-16689) Standby NameNode crashes when transitioning to Active with in-progress tailer

[ https://issues.apache.org/jira/browse/HDFS-16689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16689. Resolution: Fixed > Standby NameNode crashes when transitioning to Active with in-progress tai

[jira] [Resolved] (HDFS-16872) Fix log throttling by declaring LogThrottlingHelper as static members

[ https://issues.apache.org/jira/browse/HDFS-16872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16872. Resolution: Fixed > Fix log throttling by declaring LogThrottlingHelper as static memb

[jira] [Resolved] (HDFS-16764) ObserverNamenode handles addBlock rpc and throws a FileNotFoundException

[ https://issues.apache.org/jira/browse/HDFS-16764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16764. Resolution: Fixed > ObserverNamenode handles addBlock rpc and throws a FileNotFoundExcept

[jira] [Resolved] (HDFS-16923) The getListing RPC will throw NPE if the path does not exist

[ https://issues.apache.org/jira/browse/HDFS-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-16923. Resolution: Fixed > The getListing RPC will throw NPE if the path does not ex

[jira] [Created] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

Erik Krogen created HDFS-14973: -- Summary: Balancer getBlocks RPC dispersal does not function properly Key: HDFS-14973 URL: https://issues.apache.org/jira/browse/HDFS-14973 Project: Hadoop HDFS

[jira] [Created] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

Erik Krogen created HDFS-14979: -- Summary: [Observer Node] Balancer should submit getBlocks to Observer Node when possible Key: HDFS-14979 URL: https://issues.apache.org/jira/browse/HDFS-14979 Project

[jira] [Created] (HDFS-15032) Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider

Erik Krogen created HDFS-15032: -- Summary: Balancer crashes when it fails to contact an NN via ObserverReadProxyProvider Key: HDFS-15032 URL: https://issues.apache.org/jira/browse/HDFS-15032 Project

[jira] [Reopened] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reopened HDFS-12131: > Add some of the FSNamesystem JMX values as metr

[jira] [Created] (HDFS-12421) Balancer to emit standard metrics

Erik Krogen created HDFS-12421: -- Summary: Balancer to emit standard metrics Key: HDFS-12421 URL: https://issues.apache.org/jira/browse/HDFS-12421 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-12533) NNThroughputBenchmark threads get stuck on UGI.getCurrentUser()

Erik Krogen created HDFS-12533: -- Summary: NNThroughputBenchmark threads get stuck on UGI.getCurrentUser() Key: HDFS-12533 URL: https://issues.apache.org/jira/browse/HDFS-12533 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-11707. Resolution: Duplicate > TestDirectoryScanner#testThrottling fails on

[jira] [Created] (HDFS-12746) DataNode Audit Logger

Erik Krogen created HDFS-12746: -- Summary: DataNode Audit Logger Key: HDFS-12746 URL: https://issues.apache.org/jira/browse/HDFS-12746 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-12803) We should not lock FsNamesystem even we operate a sub directory, we should refinement the lock

[ https://issues.apache.org/jira/browse/HDFS-12803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-12803. Resolution: Duplicate This is a longstanding request tracked in HDFS-5453 > We should not l

[jira] [Created] (HDFS-12817) Support multiple storages in DataNodeCluster / SimulatedFSDataset

Erik Krogen created HDFS-12817: -- Summary: Support multiple storages in DataNodeCluster / SimulatedFSDataset Key: HDFS-12817 URL: https://issues.apache.org/jira/browse/HDFS-12817 Project: Hadoop HDFS

[jira] [Created] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

Erik Krogen created HDFS-12818: -- Summary: Support multiple storages in DataNodeCluster / SimulatedFSDataset Key: HDFS-12818 URL: https://issues.apache.org/jira/browse/HDFS-12818 Project: Hadoop HDFS

[jira] [Created] (HDFS-12823) Backport HDFS-9259 "Make SO_SNDBUF size configurable at DFSClient" to branch-2.7

Erik Krogen created HDFS-12823: -- Summary: Backport HDFS-9259 "Make SO_SNDBUF size configurable at DFSClient" to branch-2.7 Key: HDFS-12823 URL: https://issues.apache.org/jira/browse/HDFS-12823

[jira] [Created] (HDFS-12828) OIV ReverseXML Processor Fails With Escaped Characters

Erik Krogen created HDFS-12828: -- Summary: OIV ReverseXML Processor Fails With Escaped Characters Key: HDFS-12828 URL: https://issues.apache.org/jira/browse/HDFS-12828 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13122) FSImage should not update quota counts on ObserverNode

Erik Krogen created HDFS-13122: -- Summary: FSImage should not update quota counts on ObserverNode Key: HDFS-13122 URL: https://issues.apache.org/jira/browse/HDFS-13122 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13125) Improve efficiency of JN -> Standby Pipeline Under Frequent Edit Tailing

Erik Krogen created HDFS-13125: -- Summary: Improve efficiency of JN -> Standby Pipeline Under Frequent Edit Tailing Key: HDFS-13125 URL: https://issues.apache.org/jira/browse/HDFS-13125 Project: Had

[jira] [Created] (HDFS-13126) Re-enable HTTP Request Logging for WebHDFS

Erik Krogen created HDFS-13126: -- Summary: Re-enable HTTP Request Logging for WebHDFS Key: HDFS-13126 URL: https://issues.apache.org/jira/browse/HDFS-13126 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-13122) Tailing edits should not update quota counts on ObserverNode

[ https://issues.apache.org/jira/browse/HDFS-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13122. Resolution: Duplicate > Tailing edits should not update quota counts on ObserverN

[jira] [Created] (HDFS-13150) Create fast path for SbNN tailing edits from JNs

Erik Krogen created HDFS-13150: -- Summary: Create fast path for SbNN tailing edits from JNs Key: HDFS-13150 URL: https://issues.apache.org/jira/browse/HDFS-13150 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13262) Services should not start threads unnecessarily

Erik Krogen created HDFS-13262: -- Summary: Services should not start threads unnecessarily Key: HDFS-13262 URL: https://issues.apache.org/jira/browse/HDFS-13262 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13263) DiskBalancer should not start a thread if it is disabled

Erik Krogen created HDFS-13263: -- Summary: DiskBalancer should not start a thread if it is disabled Key: HDFS-13263 URL: https://issues.apache.org/jira/browse/HDFS-13263 Project: Hadoop HDFS

[jira] [Created] (HDFS-13264) CacheReplicationMonitor should be able to be disabled completely

Erik Krogen created HDFS-13264: -- Summary: CacheReplicationMonitor should be able to be disabled completely Key: HDFS-13264 URL: https://issues.apache.org/jira/browse/HDFS-13264 Project: Hadoop HDFS

[jira] [Created] (HDFS-13265) MiniDFSCluster should set reasonable defaults to reduce resource consumption

Erik Krogen created HDFS-13265: -- Summary: MiniDFSCluster should set reasonable defaults to reduce resource consumption Key: HDFS-13265 URL: https://issues.apache.org/jira/browse/HDFS-13265 Project

[jira] [Created] (HDFS-13272) DataNodeHttpServer hard-codes HttpServer2 threads at 10

Erik Krogen created HDFS-13272: -- Summary: DataNodeHttpServer hard-codes HttpServer2 threads at 10 Key: HDFS-13272 URL: https://issues.apache.org/jira/browse/HDFS-13272 Project: Hadoop HDFS

[jira] [Created] (HDFS-13400) WebHDFS append returned stream has incorrectly set position

Erik Krogen created HDFS-13400: -- Summary: WebHDFS append returned stream has incorrectly set position Key: HDFS-13400 URL: https://issues.apache.org/jira/browse/HDFS-13400 Project: Hadoop HDFS

[jira] [Created] (HDFS-13493) Reduce the HttpServer2 thread count on DataNodes

Erik Krogen created HDFS-13493: -- Summary: Reduce the HttpServer2 thread count on DataNodes Key: HDFS-13493 URL: https://issues.apache.org/jira/browse/HDFS-13493 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13522) Support observer node from Router-Based Federation

Erik Krogen created HDFS-13522: -- Summary: Support observer node from Router-Based Federation Key: HDFS-13522 URL: https://issues.apache.org/jira/browse/HDFS-13522 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13523) Support observer nodes in MiniDFSCluster

Erik Krogen created HDFS-13523: -- Summary: Support observer nodes in MiniDFSCluster Key: HDFS-13523 URL: https://issues.apache.org/jira/browse/HDFS-13523 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-13595) Edit tailing period configuration should accept time units

Erik Krogen created HDFS-13595: -- Summary: Edit tailing period configuration should accept time units Key: HDFS-13595 URL: https://issues.apache.org/jira/browse/HDFS-13595 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-13595) Edit tailing period configuration should accept time units

[ https://issues.apache.org/jira/browse/HDFS-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13595. Resolution: Invalid This is already done. Looked at the wrong branch, my mistake. > Edit tail

[jira] [Created] (HDFS-13602) Optimize checkOperation(WRITE) check in FSNamesystem getBlockLocations

Erik Krogen created HDFS-13602: -- Summary: Optimize checkOperation(WRITE) check in FSNamesystem getBlockLocations Key: HDFS-13602 URL: https://issues.apache.org/jira/browse/HDFS-13602 Project: Hadoop

[jira] [Resolved] (HDFS-13125) Improve efficiency of JN -> Standby Pipeline Under Frequent Edit Tailing

[ https://issues.apache.org/jira/browse/HDFS-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13125. Resolution: Duplicate This was subsumed by HDFS-13150 > Improve efficiency of JN -> S

[jira] [Created] (HDFS-13607) [Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions

Erik Krogen created HDFS-13607: -- Summary: [Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions Key: HDFS-13607 URL: https://issues.apache.org/jira/browse/HDFS-13607

[jira] [Created] (HDFS-13608) [Edit Tail Fast Path Pt 2] Add ability for JournalNode to serve edits via RPC

Erik Krogen created HDFS-13608: -- Summary: [Edit Tail Fast Path Pt 2] Add ability for JournalNode to serve edits via RPC Key: HDFS-13608 URL: https://issues.apache.org/jira/browse/HDFS-13608 Project

[jira] [Created] (HDFS-13609) [Edit Tail Fast Path Pt 3] NameNode-side changes to support tailing edits via RPC

Erik Krogen created HDFS-13609: -- Summary: [Edit Tail Fast Path Pt 3] NameNode-side changes to support tailing edits via RPC Key: HDFS-13609 URL: https://issues.apache.org/jira/browse/HDFS-13609 Project

[jira] [Created] (HDFS-13610) [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync

Erik Krogen created HDFS-13610: -- Summary: [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync Key: HDFS-13610 URL: https://issues.apache.org/jira/browse/HDFS-13610

[jira] [Created] (HDFS-13689) NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode

Erik Krogen created HDFS-13689: -- Summary: NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode Key: HDFS-13689 URL: https://issues.apache.org/jira/browse/HDFS-13689 Project: Hadoop

[jira] [Resolved] (HDFS-13150) [Edit Tail Fast Path] Allow SbNN to tail in-progress edits from JN via RPC

[ https://issues.apache.org/jira/browse/HDFS-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13150. Resolution: Fixed Fix Version/s: HDFS-12943 Closing this as all sub-issues (HDFS-13607

[jira] [Created] (HDFS-13789) Reduce logging frequency of QuorumJournalManager#selectInputStreams

Erik Krogen created HDFS-13789: -- Summary: Reduce logging frequency of QuorumJournalManager#selectInputStreams Key: HDFS-13789 URL: https://issues.apache.org/jira/browse/HDFS-13789 Project: Hadoop HDFS

[jira] [Created] (HDFS-13791) Limit logging frequency of edit tail related statements

Erik Krogen created HDFS-13791: -- Summary: Limit logging frequency of edit tail related statements Key: HDFS-13791 URL: https://issues.apache.org/jira/browse/HDFS-13791 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-12421) Balancer to emit standard metrics

[ https://issues.apache.org/jira/browse/HDFS-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-12421. Resolution: Duplicate Just noticed this is a dup of HDFS-10648   > Balancer to emit stand

[jira] [Created] (HDFS-13872) Only ClientProtocol should perform msync wait

Erik Krogen created HDFS-13872: -- Summary: Only ClientProtocol should perform msync wait Key: HDFS-13872 URL: https://issues.apache.org/jira/browse/HDFS-13872 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-13872) Only some protocol methods should perform msync wait

[ https://issues.apache.org/jira/browse/HDFS-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13872. Resolution: Duplicate Closing in favor of HDFS-13880 > Only some protocol methods should perf

[jira] [Created] (HDFS-13904) ContentSummary does not always respect processing limit, resulting in long lock acquisitions

Erik Krogen created HDFS-13904: -- Summary: ContentSummary does not always respect processing limit, resulting in long lock acquisitions Key: HDFS-13904 URL: https://issues.apache.org/jira/browse/HDFS-13904

[jira] [Created] (HDFS-13930) Fix crlf line endings in HDFS-12943 branch

Erik Krogen created HDFS-13930: -- Summary: Fix crlf line endings in HDFS-12943 branch Key: HDFS-13930 URL: https://issues.apache.org/jira/browse/HDFS-13930 Project: Hadoop HDFS Issue Type: Sub

[jira] [Resolved] (HDFS-13930) Fix crlf line endings in HDFS-12943 branch

[ https://issues.apache.org/jira/browse/HDFS-13930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-13930. Resolution: Fixed > Fix crlf line endings in HDFS-12943 bra

[jira] [Created] (HDFS-10817) Add Logging for Long-held NN Read Locks

Erik Krogen created HDFS-10817: -- Summary: Add Logging for Long-held NN Read Locks Key: HDFS-10817 URL: https://issues.apache.org/jira/browse/HDFS-10817 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10829) Improve Testing for NN Lock Logging

Erik Krogen created HDFS-10829: -- Summary: Improve Testing for NN Lock Logging Key: HDFS-10829 URL: https://issues.apache.org/jira/browse/HDFS-10829 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

Erik Krogen created HDFS-10843: -- Summary: Quota Feature Cached Size != Computed Size When Block Committed But Not Completed Key: HDFS-10843 URL: https://issues.apache.org/jira/browse/HDFS-10843 Project

[jira] [Created] (HDFS-10873) Add histograms for FSNamesystemLock Metrics

Erik Krogen created HDFS-10873: -- Summary: Add histograms for FSNamesystemLock Metrics Key: HDFS-10873 URL: https://issues.apache.org/jira/browse/HDFS-10873 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

Erik Krogen created HDFS-10872: -- Summary: Add MutableRate metrics for FSNamesystemLock operations Key: HDFS-10872 URL: https://issues.apache.org/jira/browse/HDFS-10872 Project: Hadoop HDFS

[jira] [Created] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

Erik Krogen created HDFS-10896: -- Summary: Move lock logging logic from FSNamesystem into FSNamesystemLock Key: HDFS-10896 URL: https://issues.apache.org/jira/browse/HDFS-10896 Project: Hadoop HDFS

[jira] [Created] (HDFS-11021) Add FSNamesystemLock metrics for BlockManager operations

Erik Krogen created HDFS-11021: -- Summary: Add FSNamesystemLock metrics for BlockManager operations Key: HDFS-11021 URL: https://issues.apache.org/jira/browse/HDFS-11021 Project: Hadoop HDFS

[jira] [Created] (HDFS-11208) Deadlock in WebHDFS on shutdown

Erik Krogen created HDFS-11208: -- Summary: Deadlock in WebHDFS on shutdown Key: HDFS-11208 URL: https://issues.apache.org/jira/browse/HDFS-11208 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11352) Potential deadlock in NN when failing over

Erik Krogen created HDFS-11352: -- Summary: Potential deadlock in NN when failing over Key: HDFS-11352 URL: https://issues.apache.org/jira/browse/HDFS-11352 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11615) FSNamesystemLock metrics can be inaccurate due millisecond precision

Erik Krogen created HDFS-11615: -- Summary: FSNamesystemLock metrics can be inaccurate due millisecond precision Key: HDFS-11615 URL: https://issues.apache.org/jira/browse/HDFS-11615 Project: Hadoop HDFS

[jira] [Created] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

Erik Krogen created HDFS-11707: -- Summary: TestDirectoryScanner#testThrottling fails on OSX Key: HDFS-11707 URL: https://issues.apache.org/jira/browse/HDFS-11707 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11717) Add unit test for HDFS-11709

Erik Krogen created HDFS-11717: -- Summary: Add unit test for HDFS-11709 Key: HDFS-11717 URL: https://issues.apache.org/jira/browse/HDFS-11717 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

Erik Krogen created HDFS-12004: -- Summary: Namenode UI continues to list DNs that have been removed from include and exclude Key: HDFS-12004 URL: https://issues.apache.org/jira/browse/HDFS-12004 Project

[jira] [Resolved] (HDFS-12004) Namenode UI continues to list DNs that have been removed from include and exclude

[ https://issues.apache.org/jira/browse/HDFS-12004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-12004. Resolution: Duplicate > Namenode UI continues to list DNs that have been removed from include

[jira] [Created] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

Erik Krogen created HDFS-12131: -- Summary: Add some of the FSNamesystem JMX values as metrics Key: HDFS-12131 URL: https://issues.apache.org/jira/browse/HDFS-12131 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12160) Fix broken NameNode metrics documentation

Erik Krogen created HDFS-12160: -- Summary: Fix broken NameNode metrics documentation Key: HDFS-12160 URL: https://issues.apache.org/jira/browse/HDFS-12160 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12219) Javadoc for FSNamesystem#getMaxObjects is incorrect

Erik Krogen created HDFS-12219: -- Summary: Javadoc for FSNamesystem#getMaxObjects is incorrect Key: HDFS-12219 URL: https://issues.apache.org/jira/browse/HDFS-12219 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is longer than timeout

Erik Krogen created HDFS-12323: -- Summary: NameNode terminates after full GC thinking QJM unresponsive if full GC is longer than timeout Key: HDFS-12323 URL: https://issues.apache.org/jira/browse/HDFS-12323

[jira] [Created] (HDFS-12342) Differentiate webhdfs vs. swebhdfs calls in audit log

Erik Krogen created HDFS-12342: -- Summary: Differentiate webhdfs vs. swebhdfs calls in audit log Key: HDFS-12342 URL: https://issues.apache.org/jira/browse/HDFS-12342 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13977) NameNode can kill itself if it tries to send too many txns to a QJM simultaneously

Erik Krogen created HDFS-13977: -- Summary: NameNode can kill itself if it tries to send too many txns to a QJM simultaneously Key: HDFS-13977 URL: https://issues.apache.org/jira/browse/HDFS-13977 Project

  1   2   >