My late +1. Really it's useful feature.. Great work. -----Original Message----- From: Konstantin Shvachko [mailto:shv.had...@gmail.com] Sent: Saturday, December 22, 2018 6:48 AM To: Hadoop Common <common-...@hadoop.apache.org>; hdfs-dev <hdfs-...@hadoop.apache.org> Cc: mapreduce-...@hadoop.apache.org; yarn-dev@hadoop.apache.org Subject: [Result] [VOTE - 2] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby
Obviously +1 from me. With four binding +1s, two non-binding +1s, and no -1s this vote passes. Thank you folks for working on the feature and for voting. Will do the merge in bit. Thanks, --Konst On Fri, Dec 14, 2018 at 6:16 PM Konstantin Shvachko <shv.had...@gmail.com> wrote: > Hi Hadoop developers, > > I would like to propose to merge to trunk the feature branch > HDFS-12943 for Consistent Reads from Standby Node. The feature is > intended to scale read RPC workloads. On large clusters reads comprise > 95% of all RPCs to the NameNode. We should be able to accommodate > higher overall RPC workloads (up to 4x by some estimates) by adding multiple > ObserverNodes. > > The main functionality has been implemented see sub-tasks of HDFS-12943. > We followed up with the test plan. Testing was done on two independent > clusters (see HDFS-14058 and HDFS-14059) with security enabled. > We ran standard HDFS commands, MR jobs, admin commands including > manual failover. > We know of one cluster running this feature in production. > > Since the previous vote we addressed Daryn's concern (see HDFS-13873), > added documentation for the new feature, and fixed a few other jiras. > > I attached a unified patch to the umbrella jira for the review. > Please vote on this thread. The vote will run for 7 days until Wed Dec 21. > > Thanks, > --Konstantin >
