Agree, +1. It will be good to ensure we get a more modern version of FairScheduler for interested folks.
Arun Sent from my iPhone On Sep 2, 2011, at 5:55 PM, Matei Zaharia <[email protected]> wrote: > Hi Matt, > > I'd like to propose backporting some of the new fair scheduler features that > have been out for almost 2 years now (in the 0.21 branch and trunk) into > 0.20.205, especially https://issues.apache.org/jira/browse/MAPREDUCE-551 and > https://issues.apache.org/jira/browse/MAPREDUCE-706. I will try to put > together a patch for this. It should be a matter of taking the trunk > fairscheduler directory and just tweaking anything that might be required to > compile on 0.20.205; I don't think there are other major differences. > > Matei > > On Sep 1, 2011, at 11:48 AM, Arun C Murthy wrote: > >> Thanks for the input guys - I'll look at MAPREDUCE-2601,MAPREDUCE-2779 & >> HADOOP-7602. >> >> Arun >> >> On Sep 1, 2011, at 11:02 AM, John George wrote: >> >>> Hi Matt, >>> I would like to bring HADOOP-7602 to your attention. I just filed it today >>> and have a patch uploaded, but I think it should go in to 205. >>> Thank you for considering. >>> >>> Regads, >>> John George >>> >>> >>> On 9/1/11 11:08 AM, "Rottinghuis, Joep" <[email protected]> wrote: >>> >>>> Could you please add MAPREDUCE-2779 to the list as well? >>>> This one has a patch as well. >>>> >>>> Thanks, >>>> >>>> Joep >>>> ________________________________________ >>>> From: Rottinghuis, Joep [[email protected]] >>>> Sent: Thursday, September 01, 2011 9:04 AM >>>> To: [email protected] >>>> Subject: RE: Content request for 0.20.205 Sustaining Release >>>> >>>> Hi Matt, >>>> >>>> IMHO MAPREDUCE-2610 should be included in 205 as well. >>>> We applied it to our branch because our users had problems with getting >>>> queue >>>> information. >>>> >>>> Thanks, >>>> >>>> Joep >>>> ________________________________________ >>>> From: Matt Foley [[email protected]] >>>> Sent: Wednesday, August 31, 2011 11:16 AM >>>> To: [email protected] >>>> Subject: Re: Content request for 0.20.205 Sustaining Release >>>> >>>> Thank you, Nathan. And thanks for combining these requests, it's much >>>> easier to review a single list than 10 or more emails. >>>> >>>> Does anyone else have requests for items to include in 0.20.205 - either >>>> already submitted to 0.20-security, or pending work? >>>> >>>> Thanks, >>>> --Matt >>>> >>>> On Wed, Aug 31, 2011 at 8:25 AM, Nathan Roberts >>>> <[email protected]>wrote: >>>> >>>>> Hi Matt, >>>>> >>>>> My colleagues with experience running 0.20.203 (as well as many previous >>>>> releases of Hadoop) in Yahoo!'s production environment are requesting that >>>>> the following items be included as high priority sustaining improvements >>>>> in >>>>> 0.20.205. Rather than contributors sending in several separate requests >>>>> to >>>>> this mailing list, this email aggregates contributions from the following >>>>> individuals: Daryn Sharp, Jeffrey Naisbitt, Kihwal Lee, Sherry Chen, >>>>> Thomas >>>>> Graves, Bharath Mundlapudi, Robert Joseph Evans, Anupam Seth, Eric Payne, >>>>> John George. >>>>> >>>>> Recommendations and suggestions for this list of jiras came from folks >>>>> with >>>>> significant experience working with large scale Hadoop clusters within >>>>> Yahoo! production environments, including Service Engineering teams, >>>>> Quality >>>>> Engineering teams, Solutions Engineering teams, and Development teams. >>>>> >>>>> Notes on the items listed below: >>>>> >>>>> * All the Jiras listed with the exception of HADOOP-7510, >>>>> MAPREDUCE-2764, MAPREDUCE-2915, and HDFS-2257 have been committed to >>>>> 0.20-security. These remaining four jiras are in-progress and should wrap >>>>> up >>>>> over the next few days. >>>>> * All of the jiras listed have been fixed in trunk with the following >>>>> exceptions: >>>>> * The four jiras listed above which are still being worked >>>>> * MAPREDUCE-2780 - Similar to previous bullet. In progress now. >>>>> * MAPREDUCE-2324 - Has a strong interaction with MR279 so filed >>>>> MAPREDUCE-2723 to make sure this is handled correctly in yarn >>>>> * MAPREDUCE-2729, MAPREDUCE-2621 - Don't make sense after integration >>>>> of MR279 >>>>> >>>>> Thank you for considering this list of Jiras for inclusion in 0.20.205. >>>>> Nathan Roberts >>>>> >>>>> ==== >>>>> [list elided, please see archives at http://tinyurl.com/3k537hs ] >>> >> >
