Cos, Arun and Sridhar, Thanks for the fast responses. Our two main requirements are:
1. Multiple output -- Write multiple output files in each reducer. 2. Max Reducers per user -- Use Fairscheduler 0.21 or greater which would let us limit the maximum number of concurrent reducers per pool/user. ~ Niranjan. On Nov 22, 2011, at 2:19 PM, sridhar basam wrote: > On Tue, Nov 22, 2011 at 3:05 PM, Niranjan Balasubramanian < > [email protected]> wrote: > >> Hello >> >> We are currently using hadoop 0.20.203 on a 10 node cluster. We are >> considering upgrading to a newer version and I have two questions in this >> regard. >> >> 1) It seems 0.21 is unlikely to become a stable release anytime soon and >> we are weary of moving to an unstable release. Our primary concern is the >> data we have on our hdfs. I want to know if anyone has been using 0.21 in >> production and would like to hear about your experiences? Any advice on >> this front is appreciated. >> >> > What new features or what deficiencies in the existing release are your > trying to overcome. If primary concern is stability, wouldn't it be better > to wait till 0.23 is GA'd. I don't think there are too many people running > 0.21 at scale. > > Sridhar > > > >> 2) Do we know when 0.23 is likely to become stable? There has been some >> discussion on mail #dev* about 0.23 becoming stable sometime soon. Is it >> going to happen by the end of this year? >> >> Thanks >> ~ Niranjan. >> >> * - >> http://search-hadoop.com/m/f623FA7bDK1/hadoop+next+stable+release+0.21&subj=0+21+stable+schedule+
