Re: Downgrading Hdfs

2009-03-20 Thread Bill Au
I though that both the capacity and fair share scheduler are available in 0.19. Are there new features add in 0.20? Is that documented anywhere? How do I learn more? Bill On Fri, Mar 20, 2009 at 7:28 AM, David B. Ritch wrote: > Looks like there's been quite a bit of work on both the Capacity >

Re: Downgrading Hdfs

2009-03-20 Thread David B. Ritch
Looks like there's been quite a bit of work on both the Capacity Scheduler and the Fair Scheduler. Are there others we should look at in 20.0? Again, thank you for your informative responses. David Raghu Angadi wrote: > > I think 0.20.0 is preferred because of new job scheduler(s) there. > Stab

Re: Downgrading Hdfs

2009-03-18 Thread Aaron Kimball
It should also be pointed out that the "rollback" process restores your HDFS cluster to the state it was at when it was upgraded by restoring a checkpoint -- it does not "downgrade" your current set of blocks. So if you've pulled new data into HDFS since the upgrade, that will be lost - Aaron On W

Re: Downgrading Hdfs

2009-03-18 Thread Raghu Angadi
I think 0.20.0 is preferred because of new job scheduler(s) there. Stability wise, 0.20 is expected to be as good as 0.19.2. I don't know the schedule for 0.19.2. Raghu. David Ritch wrote: Raghu, Thank you for your prompt and informative response. Moving to anything that ends in .0 is a b

Re: Downgrading Hdfs

2009-03-18 Thread David Ritch
Bill, Thank you. Unfortunately, that will not work for us, as our hadoop-19 has long been finalized. dbr On Wed, Mar 18, 2009 at 2:35 PM, Bill Au wrote: > As long as the version upgrade has not been finalized, here's the procedure > I use to downgrade: > > > 1. make sure that the previous v

Re: Downgrading Hdfs

2009-03-18 Thread Bill Au
As long as the version upgrade has not been finalized, here's the procedure I use to downgrade: 1. make sure that the previous version upgrade has not been finalized. A version upgrade cannot be rollback if it has been finalized. bin/hadoop dfsadmin -upgradeProgress status 2. stop m

Re: Downgrading Hdfs

2009-03-18 Thread David Ritch
Raghu, Thank you for your prompt and informative response. Moving to anything that ends in .0 is a bit scary - what are the reasons to go with 0.20.0 instead of 0.19.2? Yahoo is jumping from 0.18.x directly to 0.20.0? Why is Yahoo skipping the 0.19.x release? Is the expectation that 0.19.2 wil

Re: Downgrading Hdfs

2009-03-18 Thread Raghu Angadi
Short is answer I am afraid is no. As an alternative, I recommend upgrading to latest 0.19.x or 0.20.0 (to be released in couple of days). 0.19.2 is certainly a lot better than 0.19.0. Yahoo is rolling out 0.20.x if that helps your confidence. Raghu. David Ritch wrote: There is an establis