I have set up and maintained clusters between 6 and 40 machines while being a full time developer, so all as part of the development process. I used simple scripts like the ones I documented here (http://www.larsgeorge.com/2009/02/hadoop-scripts-part-1.html). Cluster SSH as mentioned is also used more often and if you want to do it right then use Puppet. But as JD says, setting up monitoring is the very first step or else you are flying blind.
On Wed, Nov 24, 2010 at 7:26 PM, Wojciech Langiewicz <[email protected]> wrote: > On 23.11.2010 22:14, S Ahmed wrote: >> >> Hi, >> >> How much of a guru do you have to be to keep say 5-10 servers humming? >> >> I'm a 1-man shop, and I dream of developing a web application, and scaling >> will be a core part of the application. >> >> Is it feasable for a 1-man operation to manage a 5-10 server hbase >> cluster? >> Is it something that requires hand holding and constant monitoring or it >> tends to be hands off? >> > I'm not sure what kind of managing you mean, but for doing admin work on > hadoop/hbase machines I use Cluster SSH (cssh) which allows you to log on > multiple machines at once, and execute commands. For cluster up to 20 > machines I think it's quite ok. > > -- > Wojciech Langiewicz >
