The biggest issue you'll likely have is hardware, so if you are running ec2, that is out the window. I run my datanodes on 'old' desktop grade hardware... Single Power Supply, 2GB RAM, Single HT P4 procs, and single 250GB disks. I know, it's bad, but for my current purposes, it works pretty well. Once the cluster is up and running, and I'm not changing configs and constantly restarting, it will run for weeks without intervention.
If you run on server grade hardware, built to tighter specs, the chances of failure (therefore intervention for repair or replacement) are lower. If you run on ec2, then someone else is dealing with the hardware, and you can just use the cluster... Travis Hegner http://www.travishegner.com/ -----Original Message----- From: S Ahmed [mailto:[email protected]] Sent: Wednesday, July 21, 2010 3:36 PM To: [email protected] Subject: Re: operations, how 'hard' is it to keep the servers humming Can you define what you mean by 'complete junk' ? I plan on using ec2. On Wed, Jul 21, 2010 at 3:23 PM, Hegner, Travis <[email protected]>wrote: > That question is completely dependant on the size of the cluster you are > looking at setting up, which is then dependant on how much data you want to > store and/or process. > > A one man show should be able to handle 10-20 machines without too much > trouble, unless you run complete junk. I run a 6 node cluster on complete > junk, and I rarely have had to tinker with it since setting it up. > > Travis Hegner > http://www.travishegner.com/ > > -----Original Message----- > From: S Ahmed [mailto:[email protected]] > Sent: Wednesday, July 21, 2010 2:59 PM > To: [email protected] > Subject: operations, how 'hard' is it to keep the servers humming > > From a operations standpoint, is setup a hbase cluster and keeping them > running a fairly complex task? > > i.e. if I am a 1-man show, would it be a smart choice to build on top of > hbase or is a crazy idea? > > The information contained in this communication is confidential and is > intended only for the use of the named recipient. Unauthorized use, > disclosure, or copying is strictly prohibited and may be unlawful. If you > have received this communication in error, you should know that you are > bound to confidentiality, and should please immediately notify the sender or > our IT Department at 866.459.4599. > The information contained in this communication is confidential and is intended only for the use of the named recipient. Unauthorized use, disclosure, or copying is strictly prohibited and may be unlawful. If you have received this communication in error, you should know that you are bound to confidentiality, and should please immediately notify the sender or our IT Department at 866.459.4599.
