Hi Anthony, For clusters of this size, I would recommend:
10 nodes with DN, TT, and RegionServer 1 node with HMaster, JT, NN, ZK 1 node with HMaster, 2NN, NFS export for second copy of NN metadata The various master nodes are all very low resource consumption on small clusters, so you can safely colocate them with ZooKeeper. Running a multinode ZK quorum doesn't really buy you anything on a small cluster -- it doesn't need a lot of resources, and having high availability doesn't help you much when the rest of the services on that machine aren't HA. While at first it sounds like a bad idea to put all your eggs in one basket, ops teams are very good at protecting egg-filled baskets, and it's easier to protect one than protect several. With quality hardware and dual power supplies on distinct PDUs, MTBF should be >2years. -Todd On Mon, May 31, 2010 at 7:49 PM, Anthony Ikeda < [email protected]> wrote: > I’m in the process of configuring our machines for a HBase deployment. > Based upon the documentation I’ve read so far, a ZooKeeper Quorum is > required with Hadoop running (of course). > > > > However, to what degree do I need to separate the servers? > > > > At this point I have a total of 12 servers with the possible configuration: > > > > 4 x Hadoop (1 Master, 3 Slaves) > > 4 x HBase > > 4 x ZooKeeper > > > > Should the HBase be installed with the Hadoop instances? > > i.e.: > > 8 x Hadoop and HBase (giving me 8 instances of Hadoop and HBase as opposed > to 4 of each) > > 4 x ZooKeeper > > > > Or is it typical practice for HBase to be installed on an environment > separate to Hadoop? > > > > > > Anthony Ikeda > > Java Analyst/Programmer > > Cardlink Services Limited > > Level 4, 3 Rider Boulevard > > Rhodes NSW 2138 > > > > Web: www.cardlink.com.au | Tel: + 61 2 9646 9221 | Fax: + 61 2 9646 9283 > > [image: logo_cardlink1] > > > > ********************************************************************** > This e-mail message and any attachments are intended only for the use of > the addressee(s) named above and may contain information that is privileged > and confidential. If you are not the intended recipient, any display, > dissemination, distribution, or copying is strictly prohibited. If you > believe you have received this e-mail message in error, please immediately > notify the sender by replying to this e-mail message or by telephone to (02) > 9646 9222. Please delete the email and any attachments and do not retain the > email or any attachments in any form. > ********************************************************************** > -- Todd Lipcon Software Engineer, Cloudera
