Wow a great response from everyone. I'm trying to document my understanding of the configuration and installation just to get my head around the setup.
For now I'll start with 4 servers (1 x Hadoop Master, 1 x HBase Master, 2 x Hadoop/HBase slaves) and try and get the concept right first (the deployment document I've started has reached nearly 4 pages!) I need to get my head around ensuring that a server is strictly a Datanode, master, slave, namenode, tasktracker etc. Hopefully I'll have something ready by tomorrow! -----Original Message----- From: Patrick Hunt [mailto:[email protected]] Sent: Tuesday, 1 June 2010 4:09 PM To: [email protected] Cc: Anthony Ikeda Subject: Re: Standard deployments Hi Anthony, cut back to 3 ZooKeeper servers in the ZK ensemble. The quorum uses "majority rule", so 4 servers is actually worse than 3 (typically you would go to 5 servers as the next step up from 3). Patrick On 05/31/2010 07:49 PM, Anthony Ikeda wrote: > I'm in the process of configuring our machines for a HBase deployment. > Based upon the documentation I've read so far, a ZooKeeper Quorum is > required with Hadoop running (of course). > > However, to what degree do I need to separate the servers? > > At this point I have a total of 12 servers with the possible configuration: > > 4 x Hadoop (1 Master, 3 Slaves) > > 4 x HBase > > 4 x ZooKeeper > > Should the HBase be installed with the Hadoop instances? > > i.e.: > > 8 x Hadoop and HBase (giving me 8 instances of Hadoop and HBase as > opposed to 4 of each) > > 4 x ZooKeeper > > Or is it typical practice for HBase to be installed on an environment > separate to Hadoop? > > Anthony Ikeda > > Java Analyst/Programmer > > Cardlink Services Limited > > Level 4, 3 Rider Boulevard > > Rhodes NSW 2138 > > Web: www.cardlink.com.au <http://www.cardlink.com.au> | Tel: + 61 2 9646 > 9221 | Fax: + 61 2 9646 9283 > > logo_cardlink1 > > > ********************************************************************** > This e-mail message and any attachments are intended only for the use of > the addressee(s) named above and may contain information that is > privileged and confidential. If you are not the intended recipient, any > display, dissemination, distribution, or copying is strictly prohibited. > If you believe you have received this e-mail message in error, please > immediately notify the sender by replying to this e-mail message or by > telephone to (02) 9646 9222. Please delete the email and any attachments > and do not retain the email or any attachments in any form. > ********************************************************************** _____________________________________________________________________ This e-mail has been scanned for viruses by MCI's Internet Managed Scanning Services - powered by MessageLabs. For further information visit http://www.mci.com ********************************************************************** This e-mail message and any attachments are intended only for the use of the addressee(s) named above and may contain information that is privileged and confidential. If you are not the intended recipient, any display, dissemination, distribution, or copying is strictly prohibited. If you believe you have received this e-mail message in error, please immediately notify the sender by replying to this e-mail message or by telephone to (02) 9646 9222. Please delete the email and any attachments and do not retain the email or any attachments in any form. **********************************************************************
