There are other approaches as well, of course. We have had very good results with test sites using HBase on MapR. You get much higher performance and no SPOF.
Details beyond this are a bit off-topic so followups should be off-list. Send me email if you have questions. On Thu, Jul 21, 2011 at 9:41 AM, Buttler, David <[email protected]> wrote: > By default the namenode cannot be run on multiple nodes. Check out avatar > nodes for one solution. > For a six node cluster, there is no need to run 3 zookeepers. Run one on > the same host as the name node > When you get to 10+ nodes, then you can start thinking about adding more > zookeeper nodes. > > Also, put the hmaster on the namenode. Three region servers on a six node > cluster is just wasteful. > > The secondary namenode can also host a datanode and a regionserver > > > > -----Original Message----- > From: shanmuganathan.r [mailto:[email protected]] > Sent: Thursday, July 21, 2011 3:43 AM > To: [email protected] > Subject: How can i configure? > > > Hi, > > Now i am using HBase in distributed mode . I want to use the HBase in > the Hadoop in multi master coniguration. now i am trying to configure six > nodes like following > > > 1. Namenode,jobtracker,secondarynamenode > 2. Namenode,jobtracker,secondarynamenode > 3.datanode,tasktracker,HMaster > 4.datanode,tasktracker,HRegionserver,zookeeper1 > 5.datanode,tasktracker,HRegionserver,zookeeper2 > 6.datanode,tasktracker,HRegionserver,zookeeper3 > > > is this configuration is possible? yes or no means how can i configure > hbase in multimaster environment > > > i used the hadoop 0.20.2 , hbase 0.90.1, zookeeper 3.3.3 > > > in my current configuration i face the following errors > > > 1. In the second master the namenode and jobtracker is not woring > if we start the two namenodes separately means it run , otherwise it > doesnot run ------> from that my question is can we need to run the > namenodes separately? > > > 2. The zookeeper, HMaster and one of my regionserver are working > properly but other two are not working . i got the following exception in my > fault region sever log that is > > > > > 2011-07-21 15:46:57,234 INFO > org.apache.hadoop.hbase.regionserver.ShutdownHook: Installed shutdown hook > thread: Shutdownhook:regionserver60020 > 2011-07-21 15:46:57,303 DEBUG > org.apache.hadoop.hbase.catalog.CatalogTracker: Starting catalog tracker > org.apache.hadoop.hbase.catalog.CatalogTracker@1efb4be > 2011-07-21 15:46:57,306 INFO > org.apache.hadoop.hbase.regionserver.MemStoreFlusher: > globalMemStoreLimit=398.7m, globalMemStoreLimitLowMark=348.9m, > maxHeap=996.8m > 2011-07-21 15:46:57,308 DEBUG > org.apache.hadoop.hbase.regionserver.PriorityCompactionQueue: Create > PriorityCompactionQueue > 2011-07-21 15:46:57,308 INFO > org.apache.hadoop.hbase.regionserver.HRegionServer: Runs every 10000000ms > > 2011-07-21 15:47:57,443 WARN > org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect to > master. Retrying. Error was: > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592) > at > org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404) > at > org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:328) > at > org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:883) > at > org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:750) > at > org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257) > at $Proxy5.getProtocolVersion(Unknown Source) > at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:419) > at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:393) > at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:444) > at > org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:349) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.getMaster(HRegionServer.java:1445) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1486) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.tryReportForDuty(HRegionServer.java:1470) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:563) > at java.lang.Thread.run(Thread.java:636) > >
