hi,
I'm using Hadoop 0.20.204.0 After I remove the 127.0.1.1 lines, the HMaster cannot start. I get this exception: 2011-12-16 13:37:11,899 ERROR org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1060) at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:142) at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:102) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76) at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1074) Caused by: java.net.BindException: Cannot assign requested address at sun.nio.ch.Net.bind(Native Method) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59) at org.apache.hadoop.hbase.ipc.HBaseServer.bind(HBaseServer.java :201) at org.apache.hadoop.hbase.ipc.HBaseServer$Listener.<init>(HBaseServer.java:270) at org.apache.hadoop.hbase.ipc.HBaseServer.<init>(HBaseServer.java:1168) at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.<init>(HBaseRPC.java:544) at org.apache.hadoop.hbase.ipc.HBaseRPC.getServer(HBaseRPC.java:514) at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:196) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:1055) ... 5 more what address should the hmaster rpcserver bind to? cheers exception At 2011-12-16 02:37:43,"Mohammad Tariq" <[email protected]> wrote: >I agree with J-D and Shashwat. BTW, which version of Hadoop are you using?? >Regards, > Mohammad Tariq > > > >On Thu, Dec 15, 2011 at 11:56 PM, shashwat shriparv ><[email protected]> wrote: >> make 127.0.1.1 to 127.0.0.1 that will solve lot of problems >> >> On Thu, Dec 15, 2011 at 11:54 PM, Jean-Daniel Cryans >> <[email protected]>wrote: >> >>> Hi, >>> >>> A few notes: >>> >>> Remove the 127.0.1.1 lines, they usually mess things up. >>> >>> The hbase.master configuration has been removed from the HBase code >>> more than 2 years ago, you can remove it too. >>> >>> Setting hbase.master.dns.interface alone without >>> hbase.master.dns.nameserver doesn't do anything if I remember >>> correctly, also I'm pretty sure you don't have an interface named >>> "master", it's more likely "eth0" and whatnot. >>> >>> I don't know if this will fix your DNS resolution, but at least it >>> will clean up a bit :) >>> >>> J-D >>> >>> 2011/12/15 exp <[email protected]>: >>> > hi all, >>> > >>> > I am installing hbase on a small cluster of 3 machines. The RegionServer >>> unable connect to the master. This is the log: >>> > >>> > >>> > 2011-12-15 13:46:43,415 INFO >>> org.apache.hadoop.hbase.regionserver.HRegionServer: Attempting connect to >>> Master server at localhost:60000 >>> > 2011-12-15 13:47:43,473 WARN >>> org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect to >>> master. Retrying. Error was: >>> > java.net.ConnectException: Connection refused >>> > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) >>> > at >>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567) >>> > at >>> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) >>> > ...... >>> > >>> > >>> > >>> > >>> > The lod shows this RegionServer connect to the master at a wrong >>> address(localhost:60000). >>> > >>> > >>> > as far as I know, the RegionServer use ZooKeeper to find out the >>> master's address. so I check the HMaster's log. >>> > >>> > >>> > this is what i find out: >>> > ... >>> > 2011-12-15 13:44:34,946 INFO >>> org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized >>> > 2011-12-15 13:44:35,010 INFO >>> org.apache.hadoop.hbase.master.ActiveMasterManager: Master=localhost:60000 >>> > 2011-12-15 13:44:37,476 INFO org.apache.zookeeper.ZooKeeper: Initiating >>> client connection, connectString=master:2181,slave2:2181,slave >>> > 1:2181 sessionTimeout=180000 watcher=hconnection >>> > ... >>> > >>> > >>> > The HMaster starts at localhost:60000! I think the HMaster should start >>> at master:60000. "master" is the hosts where JobTracker runs. >>> > >>> > >>> > I am using hbase 0.90.3 and zookeeper 3.3.4. This is the source code >>> where the HMaster get the address: >>> > >>> > >>> > HServerAddress a = new HServerAddress(getMyAddress(this.conf)); >>> > int numHandlers = conf.getInt("hbase.regionserver.handler.count", 10); >>> > this.rpcServer = HBaseRPC.getServer(this, >>> > new Class<?>[]{HMasterInterface.class, >>> HMasterRegionInterface.class}, >>> > a.getBindAddress(), a.getPort(), >>> > numHandlers, >>> > 0, // we dont use high priority handlers in master >>> > false, conf, >>> > 0); // this is a DNC w/o high priority handlers >>> > this.address = new HServerAddress(rpcServer.getListenerAddress()); >>> > >>> > >>> > private static String getMyAddress(final Configuration c) >>> > throws UnknownHostException { >>> > // Find out our address up in DNS. >>> > String s = >>> DNS.getDefaultHost(c.get("hbase.master.dns.interface","default"), >>> > c.get("hbase.master.dns.nameserver","default")); >>> > s += ":" + c.get(HConstants.MASTER_PORT, >>> > Integer.toString(HConstants.DEFAULT_MASTER_PORT)); >>> > return s; >>> > } >>> > >>> > >>> > >>> > >>> > As you can see in the code, the HMaster find its address in DNS! I have >>> no idea how to setup the hbase to let the HMaster find the correct address. >>> > >>> > >>> > this is my hbase-site.xml: >>> > >>> > >>> > <configuration> >>> > <property> >>> > <name>hbase.rootdir</name> >>> > <value>hdfs://master:9000/user/hadoop/hbase</value> >>> > </property> >>> > <property> >>> > <name>hbase.cluster.distributed</name> >>> > <value>true</value> >>> > </property> >>> > >>> > >>> > <property> >>> > <name>hbase.master.dns.interface</name> >>> > <value>master</value> >>> > </property> >>> > >>> > >>> > <property> >>> > <name>zookeeper.znode.master</name> >>> > <value>master</value> >>> > </property> >>> > >>> > >>> > <property> >>> > <name>hbase.master</name> >>> > <value>master:60000</value> >>> > </property> >>> > </configuration> >>> > >>> > >>> > and all the three machines are virtual machine with Ubuntu 11.04 >>> > >>> > >>> > this is the /etc/hosts : >>> > master: >>> > 127.0.0.1 localhost ubt >>> > 127.0.0.1 ubt ubuntu >>> > 10.66.201.243 master >>> > 10.66.201.244 slave1 >>> > 10.66.201.245 slave2 >>> > >>> > >>> > slave1: >>> > 127.0.0.1 localhost >>> > 127.0.1.1 slave1 ubuntu >>> > 10.66.201.243 master >>> > 10.66.201.244 slave1 >>> > 10.66.201.245 slave2 >>> > >>> > >>> > slave2: >>> > 127.0.0.1 localhost >>> > 127.0.1.1 slave2 ubuntu >>> > 10.66.201.243 master >>> > 10.66.201.244 slave1 >>> > 10.66.201.245 slave2 >>> > >>> > >>> > any idea on this problems? >>> > >>> > >>> > >>> > >>> > >>> > >>> > cheers >>> > >>> > >>> > exception >>> >> >> >> >> -- >> Shashwat Shriparv >> 09900059620 >> 09663531241 >> >> >> >> <iframe src=" >> http://rcm.amazon.com/e/cm?t=shriparv-20&o=1&p=48&l=ur1&category=kindlerotating&f=ifr"; >> width="728" height="90" scrolling="no" border="0" marginwidth="0" >> style="border:none;" frameborder="0"></iframe>
