See below where there is an rpc mismatch. I'd guess you do not have same hadoop jar under hbase lib as your cluster is running. See manual: http://hbase.apache.org/book.html#requirements, in particular the section on hadoop.
St.Ack On Thu, Jun 2, 2011 at 11:02 PM, praveenesh kumar <[email protected]> wrote: > Hey.. > Thanks for the info.. > > I just installed hbase 0.90.3 on single node. > But my HMaster is not running suddenly.. Previously it was running fine. but > now.. I dnt know its giving the following exception > > > Fri Jun 3 11:27:21 IST 2011 Starting master on ub13 > > ulimit -n 1024 > > 2011-06-03 11:27:22,191 INFO org.apache.hadoop.hbase.ipc.HBaseRpcMetrics: > Initializing RPC Metrics with hostName=HMaster, port=60000 > > 2011-06-03 11:27:22,303 INFO org.apache.hadoop.hbase.security.User: Skipping > login, not running on secure Hadoop > > 2011-06-03 11:27:22,305 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > Responder: starting > > 2011-06-03 11:27:22,309 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > listener on 60000: starting > > 2011-06-03 11:27:22,310 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 0 on 60000: starting > > 2011-06-03 11:27:22,310 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 1 on 60000: starting > > 2011-06-03 11:27:22,310 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 2 on 60000: starting > > 2011-06-03 11:27:22,311 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 4 on 60000: starting > > 2011-06-03 11:27:22,311 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 5 on 60000: starting > > 2011-06-03 11:27:22,311 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 3 on 60000: starting > > 2011-06-03 11:27:22,311 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 6 on 60000: starting > > 2011-06-03 11:27:22,311 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 7 on 60000: starting > > 2011-06-03 11:27:22,322 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 8 on 60000: starting > > 2011-06-03 11:27:22,322 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 9 on 60000: starting > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:host.name=ub13 > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.version=1.6.0_20 > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.vendor=Sun Microsystems Inc. > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.home=/usr/lib/jvm/java-6-openjdk/jre > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.class.path=/usr/local/hadoop/hbase/conf:/usr/lib/jvm/java-6-openjdk/lib/tools.jar:/usr/local/hadoop/hbase:/usr/local/hadoop/hbase/hbase-0.90.3.jar:/usr/local/hadoop/hbase/hbase-0.90.3-tests.jar:/usr/local/hadoop/hbase/lib/activation-1.1.jar:/usr/local/hadoop/hbase/lib/asm-3.1.jar:/usr/local/hadoop/hbase/lib/avro-1.3.3.jar:/usr/local/hadoop/hbase/lib/commons-cli-1.2.jar:/usr/local/hadoop/hbase/lib/commons-codec-1.4.jar:/usr/local/hadoop/hbase/lib/commons-el-1.0.jar:/usr/local/hadoop/hbase/lib/commons-httpclient-3.1.jar:/usr/local/hadoop/hbase/lib/commons-lang-2.5.jar:/usr/local/hadoop/hbase/lib/commons-logging-1.1.1.jar:/usr/local/hadoop/hbase/lib/commons-net-1.4.1.jar:/usr/local/hadoop/hbase/lib/core-3.1.1.jar:/usr/local/hadoop/hbase/lib/guava-r06.jar:/usr/local/hadoop/hbase/lib/hadoop-core-0.20-append-r1056497.jar:/usr/local/hadoop/hbase/lib/jackson-core-asl-1.5.5.jar:/usr/local/hadoop/hbase/lib/jackson-jaxrs-1.5.5.jar:/usr/local/hadoop/hbase/lib/jackson-mapper-asl-1.4.2.jar:/usr/local/hadoop/hbase/lib/jackson-xc-1.5.5.jar:/usr/local/hadoop/hbase/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoop/hbase/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoop/hbase/lib/jaxb-api-2.1.jar:/usr/local/hadoop/hbase/lib/jaxb-impl-2.1.12.jar:/usr/local/hadoop/hbase/lib/jersey-core-1.4.jar:/usr/local/hadoop/hbase/lib/jersey-json-1.4.jar:/usr/local/hadoop/hbase/lib/jersey-server-1.4.jar:/usr/local/hadoop/hbase/lib/jettison-1.1.jar:/usr/local/hadoop/hbase/lib/jetty-6.1.26.jar:/usr/local/hadoop/hbase/lib/jetty-util-6.1.26.jar:/usr/local/hadoop/hbase/lib/jruby-complete-1.6.0.jar:/usr/local/hadoop/hbase/lib/jsp-2.1-6.1.14.jar:/usr/local/hadoop/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/local/hadoop/hbase/lib/jsr311-api-1.1.1.jar:/usr/local/hadoop/hbase/lib/log4j-1.2.16.jar:/usr/local/hadoop/hbase/lib/protobuf-java-2.3.0.jar:/usr/local/hadoop/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/local/hadoop/hbase/lib/slf4j-api-1.5.8.jar:/usr/local/hadoop/hbase/lib/slf4j-log4j12-1.5.8.jar:/usr/local/hadoop/hbase/lib/stax-api-1.0.1.jar:/usr/local/hadoop/hbase/lib/thrift-0.2.0.jar:/usr/local/hadoop/hbase/lib/xmlenc-0.52.jar:/usr/local/hadoop/hbase/lib/zookeeper-3.3.2.jar > > 2011-06-03 11:27:22,353 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.library.path=/usr/lib/jvm/java-6-openjdk/jre/lib/i386/server:/usr/lib/jvm/java-6-openjdk/jre/lib/i386:/usr/lib/jvm/java-6-openjdk/jre/../lib/i386:/usr/java/packages/lib/i386:/usr/lib/jni:/lib:/usr/lib > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.io.tmpdir=/tmp > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:java.compiler=<NA> > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:os.name=Linux > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:os.arch=i386 > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:os.version=2.6.35-22-generic-pae > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:user.name=hadoop > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:user.home=/home/hadoop > > 2011-06-03 11:27:22,354 INFO org.apache.zookeeper.ZooKeeper: Client > environment:user.dir=/usr/local/hadoop/hbase > > 2011-06-03 11:27:22,355 INFO org.apache.zookeeper.ZooKeeper: Initiating > client connection, connectString=ub13:2181 sessionTimeout=180000 > watcher=master:60000 > > 2011-06-03 11:27:22,377 INFO org.apache.zookeeper.ClientCnxn: Opening socket > connection to server ub13/162.192.100.53:2181 > > 2011-06-03 11:27:22,395 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 > for server null, unexpected error, closing socket connection and attempting > reconnect > > java.net.ConnectException: Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592) > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119) > > 2011-06-03 11:27:24,117 INFO org.apache.zookeeper.ClientCnxn: Opening socket > connection to server ub13/162.192.100.53:2181 > > 2011-06-03 11:27:24,118 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 > for server null, unexpected error, closing socket connection and attempting > reconnect > > java.net.ConnectException: Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592) > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119) > > 2011-06-03 11:27:25,639 INFO org.apache.zookeeper.ClientCnxn: Opening socket > connection to server ub13/162.192.100.53:2181 > > 2011-06-03 11:27:25,640 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 > for server null, unexpected error, closing socket connection and attempting > reconnect > > java.net.ConnectException: Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592) > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119) > > 2011-06-03 11:27:26,854 INFO org.apache.zookeeper.ClientCnxn: Opening socket > connection to server ub13/162.192.100.53:2181 > > 2011-06-03 11:27:26,855 INFO org.apache.zookeeper.ClientCnxn: Socket > connection established to ub13/162.192.100.53:2181, initiating session > > 2011-06-03 11:27:26,939 INFO org.apache.zookeeper.ClientCnxn: Session > establishment complete on server ub13/162.192.100.53:2181, sessionid = > 0x1305413defc0000, negotiated timeout = 180000 > > 2011-06-03 11:27:26,955 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: > Initializing JVM Metrics with processName=Master, sessionId=ub13:60000 > > 2011-06-03 11:27:26,965 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: revision > > 2011-06-03 11:27:26,965 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: hdfsUser > > 2011-06-03 11:27:26,965 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: hdfsDate > > 2011-06-03 11:27:26,965 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: hdfsUrl > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: date > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: hdfsRevision > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: user > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: hdfsVersion > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: url > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: MetricsString > added: version > > 2011-06-03 11:27:26,966 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo > > 2011-06-03 11:27:26,967 INFO org.apache.hadoop.hbase.metrics: new MBeanInfo > > 2011-06-03 11:27:26,967 INFO > org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized > > 2011-06-03 11:27:27,021 INFO > org.apache.hadoop.hbase.master.ActiveMasterManager: Master=ub13:60000 > > 2011-06-03 11:27:27,479 FATAL org.apache.hadoop.hbase.master.HMaster: > Unhandled exception. Starting shutdown. > > org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol > org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client = > 42, server = 41) > > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:364) > > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:113) > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:215) > > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:177) > > at > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82) > > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378) > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390) > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196) > > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175) > > at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:344) > > at > org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:81) > > at > org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:347) > > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:283) > > 2011-06-03 11:27:27,480 INFO org.apache.hadoop.hbase.master.HMaster: > Aborting > > 2011-06-03 11:27:27,480 DEBUG org.apache.hadoop.hbase.master.HMaster: > Stopping service threads > > 2011-06-03 11:27:27,480 INFO org.apache.hadoop.ipc.HBaseServer: Stopping > server on 60000 > > 2011-06-03 11:27:27,480 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 2 on 60000: exiting > > 2011-06-03 11:27:27,480 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 0 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 1 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 4 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 3 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 5 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 6 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC > Server listener on 60000 > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 7 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 8 on 60000: exiting > > 2011-06-03 11:27:27,481 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server > handler 9 on 60000: exiting > > 2011-06-03 11:27:27,485 INFO org.apache.hadoop.ipc.HBaseServer: Stopping IPC > Server Responder > > 2011-06-03 11:27:27,505 INFO org.apache.zookeeper.ClientCnxn: EventThread > shut down > > 2011-06-03 11:27:27,506 INFO org.apache.zookeeper.ZooKeeper: Session: > 0x1305413defc0000 closed > > 2011-06-03 11:27:27,506 INFO org.apache.hadoop.hbase.master.HMaster: HMaster > main thread exiting > > > > What can be the reason.. it was working fine before..!! > > Seems like some socket problem, how can I resolve it ?? > > Thanks, > > Praveenesh > > > > > > > On Fri, Jun 3, 2011 at 11:07 AM, lohit <[email protected]> wrote: > >> 2011/6/2 praveenesh kumar <[email protected]> >> >> > Hello guys. >> > >> > I just have installed hbase on my hadoop cluster. >> > HMaster,HRegionServer,HQuorum Peer all are working fine.. as I can see >> > these >> > processes running through JPS. >> > >> > Is there any way to know which regionservers are running right and not ? >> > I mean is there some kind of hbase web UI or anyway to know the status of >> > Hbase cluster ?? >> > >> > Like for hadoop we can use "hadoop fsck" command and other web UIs .. >> > >> Easiest is look at hbase logs or run hbase shell and create table and add a >> row. >> >> > >> > When I used hbase 0.20.6, I can see hbase web UI hosting on 60010 port by >> > default. But I can not see that Web UI when I am using Hbase 0.90.3 ? >> > >> >> Sometimes Jetty take a while to initialize. Do you see anything in hbase >> master log? >> >> >> > Also I can not see hbase-default.xml in my $HBASE_HOME/conf folder. Is >> this >> > the reason for that ? >> > >> You do not need to have hbase-default.xml in conf directory. hbase jar >> already has hbase-default.xml. >> >> > So do I need to set all those configurations on my own for this new >> version >> > ?? >> >> >> > Thanks, >> > Praveenesh >> > >> >> >> >> -- >> Have a Nice Day! >> Lohit >> >
