Hi everybody,
I am a beginner using Hbase for testings, I already managed to implement
Pseudo distributed conf with Hadoop 0.20 + Hbase 0.26 on my machine,
as well as
distributed one with virtual machines....
but I do not manage to run any 0.90 or
0.91 build...I am running Ubuntu x64 desktop 10.04 and recently 10.10
Indeed, I assume to have followed guidelines I found on Apache and community
websites, which I basically understood as beeing:
1) check out hbase trunk
2) build with Maven
3) check out hadoop 0.20-append
4) build with Ant
Hadoop is started and responsive but Hbase is always in error when starting:
[: 54: true: unexpected operator
localhost: starting zookeeper, logging to
/home/coochie/hbase/logs/hbase-coochie-zookeeper-GERONIMO.out
starting master, logging to
/home/coochie/hbase/logs/hbase-coochie-master-GERONIMO.out
localhost: starting regionserver, logging to
/home/coochie/hbase/logs/hbase-coochie-regionserver-GERONIMO.out
localhost: Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/hbase/Leases
localhost: at java.lang.Class.forName0(Native Method)
localhost: at java.lang.Class.forName(Class.java:264)
localhost: at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:762)
localhost: at org.apache.hadoop.conf.Configuration.getClass
(Configuration.java:807)
localhost: at
org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2881)
localhost: Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.Leases
localhost: at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
localhost: at java.security.AccessController.doPrivileged(Native Method)
localhost: at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
In the Master log, it says that it is waiting for RegionServer, RegionServer log
says it has started but Zookeeper log shows the real problem:
mercredi 30 mars 2011, 21:57:03 (UTC+0200) Starting zookeeper on GERONIMO
ulimit -n 32768
2011-03-30 21:57:04,015 ERROR
org.apache.zookeeper.server.quorum.QuorumPeerConfig: Invalid configuration,
only
one server specified (ignoring)
2011-03-30 21:57:04,033 INFO org.apache.zookeeper.server.ZooKeeperServerMain:
Starting server
2011-03-30 21:57:04,062 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
2011-03-30 21:57:04,062 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:host.name=GERONIMO
2011-03-30 21:57:04,062 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.version=1.6.0_20
2011-03-30 21:57:04,062 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.vendor=Sun Microsystems Inc.
2011-03-30 21:57:04,062 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.home=/usr/lib/jvm/java-6-openjdk/jre
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.class.path=/home/coochie/hbase/conf:/usr/lib/jvm/java-6-openjdk/
lib/tools.jar:/home/coochie/hbase:/home/coochie/hbase/hbase-0.91.0-SNAPSHOT.jar:/
home/coochie/hbase/hbase-0.91.0-SNAPSHOT-tests.jar:/home/coochie/hbase/lib/
activation-1.1.jar:/home/coochie/hbase/lib/asm-3.1.jar:/home/coochie/hbase/lib/
avro-1.4.1.jar:/home/coochie/hbase/lib/commons-cli-1.2.jar:/home/coochie/hbase/
lib/commons-codec-1.4.jar:/home/coochie/hbase/lib/commons-collections-3.2.1.jar:/
home/coochie/hbase/lib/commons-el-1.0.jar:/home/coochie/hbase/lib/
ommons-httpclient-3.1.jar:/home/coochie/hbase/lib/commons-lang-2.5.jar:/home/
coochie/hbase/lib/commons-logging-1.1.1.jar:/home/coochie/hbase/lib/
commons-net-1.4.1.jar:/home/coochie/hbase/lib/core-3.1.1.jar:/home/coochie/
hbase/lib/guava-r06.jar:/home/coochie/hbase/lib/hadoop-core-0.20.3.jar:/home/
coochie/hbase/lib/hadoop-test-0.20.3.jar:/home/coochie/hbase/lib/
hbase-0.20.3-indexed.jar:/
home/coochie/hbase/lib/hbase-0.20.6-transactional.jar:/home/coochie/hbase/lib/
hbase-0.91.0-SNAPSHOT.jar:/home/coochie/hbase/lib/high-scale-lib-1.1.1.jar:/home
/coochie/hbase/lib/jackson-core-asl-1.5.5.jar:/home/coochie/hbase/lib/
jackson-jaxrs-1.5.5.jar:/home/coochie/hbase/lib/jackson-mapper-asl-1.4.2.jar:
/home/coochie/hbase/lib/jackson-xc-1.5.5.jar:/home/coochie/hbase/lib/
jasper-compiler-5.5.23.jar:/home/coochie/hbase/lib/
jasper-runtime-5.5.23.jar:/home/
coochie/hbase/lib/jaxb-api-2.1.jar:/home/coochie/hbase/lib/
jaxb-impl-2.1.12.jar:/home/coochie/hbase/lib/jersey-core-1.4.jar:/home/
coochie/hbase/lib/jersey-json-1.4.jar:/home/coochie/hbase/lib/
jersey-server-1.4.jar:/home/coochie/hbase/lib/jettison-1.1.jar:/home/
coochie/hbase/lib/jetty-6.1.26.jar:/home/coochie/hbase/lib/
jetty-util-6.1.26.jar:/home/coochie/hbase/lib/jruby-complete-1.6.0.jar:
/home/coochie/hbase/lib/jsp-2.1-6.1.14.jar:/home/coochie/hbase/lib/
jsp-api-2.1-6.1.14.jar:/home/coochie/hbase/lib/jsr311-api-1.1.1.jar:
/home/coochie/hbase/lib/libthrift-0.5.0.jar:/home/coochie/hbase/lib/
log4j-1.2.16.jar:/home/coochie/hbase/lib/netty-3.2.1.Final.jar:/home/
coochie/hbase/lib/oro-2.0.8.jar:/home/coochie/hbase/lib/
protobuf-java-2.3.0.jar:/home/coochie/hbase/lib/
servlet-api-2.5-6.1.14.jar:/home/coochie/hbase/lib/servlet-api-2.5.jar:
/home/coochie/hbase/lib/slf4j-api-1.5.8.jar:/home/coochie/hbase/lib/
slf4j-log4j12-1.5.8.jar:/home/coochie/hbase/lib/stax-api-1.0.1.jar:
/home/coochie/hbase/lib/velocity-1.6.4.jar:/home/coochie/hbase/lib/
xmlenc-0.52.jar:/home/coochie/hbase/lib/zookeeper-3.3.2.jar:/home/coochie/
hbase/conf:/home/coochie/hbase/lib/hbase-0.20.6-transactional.jar:/home/
coochie/hbase/lib/zookeeper-3.3.2.jar:/home/coochie/hadoop/conf
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer:
Server
environment:java.library.path=/usr/lib/jvm/java-6-openjdk/jre/lib/amd64/server:
/usr/lib/jvm/java-6-openjdk/jre/lib/amd64:
/usr/lib/jvm/java-6-openjdk/jre/../lib/amd64:/opt/ati-stream-sdk-v2.3-lnx64/
lib/x86_64:/usr/java/packages/lib/amd64:/usr/lib/jni:/lib:/usr/lib
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.io.tmpdir=/tmp
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:java.compiler=<NA>
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:os.name=Linux
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:os.arch=amd64
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:os.version=2.6.35-28-generic
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:user.name=coochie
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:user.home=/home/coochie
2011-03-30 21:57:04,063 INFO org.apache.zookeeper.server.ZooKeeperServer: Server
environment:user.dir=/home/coochie/hbase
2011-03-30 21:57:04,073 INFO org.apache.zookeeper.server.ZooKeeperServer:
tickTime set to 3000
2011-03-30 21:57:04,073 INFO org.apache.zookeeper.server.ZooKeeperServer:
minSessionTimeout set to -1
2011-03-30 21:57:04,073 INFO org.apache.zookeeper.server.ZooKeeperServer:
maxSessionTimeout set to 180000
2011-03-30 21:57:04,091 INFO org.apache.zookeeper.server.NIOServerCnxn: binding
to port 0.0.0.0/0.0.0.0:2181
2011-03-30 21:57:04,104 INFO
org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting: 0
2011-03-30 21:57:05,298 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted
socket connection from /127.0.0.1:33178
2011-03-30 21:57:05,303 INFO org.apache.zookeeper.server.NIOServerCnxn: Client
attempting to establish new session at /127.0.0.1:33178
2011-03-30 21:57:05,305 INFO org.apache.zookeeper.server.persistence.FileTxnLog:
Creating new log file: log.1
2011-03-30 21:57:05,450 INFO org.apache.zookeeper.server.NIOServerCnxn:
Established session 0x12f085736ed0000 with negotiated timeout 180000 for client
/127.0.0.1:33178
2011-03-30 21:57:06,873 INFO org.apache.zookeeper.server.NIOServerCnxn: Accepted
socket connection from /127.0.0.1:33190
2011-03-30 21:57:06,874 INFO org.apache.zookeeper.server.NIOServerCnxn: Client
attempting to establish new session at /127.0.0.1:33190
2011-03-30 21:57:06,883 INFO org.apache.zookeeper.server.NIOServerCnxn:
Established session 0x12f085736ed0001 with negotiated timeout 180000 for client
/127.0.0.1:33190
2011-03-30 21:57:06,885 INFO org.apache.zookeeper.server.PrepRequestProcessor:
Got user-level KeeperException when processing sessionid:0x12f085736ed0001
type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/hbase Error:KeeperErrorCode = NodeExists for /hbase
2011-03-30 21:57:06,896 INFO org.apache.zookeeper.server.PrepRequestProcessor:
Got user-level KeeperException when processing sessionid:0x12f085736ed0001
type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/hbase/unassigned Error:KeeperErrorCode = NodeExists for /hbase/unassigned
2011-03-30 21:57:06,907 INFO org.apache.zookeeper.server.PrepRequestProcessor:
Got user-level KeeperException when processing sessionid:0x12f085736ed0001
type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/hbase/rs Error:KeeperErrorCode = NodeExists for /hbase/rs
2011-03-30 21:57:06,916 INFO org.apache.zookeeper.server.PrepRequestProcessor:
Got user-level KeeperException when processing sessionid:0x12f085736ed0001
type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error
Path:/hbase/table Error:KeeperErrorCode = NodeExists for /hbase/table
I have checked Hadoop and Hbase config files with the beginner's knowledge I
have, but I am unable to set it up correctly as with precedent builds (I always
start with a re-formated HDFS filestore with "hadoop namenode -format")
Can someone give me a clue on which direction I may pursue ? I attempted to
restrict as l0 loopback for DNS services, use IP, hostname, 127.0.0.1 i various
config file but stil same error....
Hadoop and Hbase tars are built with test, no critical error to mention when
building ...I have surely made (a) mistake(s) or under-considered some
parameters, but I am stuck ... (I greatly wait for Lars Georges'upcming book on
HBase !)
Could it be because I included in hbase/lib hbase-0.20.3-indexed.jar and
hbase-0.20.6.transactional.jar alternate packages for further indexing tests ?
because I am using non-Sun JDK ?
In any case, thank you in advance for any help provided,
Cheers.
Jérôme.
XML config:
<configuration>
<property>
<name>hbase.master</name>
<value>localhost:60000</value>
<description>The host and port that the HBase master runs at.
</description>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://localhost.localdomain:8020/hbase</value>
<description>The directory shared by region servers.
Should be fully-qualified to include the filesystem to use.
E.g: hdfs://NAMENODE_SERVER:PORT/HBASE_ROOTDIR
</description>
</property>
<property> <name>hbase.zookeeper.dns.interface</name> <value>l0</value>
</property>
<property> <name>hbase.regionserver.dns.interface</name> <value>l0</value>
</property>
<property> <name>hbase.master.dns.interface</name> <value>l0</value>
</property>
<property>
<name>dfs.support.append</name>
<value>true</value>
<description>Allow append support (if you want to test data durability
with HDFS)
</description>
</property>
<property>
<name>hbase.regionserver.class</name>
<value>org.apache.hadoop.hbase.ipc.IndexedRegionInterface</value>
</property>
<property>
<name>hbase.regionserver.impl</name>
<value>org.apache.hadoop.hbase.regionserver.tableindexed.IndexedRegionServer
</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
<description>For psuedo-distributed, you want to set this to true.
false means that HBase tries to put Master + RegionServers in one process.
Pseudo-distributed = seperate processes/pids</description>
</property>
<property>
<name>hbase.regionserver.hlog.replication</name>
<value>1</value>
<description></description>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
<description>Property from ZooKeeper's config zoo.cfg.
The port at which the clients will connect.
</description>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>localhost</value>
<description></description>
</property>
</configuration>
