Well, yes, it certainly can be a nightmare :) But this should not be
difficult to get running.
Can you check the TaskTracker and Child running on Y to ensure that the
conf directory which contains hbase-site.xml is listed in the classpath,
and ensure that the path it's pointing to contains the correct
hbase-site.xml.
Hard to say why, but the issue is almost certainly inability to find
hbase-site.xml (or it's finding one pointing to localhost).
Saptarshi Guha wrote:
Yes, I did this
export HADOOP_CLASSPATH=$HBASE_HOME/conf/
in $HADOOP_HOME/conf/hadoop-env.sh
Am I inexperienced or is JAVA class path a nightmare?
On Tue, Aug 25, 2009 at 9:23 PM, Jonathan Gray<[email protected]> wrote:
You need to have hbase-site.xml somewhere in the classpath of the job
running on Y (that's where it specifies that zk is on X, not localhost).
Saptarshi Guha wrote:
Hello,
I am trying to run a Mapreduce job using Hbase as a source. X,Y are
region servers, X is master and Zookeeper.
Y is the only tasktracker., both have 16Gb ram.
I have kept the hbase-dev.20 and zookeeper jars in $HADOOP/lib folder
across machines.
When run with mapred.job.tracker='local' , it works,(it runs on X)
(entry from log
9/08/25 21:03:04 INFO zookeeper.ZooKeeper: Initiating client
connection, host=localhost:2181 sessionTimeout=30000
watcher=org.apache.hadoop.hbase.client.hconnectionmanager$tableserv...@4abf053f
09/08/25 21:03:04 INFO zookeeper.ClientCnxn: Attempting connection to
server localhost/127.0.0.1:2181
09/08/25 21:03:04 INFO zookeeper.ClientCnxn: Priming connection to
java.nio.channels.SocketChannel[connected local=/127.0.0.1:59598
remote=localhost/127.0.0.1:2181]
)
But when on a distributed mode, (the job now runs on Y)
i get these errors:
Why is quorum server equal to localhost:2181? Shouldn't it be on X?
According to the web UI, the quorum server is running on X:2181.
Is Mapreduce not loading the Hbase configuration file?
2009-08-25 21:04:29,335 INFO org.apache.zookeeper.ZooKeeper:
Initiating client connection, host=localhost:2181 sessionTimeout=30000
watcher=org.apache.hadoop.hbase.client.hconnectionmanager$tableserv...@62facf0b
2009-08-25 21:04:29,336 INFO org.apache.zookeeper.ClientCnxn:
zookeeper.disableAutoWatchReset is false
2009-08-25 21:04:29,343 INFO org.apache.zookeeper.ClientCnxn:
Attempting connection to server localhost/127.0.0.1:2181
2009-08-25 21:04:29,344 WARN org.apache.zookeeper.ClientCnxn:
Exception closing session 0x0 to sun.nio.ch.selectionkeyi...@360dc67e
java.net.ConnectException: Connection refused
....
009-08-25 21:04:29,454 WARN
org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create
/hbase -- check quorum servers, currently=localhost:2181
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
at
org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:522)
Thank you
Saptarshi
