You need to have hbase-site.xml somewhere in the classpath of the job
running on Y (that's where it specifies that zk is on X, not localhost).
Saptarshi Guha wrote:
Hello,
I am trying to run a Mapreduce job using Hbase as a source. X,Y are
region servers, X is master and Zookeeper.
Y is the only tasktracker., both have 16Gb ram.
I have kept the hbase-dev.20 and zookeeper jars in $HADOOP/lib folder
across machines.
When run with mapred.job.tracker='local' , it works,(it runs on X)
(entry from log
9/08/25 21:03:04 INFO zookeeper.ZooKeeper: Initiating client
connection, host=localhost:2181 sessionTimeout=30000
watcher=org.apache.hadoop.hbase.client.hconnectionmanager$tableserv...@4abf053f
09/08/25 21:03:04 INFO zookeeper.ClientCnxn: Attempting connection to
server localhost/127.0.0.1:2181
09/08/25 21:03:04 INFO zookeeper.ClientCnxn: Priming connection to
java.nio.channels.SocketChannel[connected local=/127.0.0.1:59598
remote=localhost/127.0.0.1:2181]
)
But when on a distributed mode, (the job now runs on Y)
i get these errors:
Why is quorum server equal to localhost:2181? Shouldn't it be on X?
According to the web UI, the quorum server is running on X:2181.
Is Mapreduce not loading the Hbase configuration file?
2009-08-25 21:04:29,335 INFO org.apache.zookeeper.ZooKeeper:
Initiating client connection, host=localhost:2181 sessionTimeout=30000
watcher=org.apache.hadoop.hbase.client.hconnectionmanager$tableserv...@62facf0b
2009-08-25 21:04:29,336 INFO org.apache.zookeeper.ClientCnxn:
zookeeper.disableAutoWatchReset is false
2009-08-25 21:04:29,343 INFO org.apache.zookeeper.ClientCnxn:
Attempting connection to server localhost/127.0.0.1:2181
2009-08-25 21:04:29,344 WARN org.apache.zookeeper.ClientCnxn:
Exception closing session 0x0 to sun.nio.ch.selectionkeyi...@360dc67e
java.net.ConnectException: Connection refused
....
009-08-25 21:04:29,454 WARN
org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create
/hbase -- check quorum servers, currently=localhost:2181
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase
at org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:522)
Thank you
Saptarshi
