Your first error is that of a HDFS permissions (over the /tmp area) and/or Windows caused issue. Your second error is that of the configs (hbase-site.xml) missing on the runtime classpath of your jar.
You'll just need to find and resolve the first issue, which is more of a HDFS/MR issue than HBase. I'm guessing your /tmp/ isn't properly permissive or is probably being tried on a local filesystem of Windows which wouldn't work. On Sun, Mar 24, 2013 at 12:07 PM, Joel Alexandre <[email protected]> wrote: > Hi, > > i'm doing a test project with hadoop and hbase. My current cluster has 2 > Ubuntu VMs hosted on a windows machine. > > Using the Java HBASE API, i can PUT, QUERY and DELETE row remotly (in my > host machine) using > > config = HBaseConfiguration.create(); > config.set("hbase.zookeeper.quorum", "192.168.56.90"); > config.set("hbase.zookeeper.property.clientPort", "2222"); > > When i tried running a hbase mapreduce job on windows with the same config > as above, i get a > > 13/03/24 06:11:03 ERROR security.UserGroupInformation: > PriviledgedActionException as:Joel cause:java.io.IOException: Failed to set > permissions of path: \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging > to 0700 > java.io.IOException: Failed to set permissions of path: > \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging to 0700 > > From what i found in the web, it's a problem o running mapreduce jobs in > windows. > > So i tried the mapreduce job in Linux by using "java - jar MR.jar" file. > > In linux, i can't connect to zookeeper. For some reason, the zookeeper host > and port are reset in the client > > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client > environment:os.version=3.5.0-23-generic > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client environment:user.name > =hduser > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client > environment:user.home=/home/hduser > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client > environment:user.dir=/home/hduser/testes > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Initiating client connection, > connectString=192.168.56.90:2222 sessionTimeout=180000 watcher=hconnection > 13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of > this process is 11552@node01 > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to > server node01/*192.168.56.90:2222*. Will not attempt to authenticate using > SASL (unknown error) > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Socket connection established > to node01/192.168.56.90:2222, initiating session* > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Session establishment > complete on server node01/192.168.56.90:2222*, sessionid = > 0x13d9afaa1a30006, negotiated timeout = 180000 > 13/03/24 05:59:33 INFO client.HConnectionManager$HConnectionImplementation: > Closed zookeeper sessionid=0x13d9afaa1a30006 > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Session: 0x13d9afaa1a30006 > closed > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: EventThread shut down > 13/03/24 05:59:33 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > 13/03/24 05:59:33 WARN mapred.JobClient: Use GenericOptionsParser for > parsing the arguments. Applications should implement Tool for the same. > 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: *Initiating client connection, > connectString=localhost:2181 *sessionTimeout=180000 watcher=hconnection > 13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of > this process is 11552@node01 > 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to > server localhost/127.0.0.1:2181. Will not attempt to authenticate using > SASL (unknown error) > 13/03/24 05:59:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692) > at > org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) > > Looking at the above log, it connects correctly to > 192.168.56.90:2222(node01 resolves to 192.168.56.90). But for some > reason, it changes to > localhost:2181 and it then gives a connection refused. > > How can i fix this to get a MR jobs running in linux, on the same machine > as zookeeper? > > versions: Hbase 0.94.5 / hadoop 1.1.2 > > Thanks. -- Harsh J
