Just spotted that in the other thread stack. Just making changes to let HBase manage zookeeper
Cheers Tim On Mon, Jul 20, 2009 at 6:37 PM, stack<[email protected]> wrote: > Zookeeper is running? > > The hbase-site.xml is pointing at your quorum? > > St.Ack > > On Mon, Jul 20, 2009 at 9:34 AM, tim robertson > <[email protected]>wrote: > >> Hmmm... I must have been doing something stupid. I added zookeeper >> and the CP error disappeared - I guess I hadn't restarted properly. >> >> Now trying to find the next issue ;o) >> >> Cheers, >> >> Tim >> >> >> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: >> Exception closing session 0x0 to sun.nio.ch.selectionkeyi...@6929ae9b >> java.net.ConnectException: Connection refused >> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) >> at >> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574) >> at >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:885) >> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring >> exception during shutdown input >> java.nio.channels.ClosedChannelException >> at >> sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638) >> at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) >> at >> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:951) >> at >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922) >> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring >> exception during shutdown output >> java.nio.channels.ClosedChannelException >> at >> sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649) >> at sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368) >> at >> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:956) >> at >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922) >> 2009-07-20 18:31:22,770 WARN >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create >> /hbase: >> org.apache.zookeeper.KeeperException$ConnectionLossException: >> KeeperErrorCode = ConnectionLoss for /hbase >> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:90) >> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:42) >> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:522) >> at >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureExists(ZooKeeperWrapper.java:342) >> at >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureParentExists(ZooKeeperWrapper.java:363) >> at >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.checkOutOfSafeMode(ZooKeeperWrapper.java:476) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:848) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:517) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:526) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:530) >> at >> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:493) >> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:124) >> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:102) >> at >> org.gbif.occurrencestore.mapreduce.DwCTabFileLoader$MapLoad.setup(DwCTabFileLoader.java:64) >> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142) >> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518) >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303) >> at org.apache.hadoop.mapred.Child.main(Child.java:170) >> >> >> >> >> >> >> >> On Mon, Jul 20, 2009 at 6:17 PM, Jonathan Gray<[email protected]> wrote: >> > Not sure why HBC was not found. Perhaps you need the hadoop jar? >> > >> > But yes, you need the zookeeper jar in the classpath that ships with >> hbase. >> > >> > tim robertson wrote: >> >> >> >> Hi all, >> >> >> >> I am trying to bulk import using my own mapreduce code (doing the >> >> insert in my map()). >> >> >> >> I have modified my hadoop-env.sh to have the following: >> >> export >> >> >> HADOOP_CLASSPATH=/var/root/hbase-0.20.0/hbase-0.20.0-dev.jar:/var/root/hbase-0.20.0/conf >> >> >> >> the paths are correct, and I copied it around the cluster and >> >> restarted all demons. >> >> >> >> When trying to load in using mapreduce I get the following 2 errors >> >> java.lang.NoClassDefFoundError: >> org/apache/hadoop/hbase/HBaseConfiguration >> >> java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher >> >> >> >> Does zookeeper now have to be on the CP? >> >> I am not sure why HBaseConfiguration is not found though... could it >> >> be a permission thing as I am running everything as root user? >> >> >> >> Thanks for any pointers, >> >> >> >> Tim >> >> >> > >> >
