Yeah, our zookeeper story was in a bit of flux there over the last month or so but Nitay nailed it about a week ago. Smooth sailing here on out (fingers-crossed). St.Ack
On Mon, Jul 20, 2009 at 9:49 AM, tim robertson <[email protected]>wrote: > Just spotted that in the other thread stack. Just making changes to > let HBase manage zookeeper > > Cheers > > Tim > > > On Mon, Jul 20, 2009 at 6:37 PM, stack<[email protected]> wrote: > > Zookeeper is running? > > > > The hbase-site.xml is pointing at your quorum? > > > > St.Ack > > > > On Mon, Jul 20, 2009 at 9:34 AM, tim robertson < > [email protected]>wrote: > > > >> Hmmm... I must have been doing something stupid. I added zookeeper > >> and the CP error disappeared - I guess I hadn't restarted properly. > >> > >> Now trying to find the next issue ;o) > >> > >> Cheers, > >> > >> Tim > >> > >> > >> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: > >> Exception closing session 0x0 to sun.nio.ch.selectionkeyi...@6929ae9b > >> java.net.ConnectException: Connection refused > >> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > >> at > >> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574) > >> at > >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:885) > >> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring > >> exception during shutdown input > >> java.nio.channels.ClosedChannelException > >> at > >> sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638) > >> at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360) > >> at > >> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:951) > >> at > >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922) > >> 2009-07-20 18:31:22,669 WARN org.apache.zookeeper.ClientCnxn: Ignoring > >> exception during shutdown output > >> java.nio.channels.ClosedChannelException > >> at > >> sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:649) > >> at > sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:368) > >> at > >> org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:956) > >> at > >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:922) > >> 2009-07-20 18:31:22,770 WARN > >> org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper: Failed to create > >> /hbase: > >> org.apache.zookeeper.KeeperException$ConnectionLossException: > >> KeeperErrorCode = ConnectionLoss for /hbase > >> at > >> org.apache.zookeeper.KeeperException.create(KeeperException.java:90) > >> at > >> org.apache.zookeeper.KeeperException.create(KeeperException.java:42) > >> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:522) > >> at > >> > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureExists(ZooKeeperWrapper.java:342) > >> at > >> > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.ensureParentExists(ZooKeeperWrapper.java:363) > >> at > >> > org.apache.hadoop.hbase.zookeeper.ZooKeeperWrapper.checkOutOfSafeMode(ZooKeeperWrapper.java:476) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:848) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:517) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:526) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:499) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:530) > >> at > >> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:493) > >> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:124) > >> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:102) > >> at > >> > org.gbif.occurrencestore.mapreduce.DwCTabFileLoader$MapLoad.setup(DwCTabFileLoader.java:64) > >> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142) > >> at > org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518) > >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303) > >> at org.apache.hadoop.mapred.Child.main(Child.java:170) > >> > >> > >> > >> > >> > >> > >> > >> On Mon, Jul 20, 2009 at 6:17 PM, Jonathan Gray<[email protected]> wrote: > >> > Not sure why HBC was not found. Perhaps you need the hadoop jar? > >> > > >> > But yes, you need the zookeeper jar in the classpath that ships with > >> hbase. > >> > > >> > tim robertson wrote: > >> >> > >> >> Hi all, > >> >> > >> >> I am trying to bulk import using my own mapreduce code (doing the > >> >> insert in my map()). > >> >> > >> >> I have modified my hadoop-env.sh to have the following: > >> >> export > >> >> > >> > HADOOP_CLASSPATH=/var/root/hbase-0.20.0/hbase-0.20.0-dev.jar:/var/root/hbase-0.20.0/conf > >> >> > >> >> the paths are correct, and I copied it around the cluster and > >> >> restarted all demons. > >> >> > >> >> When trying to load in using mapreduce I get the following 2 errors > >> >> java.lang.NoClassDefFoundError: > >> org/apache/hadoop/hbase/HBaseConfiguration > >> >> java.lang.ClassNotFoundException: org.apache.zookeeper.Watcher > >> >> > >> >> Does zookeeper now have to be on the CP? > >> >> I am not sure why HBaseConfiguration is not found though... could it > >> >> be a permission thing as I am running everything as root user? > >> >> > >> >> Thanks for any pointers, > >> >> > >> >> Tim > >> >> > >> > > >> > > >
