Hi Diego, The PR at https://github.com/apache/nutch/pull/111 will solve your issue. Thanks
On Mon, May 16, 2016 at 11:40 AM, <[email protected]> wrote: > > From: diego gullo <[email protected]> > To: [email protected] > Cc: > Date: Sun, 15 May 2016 20:04:05 +0100 > Subject: Re: Newbie trouble - Hbase class not found > Hi Lewis > > I have changed the build for the docker containers and in the weekend sent > the PR for the logs folder. The original problem I had is still persistent. > > To reproduce > > > 1. Check out https://github.com/bizmate/nutch > 2. run *docker-compose up -d* - this will pull the docker image based on > the Official docker file and mount it with the configurations suggested > in > the documentation available on the nutch site. i.e. Ivy, gora and > nutch-site configs all available at > https://github.com/bizmate/nutch/tree/master/docker/. This includes the > suggestion from your previous email. > https://github.com/bizmate/nutch/blob/master/docker/nutch/ivy.xml#L117 > 3. access the container docker exec -it nutch bash > 4. su hdbase > 5. Run inject, still says class not found > > > hduser@458c70ec85a2:/opt/nutch$ bin/nutch inject urls/seed.txt > InjectorJob: starting at 2016-05-15 18:40:31 > InjectorJob: Injecting urlDir: urls/seed.txt > Exception in thread "main" *java.lang.NoClassDefFoundError: > org/apache/hadoop/hbase/HBaseConfiguration* > at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:114) > at > > org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:102) > at > > org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:161) > at > > org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135) > at > org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:78) > at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:233) > at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:267) > at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:290) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) > at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:299) > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.hbase.HBaseConfiguration > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) > at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > ... 10 more > > this is also despite setting HBASE_HOME and HADOOP_CLASSPATH as suggested > here - > > http://stackoverflow.com/questions/26364057/exception-in-thread-main-java-lang-noclassdeffounderror-org-apache-hadoop-hba > >
