Hi Lewis.
We have ports blocked on our box, so that may be causing issues with
Ivy (which is why I prefer just standard ant and having all the
required jars sitting in a lib directory).
Every time I try to run nutch, I get this:
$ ./bin/nutch inject urls/
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/util/PlatformName
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.hadoop.util.PlatformName.
Program will exit.
Warning: $HADOOP_HOME is deprecated.
[Also, if I don't give a $HADOOP_HOME it tells me to do that, so I'm
not sure what the deal is with that...]
I made the 2 changes listed on
http://wiki.apache.org/nutch/Nutch2Tutorial, but I still get:
12/10/01 18:04:25 ERROR crawl.InjectorJob: InjectorJob:
org.apache.gora.util.GoraException: java.io.IOException:
java.lang.ClassNotFoundException: org.hsqldb.jdbc.JDBCDriver
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:167)
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135)
at
org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:75)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:214)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:228)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:248)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:258)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.IOException: java.lang.ClassNotFoundException:
org.hsqldb.jdbc.JDBCDriver
at org.apache.gora.sql.store.SqlStore.getConnection(SqlStore.java:747)
at org.apache.gora.sql.store.SqlStore.initialize(SqlStore.java:160)
at
org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:102)
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:161)
... 12 more
Caused by: java.lang.ClassNotFoundException: org.hsqldb.jdbc.JDBCDriver
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at org.apache.gora.sql.store.SqlStore.getConnection(SqlStore.java:735)
... 15 more
I'm guessing that there are more properies or things that should be in
the CLASSPATH that aren't.
Is there a tutorial that is a bit more in depth, with some examples?
Or any other documentation on how to actually set up the new Nutch
from start to finish? I'd really like to switch to this new Nutch,
but since I haven't used any of these other tools, it's a daunting
task to get this up and running.
-- Chris
On Mon, Oct 1, 2012 at 1:19 PM, Lewis John Mcgibbney
<[email protected]> wrote:
> Hi Chris,
>
> Excellent news. I can only assume that there is a compatibility issue
> with your RedHat box and 2.1!
>
> Please see our 2.x tutorials below
>
> http://wiki.apache.org/nutch/#Nutch_2.X_tutorial.28s.29
>
> There are currently quite a few options for storing your webdb or
> hostdb crawl data.
>
> Any questions, please get back on list.
>
> hth
>
> Lewis
>
> On Mon, Oct 1, 2012 at 6:02 PM, Christopher Gross <[email protected]> wrote:
>> I was able to get it built on my windows box, then I moved that to my
>> linux box. Now I'm trying to run it, but getting other errors (wants
>> me to configure a DB).
>>
>> Is there a more thorough setup guide for Nutch 2.1 somewhere? I was
>> able to work with 1.4 more or less out of the box (some minor
>> configuration needed), but 2.1 seems to be a completely different
>> beast.
>>
>> -- Chris
>>
>>
>> On Mon, Oct 1, 2012 at 12:12 PM, Christopher Gross <[email protected]> wrote:
>>> I get that same error for 2.1 as well, FYI.
>>>
>>> -- Chris
>>>
>>>
>>> On Mon, Oct 1, 2012 at 12:10 PM, Christopher Gross <[email protected]>
>>> wrote:
>>>> OS: Red Hat Enterprise Linux Server release 5.8 (Tikanga)
>>>> java version "1.6.0_30"
>>>> Apache Ant version 1.7.0 compiled on December 13 2006
>>>>
>>>> OK, I'm not going to be going live with a 2.x version of Nutch anytime
>>>> soon, I just wanted to make sure that when I'm ready to deploy it'll
>>>> be a full release, so if you're really pushing for 2.1 to be out soon,
>>>> then that's what I'll work with.
>>>>
>>>> -- Chris
>>>>
>>>>
>>>> On Mon, Oct 1, 2012 at 11:31 AM, Lewis John Mcgibbney
>>>> <[email protected]> wrote:
>>>>> Hi Chris,
>>>>>
>>>>> On Mon, Oct 1, 2012 at 4:17 PM, Christopher Gross <[email protected]>
>>>>> wrote:
>>>>>
>>>>>> I moved it to a different directory, same errors.
>>>>>
>>>>> Mmm. I'm stumped here. What OS as you on?
>>>>>>
>>>>>> I'll try 2.1 and see if that works any better.
>>>>>
>>>>> Please do and get back to us with your results as we are currently
>>>>> trying to build proof of concept before closing the RC.
>>>>>
>>>>>>
>>>>>> Do you have an idea when 2.1 will go from a release candidate to a
>>>>>> full release? A ballpark is OK.
>>>>>>
>>>>>
>>>>> I suspect (further to more in depth testing from some more committers
>>>>> and community members) I would like to see it released in the next few
>>>>> days.
>>>>>
>>>>> Lewis
>
>
>
> --
> Lewis
