I downloaded the latest nightly build of nutch today and tried to run
"nutch crawl" but
the crawling stopped with the same "Job Failed!" message:
060607 154925 CrawlDb update: Merging segment data into db.
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:342)
at org.apache.nutch.crawl.CrawlDb.update(CrawlDb.java:54)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:113)
Exception in thread "main"
Is my symptom related to the one that William reports?
-kuro
> -----Original Message-----
> From: William Choi [mailto:[EMAIL PROTECTED]
> Sent: 2006-6-07 16:01
> To: [email protected]
> Subject: Error on running Hadoop examples
>
> Hi all,
>
> I've downloaded last night build of Hadoop, and I want
> to run the wordcount example. However I got an error:
>
> [EMAIL PROTECTED] hadoopBuild]$ bin/hadoop jar
> build/hadoop-0.3-dev-examples.jar sort
> /hadoop/home/testExampleIn/ /hadoop/home/testExampleOut/
> 060607 155753 parsing
> file:/hadoop/hadoopBuild/conf/hadoop-default.xml
> 060607 155753 parsing
> file:/hadoop/hadoopBuild/conf/mapred-default.xml
> 060607 155753 parsing
> file:/hadoop/hadoopBuild/conf/mapred-default.xml
> 060607 155753 parsing file:/hadoop/hadoopBuild/conf/hadoop-site.xml
> 060607 155753 Client connection to 192.168.0.101:9001: starting
> 060607 155753 Client connection to 192.168.0.101:9000: starting
> Running on 3 nodes to sort from /hadoop/home/testExampleIn
> into /hadoop/home/testExampleOut.
> Job started: Wed Jun 07 15:57:53 PDT 2006
> 060607 155753 parsing
> file:/hadoop/hadoopBuild/conf/hadoop-default.xml
> 060607 155754 parsing file:/hadoop/hadoopBuild/conf/hadoop-site.xml
> 060607 155754 Running job: job_0001
> 060607 155755 map 100% reduce 100%
> java.io.IOException: Job failed!
> at
> org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:341)
> at org.apache.hadoop.examples.Sort.main(Sort.java:115)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess
> orImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth
> odAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke
> (ProgramDriver.java:69)
> at
> org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:141)
> at
> org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:39)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccess
> orImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMeth
> odAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:130)
>
>
> ANY idea what's going ON? I set this up on 3 machines, the
> set up is actually pretty similar as what I told by the
> NutchHadoopTutorial. I only modified the hadoop-site.xml,
> hadoop-env.sh and slaves so that it can work on 3 machines.
>
> Any help will be appreciated.
>
>
> William
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
>
