nutch-user  

Re: Job failed!

zhengsj03
Fri, 05 Sep 2008 02:29:30 -0700

Could you show the whole hdaoop.log?
在 2008-09-05五的 08:46 +0000,Edward Quick写道:
> Hi,
> 
> I ran a crawl last night 
> 
> bin/nutch crawl urls -dir crawl -depth 10
> 
> which collected 10612 pages, and then bailed out with the following error:
> 
> Exception in thread "main" java.io.IOException: Job failed!
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1062)
>         at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:552)
>         at org.apache.nutch.crawl.Crawl.main(Crawl.java:122)
> 
> I checked there was enough space on the box, and there don't appear to be any 
> errors in hadoop.log or the crawl output, so I'm stuck on what caused this.
> 
> Also, is there a way to pick up the crawl from where it stopped rather than 
> having to rerun it all over again?
> 
> Thanks for any help.
> 
> Ed.
> 
> 
> 
> _________________________________________________________________
> Discover Bird's Eye View now with Multimap from Live Search
> http://clk.atdmt.com/UKM/go/111354026/direct/01/