On Jan 21, 2007, at 6:47 AM, Sami Siren wrote:
>> However I cannot find from the change logs of hadoop that what the
>> change is that is causing nutch these problems.
>
> It's HADOOP-331, so i guess at least the changes/additions in map() is
> required.
Hi, just following up here-- does this indicate that if I get a
hadoop nightly that was patched for HADOOP-331 and have Nutch use it,
the EOFException will go away in the latest nightlies?
I tried that, it now crashes in a different spot, during fetching:
2007-01-22 11:34:53,051 INFO mapred.LocalJobRunner - 1 pages, 0
errors, 1.0 pages/s, 20 kb/s,
2007-01-22 11:34:53,134 WARN mapred.LocalJobRunner - job_yzavye
java.lang.NoSuchMethodError: org.apache.hadoop.io.MapFile
$Writer.<init>(Lorg/apache/hadoop/fs/FileSystem;Ljava/lang/
String;Ljava/lang/Class;Ljava/lang/Class;)V
at
org.apache.nutch.fetcher.FetcherOutputFormat.getRecordWriter
(FetcherOutputFormat.java:58)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:303)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run
(LocalJobRunner.java:137)
2007-01-22 11:34:53,398 FATAL fetcher.Fetcher - Fetcher:
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:
441)
at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:470)
at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:505)
at org.apache.hadoop.util.ToolBase.doMain(ToolBase.java:189)
at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:477)
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers
