Sean Dean wrote:
Sorry for not including that, this is the final output from the hadoop.log
file on the reduce stage:
Hmm, are you sure you don't have any older version of hadoop*.jar on
your classpath? This looks very suspicious:
2006-12-14 03:43:10,698 WARN mapred.LocalJobRunner - job_xv8awo
java.lang.NoSuchMethodError:
org.apache.hadoop.io.MapFile$Writer.<init>(Lorg/apache/hadoop/conf/Configura
tion;Lorg/apache/had
oop/fs/FileSystem;Ljava/lang/String;Ljava/lang/Class;Ljava/lang/Class;)V
at
org.apache.nutch.parse.ParseOutputFormat.getRecordWriter(ParseOutputFormat.j
ava:74)
The issue is that this constructor, MapFile.Writer(Configuration,
FileSystem, String, Class, Class) is present only in Hadoop 0.9, but it
wasn't present before ...
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
