I'm pretty sure there wasn't, as I don't have any older hadoop*.jar files in the classpath. The only thing that comes to mind is if an older hadoop file, which would most likely be hadoop-0.7.1.jar was loaded into memory before it was deleted/replaced with hadoop-0.9.1.jar. To make certain, I have also started another fetch, using the latest trunk and same segment on another system with no previous nutch builds, so its all fresh. This should take <24 hours to complete, and when its done I will report back with its status and any further details if available.
----- Original Message ---- From: Andrzej Bialecki <[EMAIL PROTECTED]> To: [email protected] Sent: Thursday, December 14, 2006 6:18:02 AM Subject: Re: error with trunk: linkdb copied to wrong dir Sean Dean wrote: > Sorry for not including that, this is the final output from the hadoop.log > file on the reduce stage: > Hmm, are you sure you don't have any older version of hadoop*.jar on your classpath? This looks very suspicious: > 2006-12-14 03:43:10,698 WARN mapred.LocalJobRunner - job_xv8awo > java.lang.NoSuchMethodError: > org.apache.hadoop.io.MapFile$Writer.<init>(Lorg/apache/hadoop/conf/Configura > tion;Lorg/apache/had > oop/fs/FileSystem;Ljava/lang/String;Ljava/lang/Class;Ljava/lang/Class;)V > at > org.apache.nutch.parse.ParseOutputFormat.getRecordWriter(ParseOutputFormat.j > ava:74) > The issue is that this constructor, MapFile.Writer(Configuration, FileSystem, String, Class, Class) is present only in Hadoop 0.9, but it wasn't present before ... -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com
