Hiya All,
I'm trying to set up Nutch (well Nutchwax actually but that's another story) and I run into the following problem: 2007-03-07 14:52:15,287 INFO org.apache.hadoop.fs.DFSClient: Could not obtain block from any node: java.io.IOException: No live nodes contain current block This occurs on one of the datanodes only (not the namenode) in the tasktracker log. I've got two machines for the moment: wap300 and wap400. Wap400 is set up as the namenode and the jobtracker. I can run everything fine only on wap400 (using the dfs) and the same for running everything on wap300. As soon as I try to use both machines I get this problem. The console output shows the progress for the first job (import): 07/03/07 14:50:00 INFO mapred.JobClient: Running job: job_0001 07/03/07 14:50:01 INFO mapred.JobClient: map 0% reduce 0% 07/03/07 14:50:05 INFO mapred.JobClient: map 20% reduce 0% 07/03/07 14:50:07 INFO mapred.JobClient: map 30% reduce 0% 07/03/07 14:50:09 INFO mapred.JobClient: map 46% reduce 0% 07/03/07 14:50:11 INFO mapred.JobClient: map 56% reduce 0% 07/03/07 14:50:13 INFO mapred.JobClient: map 66% reduce 0% 07/03/07 14:50:14 INFO mapred.JobClient: map 80% reduce 0% 07/03/07 14:50:16 INFO mapred.JobClient: map 90% reduce 0% 07/03/07 14:50:24 INFO mapred.JobClient: map 90% reduce 2% 07/03/07 14:50:26 INFO mapred.JobClient: map 90% reduce 3% 07/03/07 14:50:34 INFO mapred.JobClient: map 90% reduce 6% 07/03/07 14:50:36 INFO mapred.JobClient: map 90% reduce 7% 07/03/07 14:50:44 INFO mapred.JobClient: map 90% reduce 11% 07/03/07 14:50:46 INFO mapred.JobClient: map 90% reduce 12% 07/03/07 14:50:54 INFO mapred.JobClient: map 90% reduce 15% 07/03/07 14:50:56 INFO mapred.JobClient: map 90% reduce 16% 07/03/07 14:51:04 INFO mapred.JobClient: map 90% reduce 20% This hangs there for about twelve minutes and then carries on eventually completing in about 15 minutes. On the other machine I get the error message every 3 seconds. Running the same job on one machine takes under three minutes. Any ideas? I've tried google searches and searching this list but no joy. Thanks in advance, Jack Jackson Pope Technical Lead Web Archiving Programme The British Library +44 (0) 1937 546942 ************************************************************************** Experience the British Library online at www.bl.uk Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook The Library's St Pancras site is WiFi - enabled ************************************************************************* The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the [EMAIL PROTECTED] : The contents of this e-mail must not be disclosed or copied without the sender's consent. The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author. *************************************************************************
