Hiya All,
I'm trying to set up Nutch (well Nutchwax actually but that's another
story) and I run into the following problem:
2007-03-07 14:52:15,287 INFO org.apache.hadoop.fs.DFSClient: Could not
obtain block from any node: java.io.IOException: No live nodes contain
current block
This occurs on one of the datanodes only (not the namenode) in the
tasktracker log.
I've got two machines for the moment: wap300 and wap400. Wap400 is set
up as the namenode and the jobtracker. I can run everything fine only on
wap400 (using the dfs) and the same for running everything on wap300. As
soon as I try to use both machines I get this problem.
The console output shows the progress for the first job (import):
07/03/07 14:50:00 INFO mapred.JobClient: Running job: job_0001
07/03/07 14:50:01 INFO mapred.JobClient: map 0% reduce 0%
07/03/07 14:50:05 INFO mapred.JobClient: map 20% reduce 0%
07/03/07 14:50:07 INFO mapred.JobClient: map 30% reduce 0%
07/03/07 14:50:09 INFO mapred.JobClient: map 46% reduce 0%
07/03/07 14:50:11 INFO mapred.JobClient: map 56% reduce 0%
07/03/07 14:50:13 INFO mapred.JobClient: map 66% reduce 0%
07/03/07 14:50:14 INFO mapred.JobClient: map 80% reduce 0%
07/03/07 14:50:16 INFO mapred.JobClient: map 90% reduce 0%
07/03/07 14:50:24 INFO mapred.JobClient: map 90% reduce 2%
07/03/07 14:50:26 INFO mapred.JobClient: map 90% reduce 3%
07/03/07 14:50:34 INFO mapred.JobClient: map 90% reduce 6%
07/03/07 14:50:36 INFO mapred.JobClient: map 90% reduce 7%
07/03/07 14:50:44 INFO mapred.JobClient: map 90% reduce 11%
07/03/07 14:50:46 INFO mapred.JobClient: map 90% reduce 12%
07/03/07 14:50:54 INFO mapred.JobClient: map 90% reduce 15%
07/03/07 14:50:56 INFO mapred.JobClient: map 90% reduce 16%
07/03/07 14:51:04 INFO mapred.JobClient: map 90% reduce 20%
This hangs there for about twelve minutes and then carries on eventually
completing in about 15 minutes. On the other machine I get the error
message every 3 seconds. Running the same job on one machine takes under
three minutes.
Any ideas? I've tried google searches and searching this list but no
joy.
Thanks in advance,
Jack
Jackson Pope
Technical Lead
Web Archiving Programme
The British Library
+44 (0) 1937 546942
**************************************************************************
Experience the British Library online at www.bl.uk
Help the British Library conserve the world's knowledge. Adopt a Book.
www.bl.uk/adoptabook
The Library's St Pancras site is WiFi - enabled
*************************************************************************
The information contained in this e-mail is confidential and may be legally
privileged. It is intended for the addressee(s) only. If you are not the
intended recipient, please delete this e-mail and notify the [EMAIL PROTECTED]
: The contents of this e-mail must not be disclosed or copied without the
sender's consent.
The statements and opinions expressed in this message are those of the author
and do not necessarily reflect those of the British Library. The British
Library does not take any responsibility for the views of the author.
*************************************************************************
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers
