> From: Andrzej Bialecki [mailto:[EMAIL PROTECTED] > Sent: 2006-10-24 18:27
> There was a bug in some versions of 0.8, so that if you ran it with > "local" FS & jobtracker it would generate too many parts of the > fetchlist, and then process only one randomly selected part. > If that's > the case, and you are indeed running in "local" mode, try setting the > number of map and reduce tasks in your hadoop-site.xml to 1. Thank you for the information. I'm doing an intranet crawling using protocol-http. I guess you mean protocol-file by "local"? Or do you mean setting "local" for fs.defaul.name in hadoop-site.xml? Could you also explain what you mean by "setting the number of map" and how? -kuro
