--- 09年9月11日，周五, qiu tian <[email protected]> 写道：
发件人: qiu tian <[email protected]> 主题: a problem in hadoop cluster:reduce task couldn't find map tasks' output. 收件人: [email protected], [email protected] 日期: 2009年9月11日,周五,下午1:57 Hi everyone! I tried hadoop cluster setup on 4 pcs. I ran into a problem about hadoop-common. when I ran the command'bin/hadoop jar hadoop-*-examples.jar wordcount input output', the map tasks could complet quickly, but the reduce phase took very long to complet. I think it's caused by the config, so I changed the hadoop-site.xml for many times, which didn't work. Here are hadoop-site.xml: namevaluedescriptionfs.default.namehdfs://192.*.*.*:9000 mapred.job.tracker 192.*.*.*:9001 hadoop.tmp.dir/home/*/hadoop/tmp here is another hadoop-site.xml: namevaluedescriptionfs.default.namehdfs://192.*.*.*:9000 mapred.job.tracker 192.*.*.*:9001 hadoop.tmp.dir/home/*/hadoop/tmp dfs.replication2 dfs.name.dir/home/*/hadoop/file/name dfs.data.dir/home/*/hadoop/file/data mapred.system.dir /home/*/hadoop/file/mapred/ system mapred.local.dir/home/*/hadoop/file/mapred/ local mapred.temp.dir /home/*/hadoop/file/mapred/tmp mapred.tasktracker.map.tasks. maximum2 mapred.tasktracker.reduce. tasks.maximum 2 Both of them above couldn't work. Here is a problem from a tasktracker: 2009-09-10 20:08:35,169 INFO org.apache.hadoop.mapred. TaskTracker: org.apache.hadoop.util. DiskChecker$ DiskErrorException: Could not find taskTracker/jobcache/job_ 200909102001_0001/attempt_ 200909102001_0001_m_000005_0/ output/file.out in any of the configured local directories I am looking forward to your reply! Thanks! Yan 好玩贺卡等你发，邮箱贺卡全新上线！ ___________________________________________________________ 好玩贺卡等你发，邮箱贺卡全新上线！ http://card.mail.cn.yahoo.com/
