Hadoop is not supported on windows xp Use linux -----Original Message----- From: ws_dev2001 [mailto:[email protected]] Sent: 29 августа 2011 г. 10:13 To: [email protected] Subject: Map-reduce sample code not working for hadoop streaming
Hi, I am trying to run the following code sample: http://pages.cs.brandeis.edu/~cs147a/lab/hadoop-example/ I am on Windows XP, Cygwin and am using hadoop-0.20.2. I am getting stuck on an error while running the hadoop streaming sample on this page. Please let me know if I need to supply further information. hadoop@ ~ $ /usr/local/hadoop-0.20.2/bin/hadoop jar E:/Tools/cygwin/usr/local/hadoop-0.20.2/contrib/streaming/hadoop-0.20.2-streaming.jar -mapper python multifetch-mapper.py -file /tmp/multifetch-mapper.py -reducer python multifetch-reducer.py -file /tmp/multifetch-reducer.py -input urls/* -output titles packageJobJar: [/tmp/multifetch-mapper.py, /tmp/multifetch-reducer.py, /E:/tmp/hadoop/hadoop-unjar9032604726399647405/] [] C:\Documents and Settings\hadoop\streamjob1540735851960870565.jar tmpDir=null 11/08/29 16:22:34 INFO mapred.FileInputFormat: Total input paths to process : 2 11/08/29 16:22:34 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop/mapred/local] 11/08/29 16:22:34 INFO streaming.StreamJob: Running job: job_201108261641_0042 11/08/29 16:22:34 INFO streaming.StreamJob: To kill this job, run: 11/08/29 16:22:34 INFO streaming.StreamJob: E:\Tools\cygwin\usr\local\hadoop-0.20.2\/bin/hadoop job -Dmapred.job.tracker=localhost:9002 -kill job_201108261641_0042 11/08/29 16:22:34 INFO streaming.StreamJob: Tracking URL: http://localhost:50030 /jobdetails.jsp?jobid=job_201108261641_0042 11/08/29 16:22:35 INFO streaming.StreamJob: map 0% reduce 0% 11/08/29 16:22:53 INFO streaming.StreamJob: map 50% reduce 0% 11/08/29 16:23:04 INFO streaming.StreamJob: map 100% reduce 0% 11/08/29 16:49:17 INFO streaming.StreamJob: map 50% reduce 0% 11/08/29 16:49:23 INFO streaming.StreamJob: map 100% reduce 0% 11/08/29 18:48:28 INFO streaming.StreamJob: map 50% reduce 0% 11/08/29 18:48:52 INFO streaming.StreamJob: map 100% reduce 0% 11/08/29 18:48:55 INFO streaming.StreamJob: map 50% reduce 0% 11/08/29 18:48:58 INFO streaming.StreamJob: map 100% reduce 0% 11/08/29 18:49:01 INFO streaming.StreamJob: map 100% reduce 17% 11/08/29 18:49:07 INFO streaming.StreamJob: map 100% reduce 0% 11/08/29 18:49:16 INFO streaming.StreamJob: map 100% reduce 17% 11/08/29 18:49:22 INFO streaming.StreamJob: map 100% reduce 0% 11/08/29 18:52:43 INFO streaming.StreamJob: map 100% reduce 100% 11/08/29 18:52:43 INFO streaming.StreamJob: To kill this job, run: 11/08/29 18:52:43 INFO streaming.StreamJob: E:\Tools\cygwin\usr\local\hadoop-0.20.2\/bin/hadoop job -Dmapred.job.tracker=localhost:9002 -kill job_201108261641_0042 11/08/29 18:52:43 INFO streaming.StreamJob: Tracking URL: http://localhost:50030 /jobdetails.jsp?jobid=job_201108261641_0042 11/08/29 18:52:43 ERROR streaming.StreamJob: Job not Successful! 11/08/29 18:52:43 INFO streaming.StreamJob: killJob... Streaming Job Failed! Please help me out on this. TIA, R2D2. -- View this message in context: http://old.nabble.com/Map-reduce-sample-code-not-working-for-hadoop-streaming-tp32357180p32357180.html Sent from the Hadoop core-user mailing list archive at Nabble.com.
