Hi All , I am trying to run a simple steaming command as mentioned below . bin/hadoop jar /windows/Hadoop/hadoop-1.2.1/contrib/streaming/hadoop-streaming-1.2.1.jar -input /usr/pradeep/input/'Good words' -output /usr/pradeep/output mapper /bin/cat reducer /bin/wc -w
I am getting below as message in the error file packageJobJar: [/tmp/hadoop-root/hadoop-unjar3249316336279467583/] [] /tmp/streamjob1400561611088699684.jar tmpDir=null 13/08/27 23:55:54 INFO util.NativeCodeLoader: Loaded the native-hadoop library 13/08/27 23:55:54 WARN snappy.LoadSnappy: Snappy native library not loaded 13/08/27 23:55:54 INFO mapred.FileInputFormat: Total input paths to process : 1 13/08/27 23:55:55 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-root/mapred/local] 13/08/27 23:55:55 INFO streaming.StreamJob: Running job: job_201308272335_0004 13/08/27 23:55:55 INFO streaming.StreamJob: To kill this job, run: 13/08/27 23:55:55 INFO streaming.StreamJob: /windows/Hadoop/hadoop-1.2.1/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201308272335_0004 13/08/27 23:55:55 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201308272335_0004 13/08/27 23:55:56 INFO streaming.StreamJob: map 0% reduce 0% 13/08/27 23:56:21 INFO streaming.StreamJob: map 100% reduce 100% 13/08/27 23:56:21 INFO streaming.StreamJob: To kill this job, run: 13/08/27 23:56:21 INFO streaming.StreamJob: /windows/Hadoop/hadoop-1.2.1/libexec/../bin/hadoop job -Dmapred.job.tracker=localhost:9001 -kill job_201308272335_0004 13/08/27 23:56:21 INFO streaming.StreamJob: Tracking URL: http://localhost:50030/jobdetails.jsp?jobid=job_201308272335_0004 13/08/27 23:56:21 ERROR streaming.StreamJob: Job not successful. Error: JobCleanup Task Failure, Task: task_201308272335_0004_m_000002 13/08/27 23:56:21 INFO streaming.StreamJob: killJob... Streaming Command Failed! I checked the log and this is what i found : MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201308272335_0004_m_000002" TASK_ATTEMPT_ID="attempt_201308272335_0004_m_000002_0" TASK_STATUS="FAILED" FINISH_TIME="1377627971824" HOSTNAME="pradeep-pc" ERROR="java\.lang\.Throwable: Child Error at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:271) Caused by: java\.io\.IOException: Creation of symlink from /windows/Hadoop/hadoop-1\.2\.1/libexec/\.\./logs/userlogs/job_201308272335_0004/attempt_201308272335_0004_m_000002_0 to /tmp/hadoop-root/mapred/local/userlogs/job_201308272335_0004/attempt_201308272335_0004_m_000002_0 failed\. at org\.apache\.hadoop\.mapred\.TaskLog\.createTaskAttemptLogDir(TaskLog\.java:110) at org\.apache\.hadoop\.mapred\.DefaultTaskController\.createLogDir(DefaultTaskController\.java:71) at org\.apache\.hadoop\.mapred\.TaskRunner\.prepareLogFiles(TaskRunner\.java:316) at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:228) Cant understand the reason for such error .Everything seems to be fine .Would appreicate any help in this respect . Regards Pradeep Singh
