Streaming map task is not failed when the subprocess exited abnormally.
-----------------------------------------------------------------------
Key: HADOOP-2941
URL: https://issues.apache.org/jira/browse/HADOOP-2941
Project: Hadoop Core
Issue Type: Bug
Components: contrib/streaming
Reporter: Amareshwari Sriramadasu
Fix For: 0.17.0
The launched streaming process exited with a non-zero exit code. But the task
was succesful. thereby, job was succesful.
Job tracker logs show:
08/03/05 14:30:43 INFO mapred.TaskTracker: Task
task_200803051430_0001_m_000000_1 is done.
08/03/05 14:30:43 INFO mapred.TaskRunner: Saved output of task
'task_200803051430_0001_m_000000_1' to hdfs://localhost:46796/testing/out
08/03/05 14:30:43 INFO mapred.JobInProgress: Task
'task_200803051430_0001_m_000000_1' has completed
tip_200803051430_0001_m_000000 successfully.
But the syslog of the task has :
2008-03-05 14:30:43,174 INFO org.apache.hadoop.streaming.PipeMapRed:
PipeMapRed.waitOutputThreads(): subprocess failed with code 1 in
org.apache.hadoop.streaming.PipeMapRed
We could not know whether the job was successful or not, until we validate the
output and found that there is no output.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
