o.a.h.mapreduce.FileOutputCommitter doens't check for existence of
${mapred.output.dir}/_temporary
--------------------------------------------------------------------------------------------------
Key: MAPREDUCE-1841
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1841
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Affects Versions: 0.20.2
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Fix For: 0.22.0
o.a.h.mapred.FileOutputCommitter.getWorkOutputPath checks for existence of
${mapred.output.dir}/_temporary to ensure tasks launched _after_ the
job-cleanup task fail early (in a vast majority of cases). This check is
missing in the mapreduce libraries.
Related note: FileOutputCommitter.setupTask seems a more appropriate place for
the above check...
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
