Chang Li created MAPREDUCE-6512:
-----------------------------------
Summary: FileOutputCommitter tasks unconditionally create parent
directories
Key: MAPREDUCE-6512
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6512
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Chang Li
Assignee: Chang Li
If the output directory is deleted then subsequent tasks should fail. Instead
they blindly create the missing parent directories, leading the job to be
"succesful" despite potentially missing almost all of the output. Task attempts
should fail if the parent app attempt directory is missing when they go to
create their task attempt directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)