Chang Li created MAPREDUCE-6512:
-----------------------------------

             Summary: FileOutputCommitter tasks unconditionally create parent 
directories
                 Key: MAPREDUCE-6512
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6512
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Chang Li
            Assignee: Chang Li


If the output directory is deleted then subsequent tasks should fail. Instead 
they blindly create the missing parent directories, leading the job to be 
"succesful" despite potentially missing almost all of the output. Task attempts 
should fail if the parent app attempt directory is missing when they go to 
create their task attempt directory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to