The temp folder _temporary (created as part of job execution) is not getting deleted from HDFS if the job fails because of jobs cleanup task failure

[Ramgopal]

Hi all ,

 

I am executing a wordcount job. When all the map and reduce tasks are
completed ,the cleanup task is launched.

 

If the cleanup task fails, job also gets failed. 

 

As the mappers and reducers got executed successfully , the output files are
getting created.

 

But the output folder contains the temporary file /output/_temporary and
this will not be removed.

 

 

Here the framework should take care of cleaning the temporary files or
application should handle it ?

 

 

Regards,

Ramgopal