[ 
https://issues.apache.org/jira/browse/MAPREDUCE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067516#comment-13067516
 ] 

Devaraj K commented on MAPREDUCE-2589:
--------------------------------------

One improvement can be done in the patch, now for every file in the user log 
directory it is getting the jobs which are to be completed every time and 
checking. Instead of this it can get the jobs list once and can check for all 
the files in the user log directory whether it belongs to running job or not.

> TaskTracker not purging userlog directories
> -------------------------------------------
>
>                 Key: MAPREDUCE-2589
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2589
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: tasktracker
>    Affects Versions: 0.20.205.0
>         Environment: 0.20.205
>            Reporter: Sherry Chen
>            Assignee: Sherry Chen
>            Priority: Minor
>             Fix For: 0.20.205.0
>
>         Attachments: MAPREDUCE-2589.patch, cleanup_userlogs.py
>
>
> UserLogCleaner is not robust. Leftover userlogs after a restart sometimes 
> have to be manually
> cleaned. Things can accumulate over a period of time.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to