[
https://issues.apache.org/jira/browse/MAPREDUCE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13070295#comment-13070295
]
Mahadev konar commented on MAPREDUCE-2589:
------------------------------------------
Sherry,
Sorry I looked at it again and I think its good if we make the
DEFAULT_USER_LOG_RETAIN_MAX_HOURS configurable. Also, -1 should disable the
feature. I think its important to be able to switch off misbehaving
configuration.
Also, why do we need a call to get jobs that are still running? I thought the
call was made only on restart/reinit? We should be able to clean old user logs
without calling jc.jobstocomplete? I think we should avoid adding a dependency
on calling jobtracker client methods in the tasktracker itself. what do you
think?
> TaskTracker not purging userlog directories
> -------------------------------------------
>
> Key: MAPREDUCE-2589
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2589
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.205.0
> Environment: 0.20.205
> Reporter: Sherry Chen
> Assignee: Sherry Chen
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2589.patch, MAPREDUCE-2589_1.patch,
> cleanup_userlogs.py
>
>
> UserLogCleaner is not robust. Leftover userlogs after a restart sometimes
> have to be manually
> cleaned. Things can accumulate over a period of time.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
