Sandy Ryza created MAPREDUCE-5575:
-------------------------------------
Summary: History files deleted from the intermediate directory
never get removed from the JobListCache
Key: MAPREDUCE-5575
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5575
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobhistoryserver
Affects Versions: 2.2.0
Reporter: Sandy Ryza
The JobHistoryServer periodically scans through the intermediate directory. It
adds all files to the JobListCache. It deletes job files that are older than
the max age and moves all other files to the done directory. Later, when files
in the done directory become too old, they're deleted from the JobListCache.
Jobs that were deleted in the intermediate directory (and thus never moved to
the done directory) end up in the JobListCache but can never be deleted from it.
--
This message was sent by Atlassian JIRA
(v6.1#6144)