Job directories could remain undeleted in some scenarios after job completes.
-----------------------------------------------------------------------------
Key: HADOOP-5248
URL: https://issues.apache.org/jira/browse/HADOOP-5248
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Hemanth Yamijala
I observed a couple of times that when a job has completed, its job directories
were not cleaned up. In discussion, it seems like there is a condition when
only reduces from a job are run on a machine and no maps, the TT does not get a
signal from the JT to delete the files and could be left behind. FYI, JVM reuse
was enabled at the time. I can confirm that 'KillJobAction' was not received by
the TT.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.