Rework job-setup and job-cleanup tasks
--------------------------------------
Key: HADOOP-4421
URL: https://issues.apache.org/jira/browse/HADOOP-4421
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.19.0
Reporter: Arun C Murthy
Fix For: 0.20.0
Currently we have a notion of map-{setup|cleanup} TIP and
reduce-{setup|cleanup} TIP of which only 1 setup and cleanup tasks are picked
by the JobInProgress. Also a lot of state-maintenence of these TIPs are done by
the JobInProgress itself, outside of the more logical place i.e. TaskInProgress.
We really should rework this to have a single setup and cleanup task which
isn't associated with a map or reduce task i.e. into separate task _types_.
What we have currently is quite ungainly and hard to maintain.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
