[
https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Lowe updated MAPREDUCE-5003:
----------------------------------
Status: Open (was: Patch Available)
Thanks for picking this up, [~lichangleo]!
This change will recover attempts for successful tasks where the attempt was
incomplete (which should be rare), but I don't see it recovering attempts for
failed tasks or tasks that were still in progress when the prior app attempt
died. Note that the code that was changed only executes if the prior task was
successful. As mentioned in the description, we'd like to recover info for all
tasks attempts that were running in the old app attempt, even if they belong to
tasks that failed, were killed, or didn't complete at all.
> AM recovery should recreate records for attempts that were incomplete
> ---------------------------------------------------------------------
>
> Key: MAPREDUCE-5003
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5003
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mr-am
> Reporter: Jason Lowe
> Assignee: Chang Li
> Attachments: MAPREDUCE-5003.1.patch, MAPREDUCE-5003.2.patch,
> MAPREDUCE-5003.3.patch
>
>
> As discussed in MAPREDUCE-4992, it would be nice if the AM recovered task
> attempt entries for *all* task attempts launched by the prior app attempt
> even if those task attempts did not complete. The attempts would have to be
> marked as killed or something similar to indicate it is no longer running.
> Having records for the task attempts enables the user to see what nodes were
> associated with the attempts and potentially access their logs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
