[
https://issues.apache.org/jira/browse/HADOOP-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12671040#action_12671040
]
Amar Kamat commented on HADOOP-5067:
------------------------------------
Looks like the problem is with
{code}
boolean isPresent = this.activeTasks.remove(taskid) != null;
{code}
This check is made to avoid wrong/incorrect updates for stray attempts
(attempts for which there is no entry in the jobhistory). Consider a case where
the attempt _start_ and _end_ lines are still in buffer when the jobtracker
dies. In such a case the reducers might get the map completion event but the
restarted jobtracker might not know about the attempt. So ideally any complaint
about this map attempt should be ignored as the map will be re-executed. The
idea was to update only if the {{TaskInProgress}} knows about the attempt. May
be we should use {{tasks.keySet().contains()}} instead of
{{activeTasks.remove()}}. Thoughts?
> Failed/Killed attempts column in jobdetails.jsp does not show the number of
> failed/killed attempts correctly
> ------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-5067
> URL: https://issues.apache.org/jira/browse/HADOOP-5067
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Amareshwari Sriramadasu
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.19.1, 0.20.0, 0.21.0
>
>
> I see one of the task failures when i see it from the taskdetails.jsp page,
> but failed/killed attempts column show it as zero.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
