[
https://issues.apache.org/jira/browse/MAPREDUCE-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15533237#comment-15533237
]
Haibo Chen commented on MAPREDUCE-6771:
---------------------------------------
Thanks for your reviews Jason!
> RMContainerAllocator sends container diagnostics event after corresponding
> completion event
> -------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-6771
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6771
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.7.3
> Reporter: Haibo Chen
> Assignee: Haibo Chen
> Fix For: 2.8.0, 2.7.4, 3.0.0-alpha2
>
> Attachments: TaUnsuccessfullyEventEmission.jpg,
> mapreduce6771.001.patch, mapreduce6771.002.patch, mapreduce6771.003.patch,
> mapreduce6771.004.patch, mapreduce6771.branch-2.8.patch
>
>
> Task containers can go over their resource limit, and killed by Node Manager.
> Then MR AM gets notified of the container status and diagnostics information
> through its heartbeat with RM. However, it is possible that the diagnostics
> information never gets into .jhist file, so when the job completes, the
> diagnostics information associated with the failed task attempts is empty.
> This makes it hard for users to root cause job failures that are often caused
> by memory leak.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
