[
https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Lowe updated MAPREDUCE-5124:
----------------------------------
Attachment: MAPREDUCE-5124-branch-2.8.001.patch
Manually kicking the Jenkins build worked. Not sure what happened yesterday.
The javac warning is relevant. The patch removed the suppress directive for
this.
The 2.9 patch is the same as the branch-2 patch, and given those branches are
super close I don't see the need to run Jenkins just for that.
I'm posting the 2.8 patch again to trigger Jenkins to run on branch-2.8. The
same javac warning will be there, but it will be good to see if there's
anything else it finds.
> AM lacks flow control for task events
> -------------------------------------
>
> Key: MAPREDUCE-5124
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5124
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mr-am
> Affects Versions: 2.0.3-alpha, 0.23.5
> Reporter: Jason Lowe
> Assignee: Peter Bacsko
> Attachments: MAPREDUCE-5124-001.patch, MAPREDUCE-5124-002.patch,
> MAPREDUCE-5124-003.patch, MAPREDUCE-5124-CoalescingPOC-1.patch,
> MAPREDUCE-5124-CoalescingPOC2.patch, MAPREDUCE-5124-CoalescingPOC3.patch,
> MAPREDUCE-5124-branch-2.001.patch, MAPREDUCE-5124-branch-2.7.001.patch,
> MAPREDUCE-5124-branch-2.8.001.patch, MAPREDUCE-5124-branch-2.8.001.patch,
> MAPREDUCE-5124-branch-2.9.001.patch, MAPREDUCE-5124-proto.2.txt,
> MAPREDUCE-5124-prototype.txt
>
>
> The AM does not have any flow control to limit the incoming rate of events
> from tasks. If the AM is unable to keep pace with the rate of incoming
> events for a sufficient period of time then it will eventually exhaust the
> heap and crash. MAPREDUCE-5043 addressed a major bottleneck for event
> processing, but the AM could still get behind if it's starved for CPU and/or
> handling a very large job with tens of thousands of active tasks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
