[
https://issues.apache.org/jira/browse/MAPREDUCE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Scott Chen updated MAPREDUCE-1198:
----------------------------------
Attachment: MAPREDUCE-1198-v4.patch
I have revised the code according to Matei's suggestions.
1. Initialize the rejection flags to true. So if the task is not found, it will
be mark as rejected
2. Change the counter to mapAssigned and reduceAssigned and move them in the
proper places
3. Move the initialization of the HashSet visited outside the loop to avoid
repeated initialization
4. Changes of the comments according to the suggestions.
> Alternatively schedule different types of tasks in fair share scheduler
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-1198
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1198
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/fair-share
> Affects Versions: 0.22.0
> Reporter: Scott Chen
> Assignee: Scott Chen
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1198-v1.patch, MAPREDUCE-1198-v2.patch,
> MAPREDUCE-1198-v3.patch, MAPREDUCE-1198-v4.patch
>
>
> Matei has mentioned in MAPREDUCE-961 that the current scheduler will first
> try to launch map tasks until canLaunthTask() returns false then look for
> reduce tasks. This might starve reduce task. He also mention that
> alternatively schedule different types of tasks can solve this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
