[
https://issues.apache.org/jira/browse/MAPREDUCE-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13412408#comment-13412408
]
Patrick Wendell commented on MAPREDUCE-3451:
--------------------------------------------
So I spent some time offline talking with Tom and I think we're ready to move
forward with committing this to MR2. The primary goals are:
1) Let people who use the MR1 fair scheduler have a drop in equivalent for MR2
- and -
2) Keep as much code shared as possible between MR2 schedulers given that the
overlap in substantial functionality
I think we're clearly accomplishing (1) and well on our way to (2), but
subsequent patches might find more opportunity for code re-use.
This also doesn't include some necessities like the Web UI and some
nice-to-have extensions like hierarchical queues. That said I'd like to get
this committed as a starting point build from there, given that it's already a
pretty large commit.
> Port Fair Scheduler to MR2
> --------------------------
>
> Key: MAPREDUCE-3451
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3451
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: mrv2, scheduler
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Attachments: MAPREDUCE-3451.v1.patch.txt,
> MAPREDUCE-3451.v2.patch.txt, MAPREDUCE-3451.v3.patch.txt,
> MAPREDUCE-3451.v4.patch.txt, MAPREDUCE-3451.v5.patch,
> MAPREDUCE-3451.v6.patch, MAPREDUCE-3451.v7.patch
>
>
> The Fair Scheduler is in widespread use today in MR1 clusters, but not yet
> ported to MR2. This is to track the porting of the Fair Scheduler to MR2 and
> will be updated to include design considerations and progress.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira