[ 
https://issues.apache.org/jira/browse/MAPREDUCE-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13412408#comment-13412408
 ] 

Patrick Wendell commented on MAPREDUCE-3451:
--------------------------------------------

So I spent some time offline talking with Tom and I think we're ready to move 
forward with committing this to MR2. The primary goals are:

1) Let people who use the MR1 fair scheduler have a drop in equivalent for MR2
- and -
2) Keep as much code shared as possible between MR2 schedulers given that the 
overlap in substantial functionality

I think we're clearly accomplishing (1) and well on our way to (2), but 
subsequent patches might find more opportunity for code re-use.

This also doesn't include some necessities like the Web UI and some 
nice-to-have extensions like hierarchical queues. That said I'd like to get 
this committed as a starting point build from there, given that it's already a 
pretty large commit.
                
> Port Fair Scheduler to MR2
> --------------------------
>
>                 Key: MAPREDUCE-3451
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3451
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: mrv2, scheduler
>            Reporter: Patrick Wendell
>            Assignee: Patrick Wendell
>         Attachments: MAPREDUCE-3451.v1.patch.txt, 
> MAPREDUCE-3451.v2.patch.txt, MAPREDUCE-3451.v3.patch.txt, 
> MAPREDUCE-3451.v4.patch.txt, MAPREDUCE-3451.v5.patch, 
> MAPREDUCE-3451.v6.patch, MAPREDUCE-3451.v7.patch
>
>
> The Fair Scheduler is in widespread use today in MR1 clusters, but not yet 
> ported to MR2. This is to track the porting of the Fair Scheduler to MR2 and 
> will be updated to include design considerations and progress.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to