[ https://issues.apache.org/jira/browse/MAPREDUCE-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739939#action_12739939 ]
Hadoop QA commented on MAPREDUCE-706: ------------------------------------- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12415552/mapreduce-706.v3.patch against trunk revision 800693. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 9 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/443/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/443/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/443/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-vesta.apache.org/443/console This message is automatically generated. > Support for FIFO pools in the fair scheduler > -------------------------------------------- > > Key: MAPREDUCE-706 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-706 > Project: Hadoop Map/Reduce > Issue Type: New Feature > Components: contrib/fair-share > Reporter: Matei Zaharia > Assignee: Matei Zaharia > Attachments: fsdesigndoc.pdf, fsdesigndoc.tex, mapreduce-706.patch, > mapreduce-706.v1.patch, mapreduce-706.v2.patch, mapreduce-706.v3.patch > > > The fair scheduler should support making the internal scheduling algorithm > for some pools be FIFO instead of fair sharing in order to work better for > batch workloads. FIFO pools will behave exactly like the current default > scheduler, sorting jobs by priority and then submission time. Pools will have > their scheduling algorithm set through the pools config file, and it will be > changeable at runtime. > To support this feature, I'm also changing the internal logic of the fair > scheduler to no longer use deficits. Instead, for fair sharing, we will > assign tasks to the job farthest below its share as a ratio of its share. > This is easier to combine with other scheduling algorithms and leads to a > more stable sharing situation, avoiding unfairness issues brought up in > MAPREDUCE-543 and MAPREDUCE-544 that happen when some jobs have long tasks. > The new preemption (MAPREDUCE-551) will ensure that critical jobs can gain > their fair share within a bounded amount of time. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.