[
https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15591597#comment-15591597
]
Sunil G edited comment on YARN-2009 at 10/20/16 11:47 AM:
----------------------------------------------------------
I tested below case
{noformat}
String queuesConfig =
// guaranteed,max,used,pending,reserved
"root(=[100 100 55 170 0]);" + // root
"-a(=[40 100 10 50 0]);" + // a
"-b(=[60 100 45 120 0])"; // b
String appsConfig =
// queueName\t(priority,resource,host,expression,#repeat,reserved,pending)
"a\t" // app1 in a
+ "(1,1,n1,,5,false,25, user);" + // app1 a
"a\t" // app2 in a
+ "(2,1,n1,,5,false,25, user);" + // app2 a
"b\t" // app3 in b
+ "(4,1,n1,,40,false,20,user1);" + // app3 b
"b\t" // app1 in a
+ "(6,1,n1,,5,false,30,user2)";
verify(mDisp, times(16)).handle(argThat(
new TestProportionalCapacityPreemptionPolicy.IsPreemptionRequestFor(
getAppAttemptId(3))));
verify(mDisp, never()).handle(argThat(
new TestProportionalCapacityPreemptionPolicy.IsPreemptionRequestFor(
getAppAttemptId(4))));
{noformat}
Here queue 'b' has 3 users and 60% is the cap for this queue. So i am
considering 20GB for each user (33.33 userlimit).
Given 20GB, preemption is happening for 16GB considering 4GB is already running
for app3. But I am not seeing any extra preemption from same level app. May be
could u share some more details.
was (Author: sunilg):
I tested below case
{noformat}
String queuesConfig =
// guaranteed,max,used,pending,reserved
"root(=[100 100 55 170 0]);" + // root
"-a(=[40 100 10 50 0]);" + // a
"-b(=[60 100 45 120 0])"; // b
String appsConfig =
// queueName\t(priority,resource,host,expression,#repeat,reserved,pending)
"a\t" // app1 in a
+ "(1,1,n1,,5,false,25, user);" + // app1 a
"a\t" // app2 in a
+ "(2,1,n1,,5,false,25, user);" + // app2 a
"b\t" // app3 in b
+ "(4,1,n1,,40,false,20,user1);" + // app3 b
"b\t" // app1 in a
+ "(6,1,n1,,5,false,30,user2)";
{noformat}
Here queue 'b' has 3 users and 60% is the cap for this queue. So i am
considering 20GB for each user (33.33 userlimit).
Given 20GB, preemption is happening for 16GB considering 4GB is already running
for app3. But I am not seeing any extra preemption from same level app. May be
could u share some more details.
> Priority support for preemption in ProportionalCapacityPreemptionPolicy
> -----------------------------------------------------------------------
>
> Key: YARN-2009
> URL: https://issues.apache.org/jira/browse/YARN-2009
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: capacityscheduler
> Reporter: Devaraj K
> Assignee: Sunil G
> Attachments: YARN-2009.0001.patch, YARN-2009.0002.patch,
> YARN-2009.0003.patch, YARN-2009.0004.patch, YARN-2009.0005.patch,
> YARN-2009.0006.patch, YARN-2009.0007.patch, YARN-2009.0008.patch,
> YARN-2009.0009.patch, YARN-2009.0010.patch, YARN-2009.0011.patch
>
>
> While preempting containers based on the queue ideal assignment, we may need
> to consider preempting the low priority application containers first.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
