[
https://issues.apache.org/jira/browse/YARN-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhaohui Xin reassigned YARN-8061:
---------------------------------
Assignee: Zhaohui Xin
> An application may preempt itself in case of minshare preemption
> ----------------------------------------------------------------
>
> Key: YARN-8061
> URL: https://issues.apache.org/jira/browse/YARN-8061
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
> Affects Versions: 2.9.0, 2.8.3, 3.0.0
> Reporter: Yufei Gu
> Assignee: Zhaohui Xin
> Priority: Major
>
> Assume a leaf queue A's minshare is 10G memory and fairshare is 12G. It used
> 4G, so its minshare-staved resources is 6G and will be distributed to all its
> apps. Assume there are 4 apps a1, a2, a3, a4 inside, who demand 3G, 2G, 1G,
> and 0.5G. a1 gets 3G minshare-starved resources, a2 gets 2G, a3 get 1G, they
> are all considered as starved apps except a4 who doesn't get any.
> An app can preempt another under the same queue due to minshare starvation.
> For example, a1 can preempt a4 if a4 uses more resources than its fair share,
> which is 3G(12G/4). If a1 itself used more than 3G memory, it will preempt
> itself! I will create a unit test later.
> The solution would check application's fair share while distributing minshare
> starvation, more details in method
> {{FSLeafQueue#updateStarvedAppsMinshare()}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
