[
https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla updated YARN-4661:
-----------------------------------
Issue Type: Sub-task (was: Wish)
Parent: YARN-4752
> Per-queue preemption policy in FairScheduler
> --------------------------------------------
>
> Key: YARN-4661
> URL: https://issues.apache.org/jira/browse/YARN-4661
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: fairscheduler
> Affects Versions: 2.6.0
> Reporter: He Tianyi
> Priority: Minor
>
> When {{FairScheduler}} needs to preempt container, it tries to find a
> container by hierachically sorting and selecting {{AppSchedulable}} with most
> 'over fairshare' (in {{FairSharePolicy}}), and pick its latest launched
> container.
> In some case, strategy above become non-optimal, one may want to kill latest
> container (not {{AppSchedulable}}) launched in the queue for better trade-off
> between fairness and efficiency. Since most app with over fairshare tend to
> be started longer ago than other apps, perhaps even its latent launch
> container is running quite some time.
> Maybe besides {{policy}}, we make it possible to also specify a
> {{preemptionPolicy}} only for selecting container to preempt, without
> changing scheduling policy.
> For example:
> {quote}
> <queue name="queueA">
> <preemptionPolicy>fifo</preemptionPolicy>
> <policy>fair</policy>
> </queue>
> {quote}
> Any suggestions or comments?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
