[ 
https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei Yan updated YARN-2395:
--------------------------

    Attachment: YARN-2395-1.patch

Discussed with Karthik offline. We agree on the solution that each queue can 
specify its own fairSharePreemptionTimeout. If not specified, the queue will 
inherits the value from its parent queue.

Another issue here: I removed the old "defaultFairSharePreemptionTimeout" and 
added a new one "rootFairSharePreemptionTimeout", which configures the timeout 
value for the root queue. I didn't use the name 
"defaultFairSharePreemptionTimeout" as it may confuse users that the queue will 
use this value if not configure, which is not true and the queue will take 
value from its parent queue.

> Fair Scheduler : implement fair share preemption at parent queue based on 
> fairSharePreemptionTimeout
> ----------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2395
>                 URL: https://issues.apache.org/jira/browse/YARN-2395
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: fairscheduler
>            Reporter: Ashwin Shankar
>            Assignee: Wei Yan
>         Attachments: YARN-2395-1.patch
>
>
> Currently in fair scheduler, the preemption logic considers fair share 
> starvation only at leaf queue level. This jira is created to implement it at 
> the parent queue as well.
> It involves :
> 1. Making "check for fair share starvation" and "amount of resource to 
> preempt"  recursive such that they traverse the queue hierarchy from root to 
> leaf.
> 2. Currently fairSharePreemptionTimeout is a global config. We could make it 
> configurable on a per queue basis,so that we can specify different timeouts 
> for parent queues.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to