Karthik Kambatla commented on YARN-2395:

I think I now get Ashwin's point. Ashwin - please correct me if I am wrong.

If the parent queue has a timeout of 5 seconds and all the child queues have a 
timeout of 30 seconds, any preemption under the parent queue kicks in only 
after 30 seconds and not 5 seconds. 

I am not sure we can really do much in this case. It can be a case of 
misconfiguration that we might want to warn. But again, if a leaf queue were to 
be created under, that would inherit these timeouts. 

> FairScheduler: Preemption timeout should be configurable per queue
> ------------------------------------------------------------------
>                 Key: YARN-2395
>                 URL: https://issues.apache.org/jira/browse/YARN-2395
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: fairscheduler
>            Reporter: Ashwin Shankar
>            Assignee: Wei Yan
>         Attachments: YARN-2395-1.patch, YARN-2395-2.patch, YARN-2395-3.patch, 
> YARN-2395-3.patch
> Currently in fair scheduler, the preemption logic considers fair share 
> starvation only at leaf queue level. This jira is created to implement it at 
> the parent queue as well.
> It involves :
> 1. Making "check for fair share starvation" and "amount of resource to 
> preempt"  recursive such that they traverse the queue hierarchy from root to 
> leaf.
> 2. Currently fairSharePreemptionTimeout is a global config. We could make it 
> configurable on a per queue basis,so that we can specify different timeouts 
> for parent queues.

This message was sent by Atlassian JIRA

Reply via email to