Ashwin Shankar commented on YARN-2395:

I felt having timeout per queue would give more flexibility.
Just as an example : 
For a high priority queue with production jobs, we may want to give very high 
threshold and very small timeout.
For a medium priority queue, we may still want a high threshold but would like 
to wait sometime before preempting
from a production queue.
I know this adds to the complexity, but it seemed useful to me.
Thoughts ?  

> Fair Scheduler : implement fair share preemption at parent queue based on 
> fairSharePreemptionTimeout
> ----------------------------------------------------------------------------------------------------
>                 Key: YARN-2395
>                 URL: https://issues.apache.org/jira/browse/YARN-2395
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: fairscheduler
>            Reporter: Ashwin Shankar
> Currently in fair scheduler, the preemption logic considers fair share 
> starvation only at leaf queue level. This jira is created to implement it at 
> the parent queue as well.
> It involves :
> 1. Making "check for fair share starvation" and "amount of resource to 
> preempt"  recursive such that they traverse the queue hierarchy from root to 
> leaf.
> 2. Currently fairSharePreemptionTimeout is a global config. We could make it 
> configurable on a per queue basis,so that we can specify different timeouts 
> for parent queues.

This message was sent by Atlassian JIRA

Reply via email to