Vinod Kumar Vavilapalli created YARN-3306:

             Summary: [Umbrella] Proposing per-queue Policy driven scheduling 
                 Key: YARN-3306
             Project: Hadoop YARN
          Issue Type: Bug
          Components: scheduler
            Reporter: Vinod Kumar Vavilapalli
            Assignee: Vinod Kumar Vavilapalli

Scheduling layout in Apache Hadoop YARN today is very coarse grained. This 
proposal aims at converting today’s rigid scheduling in YARN to a per­-queue 
policy driven architecture.

We propose the creation of a c​ommon policy framework​ and implement a​common 
set of policies​ that administrators can pick and chose per queue
 - Make scheduling policies configurable per queue
 - Initially, we limit ourselves to a new type of scheduling policy that 
determines the ordering of applications within the l​eaf ­queue
 - In the near future, we will also pursue parent­ queue level policies and 
potential algorithm reuse through a separate type of policies that control 
resource limits per queue, user, application etc.

This message was sent by Atlassian JIRA

Reply via email to