Panagiotis Garefalakis created HIVE-24914:
---------------------------------------------

             Summary: Improve scheduling by only traversing hosts with capacity
                 Key: HIVE-24914
                 URL: https://issues.apache.org/jira/browse/HIVE-24914
             Project: Hive
          Issue Type: Sub-task
            Reporter: Panagiotis Garefalakis
            Assignee: Panagiotis Garefalakis


*schedulePendingTasks* on the LlapTaskScheduler currently goes through all the 
pending tasks and tries to allocate them based on their Priority -- if a 
priority can not be scheduled completely, we bail out as lower priorities would 
not be able to get allocations either.

An optimization here could be to only walk through the nodes with capacity (if 
any) ,and not all available hosts, for scheduling these tasks based on their 
priority and locality preferences.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to