Capacity scheduler should account high memory jobs as using more capacity of
the queue
--------------------------------------------------------------------------------------
Key: HADOOP-5884
URL: https://issues.apache.org/jira/browse/HADOOP-5884
Project: Hadoop Core
Issue Type: Bug
Components: contrib/capacity-sched
Reporter: Hemanth Yamijala
Currently, when a high memory job is scheduled by the capacity scheduler, each
task scheduled counts only once in the capacity of the queue, though it may
actually be preventing other jobs from using spare slots on that node because
of its higher memory requirements. In order to be fair, the capacity scheduler
should proportionally (with respect to default memory) account high memory jobs
as using a larger capacity of the queue.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
