Nathan Roberts created YARN-4963:
------------------------------------
Summary: capacity scheduler: Make number of OFF_SWITCH assignments
per heartbeat configurable
Key: YARN-4963
URL: https://issues.apache.org/jira/browse/YARN-4963
Project: Hadoop YARN
Issue Type: Improvement
Components: capacityscheduler
Affects Versions: 2.7.2, 3.0.0
Reporter: Nathan Roberts
Assignee: Nathan Roberts
Currently the capacity scheduler will allow exactly 1 OFF_SWITCH assignment per
heartbeat. With more and more non MapReduce workloads coming along, the degree
of locality is declining, causing scheduling to be significantly slower. It's
still important to limit the number of OFF_SWITCH assignments to avoid densely
packing OFF_SWITCH containers onto nodes.
Proposal is to add a simple config that makes the number of OFF_SWITCH
assignments configurable.
Will upload candidate patch shortly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
