Benjamin Teke created YARN-10505:
------------------------------------
Summary: Extend the maximum-capacity property to react to weight
mode changes
Key: YARN-10505
URL: https://issues.apache.org/jira/browse/YARN-10505
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Benjamin Teke
The property root.users.maximum-capacity could mean the following things:
* Relative Percentage: maximum capacity relative to its parent. If it’s set to
50, then it means that the capacity is capped with respect to the parent.
* Absolute Percentage: maximum capacity expressed as a percentage of the
overall cluster capacity.
* Percentages of different resource types: this would refer to vCores, memory,
GPU, etc... Similarly to the single percentage value, this could either mean
percentage of the parent or percentage of the overall cluster resource.
* Absolute limit: explicit definition of vCores and memory like vcores=20,
memory-mb=16384.
Note that Fair Scheduler supports the following settings:
* Single percentage (absolute)
* Two percentages (absolute)
* Absolute resources
It is recommended that all three formats are supported for maximum-capacity
after introducing weight mode. The final form of the configuration for example
could look like this:
root.users.maximum-capacity = 100% - single percentage
root.users.maximum-capacity = (vcores=100%, memory-mb=100%) - two percentages
root.users.maximum-capacity = (vcores=10, memory-mb=10000mb) - absolute
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
