YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/333ef303 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/333ef303 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/333ef303 Branch: refs/heads/HDFS-7240 Commit: 333ef303ff0caf9adfd378652a8f966377901768 Parents: 53509f2 Author: Wei Yan <[email protected]> Authored: Wed Nov 29 14:37:57 2017 -0800 Committer: Wei Yan <[email protected]> Committed: Wed Nov 29 14:38:07 2017 -0800 ---------------------------------------------------------------------- .../src/site/markdown/CapacityScheduler.md | 10 ++++++++++ 1 file changed, 10 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/333ef303/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ---------------------------------------------------------------------- diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md index 4754c94..0449e88 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md @@ -282,6 +282,16 @@ The `ReservationSystem` is integrated with the `CapacityScheduler` queue hierach |:---- |:---- | | `yarn.scheduler.capacity.node-locality-delay` | Number of missed scheduling opportunities after which the CapacityScheduler attempts to schedule rack-local containers. Typically, this should be set to number of nodes in the cluster. By default is setting approximately number of nodes in one rack which is 40. Positive integer value is expected. | + * Container Allocation per NodeManager Heartbeat + + The `CapacityScheduler` supports the following parameters to control how many containers can be allocated in each NodeManager heartbeat. + +| Property | Description | +|:---- |:---- | +| `yarn.scheduler.capacity.per-node-heartbeat.multiple-assignments-enabled` | Whether to allow multiple container assignments in one NodeManager heartbeat. Defaults to true. | +| `yarn.scheduler.capacity.per-node-heartbeat.maximum-container-assignments` | If `multiple-assignments-enabled` is true, the maximum amount of containers that can be assigned in one NodeManager heartbeat. Defaults to -1, which sets no limit. | +| `yarn.scheduler.capacity.per-node-heartbeat.maximum-offswitch-assignments` | If `multiple-assignments-enabled` is true, the maximum amount of off-switch containers that can be assigned in one NodeManager heartbeat. Defaults to 1, which represents only one off-switch allocation allowed in one heartbeat. | + ###Reviewing the configuration of the CapacityScheduler Once the installation and configuration is completed, you can review it after starting the YARN cluster from the web-ui. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
