Repository: hadoop Updated Branches: refs/heads/branch-2.9 7d2b13f0b -> 17289ca67
YARN-6851. Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat. (cherry picked from commit 333ef303ff0caf9adfd378652a8f966377901768) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/17289ca6 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/17289ca6 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/17289ca6 Branch: refs/heads/branch-2.9 Commit: 17289ca67705eacb4cd7fc0d13f5cc44384526e5 Parents: 7d2b13f Author: Wei Yan <[email protected]> Authored: Wed Nov 29 14:37:57 2017 -0800 Committer: Wei Yan <[email protected]> Committed: Wed Nov 29 14:48:19 2017 -0800 ---------------------------------------------------------------------- .../src/site/markdown/CapacityScheduler.md | 10 ++++++++++ 1 file changed, 10 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/17289ca6/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md ---------------------------------------------------------------------- diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md index 4754c94..0449e88 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/CapacityScheduler.md @@ -282,6 +282,16 @@ The `ReservationSystem` is integrated with the `CapacityScheduler` queue hierach |:---- |:---- | | `yarn.scheduler.capacity.node-locality-delay` | Number of missed scheduling opportunities after which the CapacityScheduler attempts to schedule rack-local containers. Typically, this should be set to number of nodes in the cluster. By default is setting approximately number of nodes in one rack which is 40. Positive integer value is expected. | + * Container Allocation per NodeManager Heartbeat + + The `CapacityScheduler` supports the following parameters to control how many containers can be allocated in each NodeManager heartbeat. + +| Property | Description | +|:---- |:---- | +| `yarn.scheduler.capacity.per-node-heartbeat.multiple-assignments-enabled` | Whether to allow multiple container assignments in one NodeManager heartbeat. Defaults to true. | +| `yarn.scheduler.capacity.per-node-heartbeat.maximum-container-assignments` | If `multiple-assignments-enabled` is true, the maximum amount of containers that can be assigned in one NodeManager heartbeat. Defaults to -1, which sets no limit. | +| `yarn.scheduler.capacity.per-node-heartbeat.maximum-offswitch-assignments` | If `multiple-assignments-enabled` is true, the maximum amount of off-switch containers that can be assigned in one NodeManager heartbeat. Defaults to 1, which represents only one off-switch allocation allowed in one heartbeat. | + ###Reviewing the configuration of the CapacityScheduler Once the installation and configuration is completed, you can review it after starting the YARN cluster from the web-ui. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
