hadoop git commit: YARN-4100. Add Documentation for Distributed and Delegated-Centralized Node Labels feature. Contributed by Naganarasimha G R.
Repository: hadoop Updated Branches: refs/heads/branch-2.8 c487453b9 -> aeea77ce1 YARN-4100. Add Documentation for Distributed and Delegated-Centralized Node Labels feature. Contributed by Naganarasimha G R. (cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/aeea77ce Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/aeea77ce Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/aeea77ce Branch: refs/heads/branch-2.8 Commit: aeea77ce147c8f53a868274654df693437e1c435 Parents: c487453 Author: Devaraj KAuthored: Tue Feb 2 12:06:51 2016 +0530 Committer: Devaraj K Committed: Tue Feb 2 12:08:56 2016 +0530 -- hadoop-yarn-project/CHANGES.txt | 3 + .../src/main/resources/yarn-default.xml | 50 ++-- .../src/site/markdown/NodeLabel.md | 86 3 files changed, 99 insertions(+), 40 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/aeea77ce/hadoop-yarn-project/CHANGES.txt -- diff --git a/hadoop-yarn-project/CHANGES.txt b/hadoop-yarn-project/CHANGES.txt index 901a1eb..636db91 100644 --- a/hadoop-yarn-project/CHANGES.txt +++ b/hadoop-yarn-project/CHANGES.txt @@ -592,6 +592,9 @@ Release 2.8.0 - UNRELEASED YARN-4340. Add "list" API to reservation system. (Sean Po via wangda) +YARN-4100. Add Documentation for Distributed and Delegated-Centralized +Node Labels feature. (Naganarasimha G R via devaraj) + OPTIMIZATIONS YARN-3339. TestDockerContainerExecutor should pull a single image and not http://git-wip-us.apache.org/repos/asf/hadoop/blob/aeea77ce/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml -- diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml index 0add988..80f0fea 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml @@ -2281,26 +2281,26 @@ -When "yarn.node-labels.configuration-type" parameter in RM is configured as -"distributed", Administrators can configure in NM, the provider for the +When "yarn.node-labels.configuration-type" is configured with "distributed" +in RM, Administrators can configure in NM the provider for the node labels by configuring this parameter. Administrators can -specify "config", "script" or the class name of the provider. Configured +configure "config", "script" or the class name of the provider. Configured class needs to extend org.apache.hadoop.yarn.server.nodemanager.nodelabels.NodeLabelsProvider. -If "config" is specified then "ConfigurationNodeLabelsProvider" and -"script" then "ScriptNodeLabelsProvider" will be used. +If "config" is configured, then "ConfigurationNodeLabelsProvider" and if +"script" is configured, then "ScriptNodeLabelsProvider" will be used. yarn.nodemanager.node-labels.provider -When node labels "yarn.nodemanager.node-labels.provider" is of type -"config" or the configured class extends AbstractNodeLabelsProvider then -periodically node labels are retrieved from the node labels provider. -This configuration is to define the interval. If -1 is configured then -node labels are retrieved from. provider only during initialization. -Defaults to 10 mins. +When "yarn.nodemanager.node-labels.provider" is configured with "config", +"Script" or the configured class extends AbstractNodeLabelsProvider, then +periodically node labels are retrieved from the node labels provider. This +configuration is to define the interval period. +If -1 is configured then node labels are retrieved from provider only +during initialization. Defaults to 10 mins. yarn.nodemanager.node-labels.provider.fetch-interval-ms 60 @@ -2308,8 +2308,8 @@ - Interval at which node labels syncs with RM from NM.Will send loaded labels - every x intervals configured along with heartbeat from NM to RM. + Interval at which NM syncs its node labels with RM. NM will send its loaded + labels every x intervals configured, along with heartbeat to RM. yarn.nodemanager.node-labels.resync-interval-ms 12 @@ -2317,19 +2317,18 @@ -When node labels "yarn.nodemanager.node-labels.provider" -is of type "config" then
hadoop git commit: YARN-4100. Add Documentation for Distributed and Delegated-Centralized Node Labels feature. Contributed by Naganarasimha G R.
Repository: hadoop Updated Branches: refs/heads/trunk 1cd55e0c1 -> db144eb1c YARN-4100. Add Documentation for Distributed and Delegated-Centralized Node Labels feature. Contributed by Naganarasimha G R. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/db144eb1 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/db144eb1 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/db144eb1 Branch: refs/heads/trunk Commit: db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33 Parents: 1cd55e0 Author: Devaraj KAuthored: Tue Feb 2 12:06:51 2016 +0530 Committer: Devaraj K Committed: Tue Feb 2 12:06:51 2016 +0530 -- hadoop-yarn-project/CHANGES.txt | 3 + .../src/main/resources/yarn-default.xml | 50 ++-- .../src/site/markdown/NodeLabel.md | 86 3 files changed, 99 insertions(+), 40 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/db144eb1/hadoop-yarn-project/CHANGES.txt -- diff --git a/hadoop-yarn-project/CHANGES.txt b/hadoop-yarn-project/CHANGES.txt index bf46864..345c64b 100644 --- a/hadoop-yarn-project/CHANGES.txt +++ b/hadoop-yarn-project/CHANGES.txt @@ -778,6 +778,9 @@ Release 2.8.0 - UNRELEASED YARN-4340. Add "list" API to reservation system. (Sean Po via wangda) +YARN-4100. Add Documentation for Distributed and Delegated-Centralized +Node Labels feature. (Naganarasimha G R via devaraj) + OPTIMIZATIONS YARN-3339. TestDockerContainerExecutor should pull a single image and not http://git-wip-us.apache.org/repos/asf/hadoop/blob/db144eb1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml -- diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml index e33d23e..d8ea3ad 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml @@ -2281,26 +2281,26 @@ -When "yarn.node-labels.configuration-type" parameter in RM is configured as -"distributed", Administrators can configure in NM, the provider for the +When "yarn.node-labels.configuration-type" is configured with "distributed" +in RM, Administrators can configure in NM the provider for the node labels by configuring this parameter. Administrators can -specify "config", "script" or the class name of the provider. Configured +configure "config", "script" or the class name of the provider. Configured class needs to extend org.apache.hadoop.yarn.server.nodemanager.nodelabels.NodeLabelsProvider. -If "config" is specified then "ConfigurationNodeLabelsProvider" and -"script" then "ScriptNodeLabelsProvider" will be used. +If "config" is configured, then "ConfigurationNodeLabelsProvider" and if +"script" is configured, then "ScriptNodeLabelsProvider" will be used. yarn.nodemanager.node-labels.provider -When node labels "yarn.nodemanager.node-labels.provider" is of type -"config" or the configured class extends AbstractNodeLabelsProvider then -periodically node labels are retrieved from the node labels provider. -This configuration is to define the interval. If -1 is configured then -node labels are retrieved from. provider only during initialization. -Defaults to 10 mins. +When "yarn.nodemanager.node-labels.provider" is configured with "config", +"Script" or the configured class extends AbstractNodeLabelsProvider, then +periodically node labels are retrieved from the node labels provider. This +configuration is to define the interval period. +If -1 is configured then node labels are retrieved from provider only +during initialization. Defaults to 10 mins. yarn.nodemanager.node-labels.provider.fetch-interval-ms 60 @@ -2308,8 +2308,8 @@ - Interval at which node labels syncs with RM from NM.Will send loaded labels - every x intervals configured along with heartbeat from NM to RM. + Interval at which NM syncs its node labels with RM. NM will send its loaded + labels every x intervals configured, along with heartbeat to RM. yarn.nodemanager.node-labels.resync-interval-ms 12 @@ -2317,19 +2317,18 @@ -When node labels "yarn.nodemanager.node-labels.provider" -is of type "config" then ConfigurationNodeLabelsProvider fetches the -partition from this parameter.
hadoop git commit: YARN-4100. Add Documentation for Distributed and Delegated-Centralized Node Labels feature. Contributed by Naganarasimha G R.
Repository: hadoop Updated Branches: refs/heads/branch-2 bbda44688 -> 43131af1e YARN-4100. Add Documentation for Distributed and Delegated-Centralized Node Labels feature. Contributed by Naganarasimha G R. (cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/43131af1 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/43131af1 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/43131af1 Branch: refs/heads/branch-2 Commit: 43131af1e21cde903c0203e935545251a32136f1 Parents: bbda446 Author: Devaraj KAuthored: Tue Feb 2 12:06:51 2016 +0530 Committer: Devaraj K Committed: Tue Feb 2 12:07:49 2016 +0530 -- hadoop-yarn-project/CHANGES.txt | 3 + .../src/main/resources/yarn-default.xml | 50 ++-- .../src/site/markdown/NodeLabel.md | 86 3 files changed, 99 insertions(+), 40 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/43131af1/hadoop-yarn-project/CHANGES.txt -- diff --git a/hadoop-yarn-project/CHANGES.txt b/hadoop-yarn-project/CHANGES.txt index 94b62e1..d6e1d4d 100644 --- a/hadoop-yarn-project/CHANGES.txt +++ b/hadoop-yarn-project/CHANGES.txt @@ -723,6 +723,9 @@ Release 2.8.0 - UNRELEASED YARN-4340. Add "list" API to reservation system. (Sean Po via wangda) +YARN-4100. Add Documentation for Distributed and Delegated-Centralized +Node Labels feature. (Naganarasimha G R via devaraj) + OPTIMIZATIONS YARN-3339. TestDockerContainerExecutor should pull a single image and not http://git-wip-us.apache.org/repos/asf/hadoop/blob/43131af1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml -- diff --git a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml index e33d23e..d8ea3ad 100644 --- a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml +++ b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml @@ -2281,26 +2281,26 @@ -When "yarn.node-labels.configuration-type" parameter in RM is configured as -"distributed", Administrators can configure in NM, the provider for the +When "yarn.node-labels.configuration-type" is configured with "distributed" +in RM, Administrators can configure in NM the provider for the node labels by configuring this parameter. Administrators can -specify "config", "script" or the class name of the provider. Configured +configure "config", "script" or the class name of the provider. Configured class needs to extend org.apache.hadoop.yarn.server.nodemanager.nodelabels.NodeLabelsProvider. -If "config" is specified then "ConfigurationNodeLabelsProvider" and -"script" then "ScriptNodeLabelsProvider" will be used. +If "config" is configured, then "ConfigurationNodeLabelsProvider" and if +"script" is configured, then "ScriptNodeLabelsProvider" will be used. yarn.nodemanager.node-labels.provider -When node labels "yarn.nodemanager.node-labels.provider" is of type -"config" or the configured class extends AbstractNodeLabelsProvider then -periodically node labels are retrieved from the node labels provider. -This configuration is to define the interval. If -1 is configured then -node labels are retrieved from. provider only during initialization. -Defaults to 10 mins. +When "yarn.nodemanager.node-labels.provider" is configured with "config", +"Script" or the configured class extends AbstractNodeLabelsProvider, then +periodically node labels are retrieved from the node labels provider. This +configuration is to define the interval period. +If -1 is configured then node labels are retrieved from provider only +during initialization. Defaults to 10 mins. yarn.nodemanager.node-labels.provider.fetch-interval-ms 60 @@ -2308,8 +2308,8 @@ - Interval at which node labels syncs with RM from NM.Will send loaded labels - every x intervals configured along with heartbeat from NM to RM. + Interval at which NM syncs its node labels with RM. NM will send its loaded + labels every x intervals configured, along with heartbeat to RM. yarn.nodemanager.node-labels.resync-interval-ms 12 @@ -2317,19 +2317,18 @@ -When node labels "yarn.nodemanager.node-labels.provider" -is of type "config" then