MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/22befbd5 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/22befbd5 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/22befbd5 Branch: refs/heads/YARN-5085 Commit: 22befbd585f65934e1d9ae5782a8f961192c0750 Parents: 38e66d4 Author: Akira Ajisaka <[email protected]> Authored: Fri Dec 23 04:48:04 2016 +0900 Committer: Akira Ajisaka <[email protected]> Committed: Fri Dec 23 04:48:04 2016 +0900 ---------------------------------------------------------------------- .../hadoop-common/src/site/markdown/ClusterSetup.md | 1 + .../hadoop-common/src/site/markdown/SingleCluster.md.vm | 12 ++++-------- 2 files changed, 5 insertions(+), 8 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/hadoop/blob/22befbd5/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md b/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md index 56b43e6..e2ccbf0 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md @@ -156,6 +156,7 @@ This section deals with important parameters to be specified in the given config | `yarn.nodemanager.remote-app-log-dir` | */logs* | HDFS directory where the application logs are moved on application completion. Need to set appropriate permissions. Only applicable if log-aggregation is enabled. | | `yarn.nodemanager.remote-app-log-dir-suffix` | *logs* | Suffix appended to the remote log dir. Logs will be aggregated to ${yarn.nodemanager.remote-app-log-dir}/${user}/${thisParam} Only applicable if log-aggregation is enabled. | | `yarn.nodemanager.aux-services` | mapreduce\_shuffle | Shuffle service that needs to be set for Map Reduce applications. | +| `yarn.nodemanager.env-whitelist` | Environment properties to be inherited by containers from NodeManagers | For mapreduce application in addition to the default values HADOOP\_MAPRED_HOME should to be added. Property value should JAVA\_HOME,HADOOP\_COMMON\_HOME,HADOOP\_HDFS\_HOME,HADOOP\_CONF\_DIR,CLASSPATH\_PREPEND\_DISTCACHE,HADOOP\_YARN\_HOME,HADOOP\_MAPRED\_HOME | * Configurations for History Server (Needs to be moved elsewhere): http://git-wip-us.apache.org/repos/asf/hadoop/blob/22befbd5/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm b/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm index 4825e00..fb4df9a 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm +++ b/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm @@ -190,14 +190,6 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions] <name>mapreduce.framework.name</name> <value>yarn</value> </property> - <property> - <name>mapreduce.admin.user.env</name> - <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value> - </property> - <property> - <name>yarn.app.mapreduce.am.env</name> - <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value> - </property> </configuration> `etc/hadoop/yarn-site.xml`: @@ -207,6 +199,10 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions] <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> + <property> + <name>yarn.nodemanager.env-whitelist</name> + <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value> + </property> </configuration> 2. Start ResourceManager daemon and NodeManager daemon: --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
