various issues with running yarn proxyserver
--------------------------------------------
Key: MAPREDUCE-3916
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3916
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2, resourcemanager, webapps
Affects Versions: 0.23.1
Reporter: Roman Shaposhnik
Seem like yarn proxyserver is not operational when running out of the 0.23.1
RC2 tarball.
# Setting yarn.web-proxy.address to match yarn.resourcemanager.address doesn't
disable the proxyserver (althought not setting yarn.web-proxy.address at all
correctly disable it and produces a message:
org.apache.hadoop.yarn.YarnException: yarn.web-proxy.address is not set so the
proxy will not run). This contradicts the documentation provided for
yarn.web-proxy.address in yarn-default.xml
# Setting yarn.web-proxy.address and running the service results in the
following:
{noformat}
$ ./sbin/yarn-daemon.sh start proxyserver
starting proxyserver, logging to
/tmp/hadoop-0.23.1/logs/yarn-rvs-proxyserver-ahmed-laptop.out
/usr/java/64/jdk1.6.0_22/bin/java -Dproc_proxyserver -Xmx1000m
-Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs -Dyarn.log.dir=/tmp/hadoop-0.23.1/logs
-Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log -Dyarn.home.dir=
-Dyarn.id.str=rvs -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA
-Djava.library.path=/tmp/hadoop-0.23.1/lib/native
-Dyarn.policy.file=hadoop-policy.xml -Dhadoop.log.dir=/tmp/hadoop-0.23.1/logs
-Dyarn.log.dir=/tmp/hadoop-0.23.1/logs
-Dhadoop.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.log.file=yarn-rvs-proxyserver-ahmed-laptop.log
-Dyarn.home.dir=/tmp/hadoop-0.23.1 -Dhadoop.root.logger=INFO,DRFA
-Dyarn.root.logger=INFO,DRFA -Djava.library.path=/tmp/hadoop-0.23.1/lib/native
-classpath
/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/etc/hadoop:/tmp/hadoop-0.23.1/share/hadoop/common/lib/*:/tmp/hadoop-0.23.1/share/hadoop/common/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs:/tmp/hadoop-0.23.1/share/hadoop/hdfs/lib/*:/tmp/hadoop-0.23.1/share/hadoop/hdfs/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/*:/tmp/hadoop-0.23.1/share/hadoop/mapreduce/lib/*
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer
{noformat}
with the following message found in the logs:
{noformat}
2012-02-24 09:26:31,099 FATAL
org.apache.hadoop.yarn.server.webproxy.WebAppProxy: Could not start proxy web
server
java.io.FileNotFoundException: webapps/proxy not found in CLASSPATH
at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:532)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:224)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:164)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxy.start(WebAppProxy.java:85)
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at
org.apache.hadoop.yarn.server.webproxy.WebAppProxyServer.main(WebAppProxyServer.java:76)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
