RM and NM fail to start (webapps/cluster is missing)
----------------------------------------------------
Key: MAPREDUCE-3116
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3116
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: nodemanager, resourcemanager
Affects Versions: 0.24.0
Environment: [criccomi@criccomi-ld trunk]$ svn info
Path: .
URL: http://svn.apache.org/repos/asf/hadoop/common/trunk
Repository Root: http://svn.apache.org/repos/asf
Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
Revision: 1176955
Node Kind: directory
Schedule: normal
Last Changed Author: vinodkv
Last Changed Rev: 1176849
Last Changed Date: 2011-09-28 05:36:30 -0700 (Wed, 28 Sep 2011)
Reporter: Chris Riccomini
Priority: Critical
When I try to start the RM, I get:
2011-09-28 10:03:42,848 FATAL resourcemanager.ResourceManager
(ResourceManager.java:main(514)) - Error starting ResourceManager
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startWepApp(ResourceManager.java:396)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.start(ResourceManager.java:411)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:512)
Caused by: java.io.FileNotFoundException: webapps/cluster not found in CLASSPATH
at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:484)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:184)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:139)
at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144)
... 3 more
When I try to start the NM, I get:
2011-09-28 09:40:52,330 ERROR webapp.WebServer (WebServer.java:start(65)) -
NMWebapps failed to start.
org.apache.hadoop.yarn.webapp.WebAppException: Error starting http server
at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:152)
at
org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.start(WebServer.java:59)
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:153)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:202)
Caused by: java.io.FileNotFoundException: webapps/node not found in CLASSPATH
at org.apache.hadoop.http.HttpServer.getWebAppsPath(HttpServer.java:507)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:207)
at org.apache.hadoop.http.HttpServer.<init>(HttpServer.java:162)
at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:144)
... 4 more
I poked around a bit. When I jar -tvf my hadoop-yarn-common-0.24.0-SNAPSHOT.jar
file, I see that it has:
0 Mon Sep 19 09:41:18 PDT 2011 webapps/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/js/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/
0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/
612 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/images/back_disabled.jpg
260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_desc.png
263 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_asc.png
807 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/images/back_enabled.jpg
894 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/favicon.ico
251 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/images/sort_desc_disabled.png
252 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/images/sort_asc_disabled.png
27490 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/Sorting
icons.psd
635 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/images/forward_disabled.jpg
282 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/images/sort_both.png
852 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/images/forward_enabled.jpg
18043 Mon Sep 19 09:41:18 PDT 2011
webapps/static/dt-1.7.5/js/jquery.dataTables.min.js.gz
1276 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_page.css
9689 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/demo_table.css
6211 Mon Sep 19 09:41:18 PDT 2011 webapps/static/dt-1.7.5/css/jui-dt.css
4191 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_trontastic.png
3259 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_humanity.png
3260 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_start_menu.png
8581 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_sunny.png
2961 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_hot_sneaks.png
3417 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_smoothness.png
3309 Mon Sep 19 09:41:18 PDT 2011
webapps/static/theme/theme_90_black_matte.png
3697 Mon Sep 19 09:41:18 PDT 2011
webapps/static/theme/theme_90_excite_bike.png
8530 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_cupertino.png
9041 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_eggplant.png
5153 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_ui_light.png
7533 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_blitzer.png
9124 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_le_frog.png
3166 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_dot_luv.png
7103 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_overcast.png
11553 Mon Sep 19 09:41:18 PDT 2011
webapps/static/theme/theme_90_pepper_grinder.png
5367 Mon Sep 19 09:41:18 PDT 2011
webapps/static/theme/theme_90_swanky_purse.png
6432 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_flick.png
10481 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_dark_hive.png
8760 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_ui_dark.png
3370 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_windoze.png
8417 Mon Sep 19 09:41:18 PDT 2011
webapps/static/theme/theme_90_south_street.png
8620 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_mint_choco.png
3623 Mon Sep 19 09:41:18 PDT 2011 webapps/static/theme/theme_90_black_tie.png
1118 Mon Sep 19 09:41:18 PDT 2011 webapps/static/yarn.css
23946 Mon Sep 19 09:41:18 PDT 2011 webapps/static/hadoop-st.png
8821 Mon Sep 19 09:41:18 PDT 2011 webapps/static/themeswitcher.js.gz
3494 Mon Sep 19 09:41:18 PDT 2011 webapps/static/busy.gif
37540 Mon Sep 19 09:41:18 PDT 2011 webapps/static/jt/jquery.jstree.js.gz
1628 Mon Sep 19 09:41:18 PDT 2011 webapps/static/yarn.dt.plugins.js
0 Mon Sep 19 09:41:18 PDT 2011 webapps/test/.keep
0 Mon Sep 19 09:41:18 PDT 2011 webapps/yarn/.keep
Clearly, this is missing the cluster/.keep path, which appears to be required
by RM (as it specifies "cluster" as the webapp name when it starts).
I think that we need to get "cluster" and whatever NM's webapp name is back
into the webapps directory in the jar.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
