[
https://issues.apache.org/jira/browse/TEZ-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048226#comment-17048226
]
Ashutosh Chauhan commented on TEZ-4114:
---------------------------------------
If jetty is not in tez AM classpath, it fails to come up with following error:
{code}
[ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
org.apache.hadoop.service.ServiceStateException:
java.lang.NoClassDefFoundError: org/eclipse/jetty/servlet/ServletContextHandler
at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
at
org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1968)
at
org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:2035)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2682)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
at
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2678)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2484)
Caused by: java.lang.NoClassDefFoundError:
org/eclipse/jetty/servlet/ServletContextHandler
at org.apache.hadoop.yarn.webapp.WebApps.$for(WebApps.java:509)
at org.apache.hadoop.yarn.webapp.WebApps.$for(WebApps.java:515)
at org.apache.hadoop.yarn.webapp.WebApps.$for(WebApps.java:520)
at
org.apache.tez.dag.app.web.WebUIService.serviceStart(WebUIService.java:92)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1888)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1909)
Caused by: java.lang.ClassNotFoundException:
org.eclipse.jetty.servlet.ServletContextHandler
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 7 more
{code}
Tez AM webUI depends on jetty transitively. It extends
{{org.apache.hadoop.yarn.webapp.WebApps}} which brings in jetty transitively
via yarn webapps module. So, though tez doesnt have direct dependency
tez.tar.gz and thus tez distribution still needs to contain jetty. So, it makes
sense for tez to package it with the same version as hadoop is using, but
exclude it from compile scope.
> Upgrade to Jetty 9.4
> --------------------
>
> Key: TEZ-4114
> URL: https://issues.apache.org/jira/browse/TEZ-4114
> Project: Apache Tez
> Issue Type: Bug
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Attachments: TEZ-4114.01.patch, TEZ-4114.02.patch, TEZ-4114.03.patch,
> TEZ-4114.04.patch, TEZ-4114.05.patch, TEZ-4114.06.patch, TEZ-4114.07.patch,
> master.deps.txt
>
>
> Hadoop already did it in: https://issues.apache.org/jira/browse/HADOOP-16152
> Hive: "in progress", only abandoned jiras
> https://issues.apache.org/jira/browse/HIVE-21961
> https://issues.apache.org/jira/browse/HIVE-21211
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
