Takanobu Asanuma created TEZ-4322:
-------------------------------------

             Summary: Some jetty jars are not generated in tez-dist
                 Key: TEZ-4322
                 URL: https://issues.apache.org/jira/browse/TEZ-4322
             Project: Apache Tez
          Issue Type: Sub-task
            Reporter: Takanobu Asanuma


built tez specifying hadoop-3.3.1 with master branch
{noformat}
$ tez git:(master) mvn clean package -Dhadoop.version=3.3.1 -DskipTests 
-Dmaven.javadoc.skip=true -Dallow.root.build=true
{noformat}

submitted tez job
{noformat}
$ hadoop jar tez-examples-0.10.2-SNAPSHOT.jar orderedwordcount data output1
{noformat}

Tez AM failed with the following error.
{noformat}
2021-08-02 16:47:14,063 [ERROR] [main] |app.DAGAppMaster|: Error starting 
DAGAppMaster
org.apache.hadoop.service.ServiceStateException: 
java.lang.NoClassDefFoundError: org/eclipse/jetty/servlet/ServletContextHandler
        at 
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
        at 
org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1879)
        at 
org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1943)
        at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
        at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2626)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
        at 
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2622)
        at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2409)
{noformat}

I think generated jetty jars are not enough. (there are not jetty-servlet, 
jetty-webapp, etc )
{noformat}
$ tez git:(master) find  tez-dist/target | grep jetty
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-io-9.4.40.v20210413.jar
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-util-9.4.40.v20210413.jar
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-http-9.4.40.v20210413.jar
tez-dist/target/tez-0.10.2-SNAPSHOT/lib/jetty-client-9.4.40.v20210413.jar
{noformat}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to