LuciferYang commented on a change in pull request #30701:
URL: https://github.com/apache/spark/pull/30701#discussion_r710902227
##########
File path: core/pom.xml
##########
@@ -66,7 +66,13 @@
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
- <artifactId>hadoop-client</artifactId>
+ <artifactId>${hadoop-client-api.artifact}</artifactId>
Review comment:
```
mvn clean install -DskipTests -pl resource-managers/yarn -am -Phadoop-2.7
-Pyarn
mvn test -pl resource-managers/yarn -Phadoop-2.7 -Pyarn
-DwildcardSuites=org.apache.spark.deploy.yarn.YarnClusterSuite
```
I check the above commands on master, branch-3.2, branch-3.1, branch-3.0 :
- master: failed due to problems described above
- branch-3.2 : failed due to problems described above
- branch-3.1: successful
- branch-3.0: failed due to other problems
-------------------------------------------------------------------------------------------
branch-3.0 error log
```
21/09/17 17:27:02.346 launcher-proc-1 INFO YarnClusterDriver: Exception in
thread "main" java.lang.ExceptionInInitializerError
21/09/17 17:27:02.346 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:116)
21/09/17 17:27:02.346 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:103)
21/09/17 17:27:02.346 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.metrics.sink.MetricsServlet.getHandlers(MetricsServlet.scala:53)
21/09/17 17:27:02.346 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.metrics.MetricsSystem.$anonfun$getServletHandlers$2(MetricsSystem.scala:93)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
scala.Option.map(Option.scala:230)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:93)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.SparkContext.<init>(SparkContext.scala:577)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.yarn.YarnClusterDriver$.main(YarnClusterSuite.scala:412)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.yarn.YarnClusterDriver.main(YarnClusterSuite.scala)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.lang.reflect.Method.invoke(Method.java:498)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:928)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1007)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1016)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: Caused by:
java.lang.SecurityException: class "javax.servlet.http.HttpSessionIdListener"'s
signer information does not match signer information of other classes in the
same package
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.lang.ClassLoader.checkCerts(ClassLoader.java:892)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.lang.ClassLoader.preDefineClass(ClassLoader.java:662)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.lang.ClassLoader.defineClass(ClassLoader.java:755)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.net.URLClassLoader.access$100(URLClassLoader.java:74)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.net.URLClassLoader$1.run(URLClassLoader.java:369)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.net.URLClassLoader$1.run(URLClassLoader.java:363)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.security.AccessController.doPrivileged(Native Method)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.net.URLClassLoader.findClass(URLClassLoader.java:362)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.lang.ClassLoader.loadClass(ClassLoader.java:419)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
java.lang.ClassLoader.loadClass(ClassLoader.java:352)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: at
org.eclipse.jetty.server.handler.ContextHandler.<clinit>(ContextHandler.java:121)
21/09/17 17:27:02.347 launcher-proc-1 INFO YarnClusterDriver: ... 21 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
