[
https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13986494#comment-13986494
]
Sean Owen commented on SPARK-1693:
----------------------------------
Ah didn't even see that! Yeah that's my "#1", which you already identified. It
is simple. Does it resolve this error? (I assume so.)
The only reason this feels undesirable is that Hadoop's web app then only
happens to work because Jetty is also bundled. That kind of accidental working
is brittle. (Although, why does the Hadoop client lib need a web app? could be
an accident of the dependency graph that totally doesn't matter.)
I had thought that the real fix is to declare that the project's conflicting
dependencies must agree, by declaring the dependency they must agree on and
then excluding the offenders. That is, does #2 work for you too? It is not much
more work and more robust. But I am not 100% sure it works.
> Most of the tests throw a java.lang.SecurityException when spark built for
> hadoop 2.3.0 , 2.4.0
> ------------------------------------------------------------------------------------------------
>
> Key: SPARK-1693
> URL: https://issues.apache.org/jira/browse/SPARK-1693
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Guoqiang Li
> Assignee: Guoqiang Li
> Attachments: log.txt
>
>
> {code}mvn test -Pyarn -Dhadoop.version=2.4.0 -Dyarn.version=2.4.0 >
> log.txt{code}
> The log:
> {code}
> UnpersistSuite:
> - unpersist RDD *** FAILED ***
> java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s
> signer information does not match signer information of other classes in the
> same package
> at java.lang.ClassLoader.checkCerts(ClassLoader.java:952)
> at java.lang.ClassLoader.preDefineClass(ClassLoader.java:666)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:794)
> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
