[ 
https://issues.apache.org/jira/browse/SPARK-31043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051655#comment-17051655
 ] 

Thomas Graves commented on SPARK-31043:
---------------------------------------

A couple of my colleagues actually ran into this and reported it to me. I built 
and saw the same thing. I did a clean when building, but I'll run again just to 
verify.

I was building with:

build/mvn -Phadoop-2.7 -Pyarn -Pkinesis-asl -Pkubernetes -Pmesos -Phadoop-cloud 
-Pspark-ganglia-lgpl clean package -DskipTests 2>&1 | tee out

I reverted the one xerces version change commit and rebuilt with command above 
and the error went away.

One thing is that I don't have hadoop env variables set - not sure if you do or 
have them in path such that it might be picking up jars from there.

Yeah I actually started looking for other things because it was complaining 
about xml-apis so thought the xerces change was weird that it caused but 
haven't investigated further

> Spark 3.0 built against hadoop2.7 can't start standalone master
> ---------------------------------------------------------------
>
>                 Key: SPARK-31043
>                 URL: https://issues.apache.org/jira/browse/SPARK-31043
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>    Affects Versions: 3.0.0
>            Reporter: Thomas Graves
>            Priority: Critical
>
> trying to start a standalone master when building spark branch 3.0 with 
> hadoop2.7 fails with:
>  
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/w3c/dom/ElementTraversal
>         at java.lang.ClassLoader.defineClass1(Native Method)
>         at java.lang.ClassLoader.defineClass(ClassLoader.java:757)
>         at 
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>         at 
> [java.net|http://java.net/]
> .URLClassLoader.defineClass(URLClassLoader.java:468)
>         at 
> [java.net|http://java.net/]
> .URLClassLoader.access$100(URLClassLoader.java:74)
>         at 
> [java.net|http://java.net/]
> .URLClassLoader$1.run(URLClassLoader.java:369)
> ...
> Caused by: java.lang.ClassNotFoundException: org.w3c.dom.ElementTraversal
>         at 
> [java.net|http://java.net/]
> .URLClassLoader.findClass(URLClassLoader.java:382)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
>         ... 42 more



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to