[
https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15339454#comment-15339454
]
Villu Ruusmann commented on SPARK-16068:
----------------------------------------
Spark MLlib 1.6.1 depends on org.jpmml:pmml-model:1.1.15, which depends on
GlassFish Metro 2.2.7.
If you want to use any other JPMML(-Model) version, then you need to exclude
org.jpmml:pmml-model:1.1.15, and include the shaded variant of this other
version into your spark application uber-JAR. For starters, check out the
pom.xml file of the JPMML-Spark example application:
https://github.com/jpmml/jpmml-spark/blob/master/pmml-spark-example/pom.xml
I don't think this issue can be fixed at the Apache Spark project level.
However, you can help to eliminate this particular classpath conflict from
future Apache Spark versions by upvoting SPARK-15526.
> ml model import jpmml which includes wrong jaxb-impl version 2.2.7
> ----------------------------------------------------------------------
>
> Key: SPARK-16068
> URL: https://issues.apache.org/jira/browse/SPARK-16068
> Project: Spark
> Issue Type: Bug
> Components: ML, Spark Core
> Affects Versions: 1.6.1
> Reporter: weijie.tong
>
> ml model import jpmml which includes wrong jaxb-impl version 2.2.7 ,the
> com.sun.xml.bind.v2.model.annotation.RuntimeAnnotationReader interface
> extends AnnotationReader which doesn't appears in jaxb-impl version 2.2.7,
> this interface was packed in the assembly jar causing the spark application
> throw exception,
> Caused by: java.lang.NoClassDefFoundError:
> com/sun/xml/bind/v2/model/annotation/AnnotationReader
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
