Stephen Haberman created SPARK-4877:
---------------------------------------
Summary: userClassPathFirst doesn't handle user classes inheriting
from parent
Key: SPARK-4877
URL: https://issues.apache.org/jira/browse/SPARK-4877
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.2.0
Reporter: Stephen Haberman
We're trying out userClassPathFirst.
To do so, we make an uberjar that does not contain Spark or Scala classes
(because we want those to load from the parent classloader, otherwise we'll get
errors like scala.Function0 != scala.Function0 since they'd load from different
class loaders).
(Tangentially, some isolation classloaders like Jetty whitelist certain
packages, like spark/* and scala/*, to only come from the parent classloader,
so that technically if the user still messes up and leaks the Scala/Spark jars
into their uberjar, it won't blow up; this would be a good enhancement, I
think.)
Anyway, we have a custom Kryo registrar, which ships in our uberjar, but since
it "extends spark.KryoRegistrator", which is not in our uberjar, we get a
ClassNotFoundException.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
