[
https://issues.apache.org/jira/browse/SPARK-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990359#comment-13990359
]
Patrick Wendell commented on SPARK-1734:
----------------------------------------
This is pretty strange, I would think this should work since spark-submit
itself is launched with Spark in the classpath.
One thing would be to see if this fixes it... I'm not proposing this as a
solution, just a debug step:
{code}
broadcastFactory =
Class.forName(broadcastFactoryClass).newInstance.asInstanceOf[BroadcastFactory]
{code}
{code}
broadcastFactory = Class.forName(broadcastFactoryClass, false,
Utils.getSparkClassLoader)
.newInstance.asInstanceOf[BroadcastFactory]
{code}
> spark-submit throws an exception: Exception in thread "main"
> java.lang.ClassNotFoundException:
> org.apache.spark.broadcast.TorrentBroadcastFactory
> -------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-1734
> URL: https://issues.apache.org/jira/browse/SPARK-1734
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Spark Core
> Reporter: Guoqiang Li
> Priority: Blocker
>
> {{conf/spark-defaults.conf}}:
> {code}
> spark.broadcast.factory
> org.apache.spark.broadcast.TorrentBroadcastFactory
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
