[
https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375599#comment-14375599
]
Littlestar edited comment on SPARK-1702 at 3/23/15 11:00 AM:
-------------------------------------------------------------
I met this on spak 1.3.0 + mesos 0.21.1 with "run-example SparkPi"
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/spark/executor/MesosExecutorBackend
Caused by: java.lang.ClassNotFoundException:
org.apache.spark.executor.MesosExecutorBackend
at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
Could not find the main class: org.apache.spark.executor.MesosExecutorBackend
was (Author: cnstar9988):
I met this on spak 1.3.0 + mesos 0.21.1 with "run-example SparkPi"
> Mesos executor won't start because of a ClassNotFoundException
> --------------------------------------------------------------
>
> Key: SPARK-1702
> URL: https://issues.apache.org/jira/browse/SPARK-1702
> Project: Spark
> Issue Type: Bug
> Components: Mesos
> Affects Versions: 1.0.0
> Reporter: Bouke van der Bijl
> Labels: executors, mesos, spark
>
> Some discussion here:
> http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-spark-on-mesos-td3510.html
> Fix here (which is probably not the right fix):
> https://github.com/apache/spark/pull/620
> This was broken in v0.9.0, was fixed in v0.9.1 and is now broken again.
> Error in Mesos executor stderr:
> WARNING: Logging before InitGoogleLogging() is written to STDERR
> I0502 17:31:42.672224 14688 exec.cpp:131] Version: 0.18.0
> I0502 17:31:42.674959 14707 exec.cpp:205] Executor registered on slave
> 20140501-182306-16842879-5050-10155-0
> 14/05/02 17:31:42 INFO MesosExecutorBackend: Using Spark's default log4j
> profile: org/apache/spark/log4j-defaults.properties
> 14/05/02 17:31:42 INFO MesosExecutorBackend: Registered with Mesos as
> executor ID 20140501-182306-16842879-5050-10155-0
> 14/05/02 17:31:43 INFO SecurityManager: Changing view acls to: vagrant
> 14/05/02 17:31:43 INFO SecurityManager: SecurityManager, is authentication
> enabled: false are ui acls enabled: false users with view permissions:
> Set(vagrant)
> 14/05/02 17:31:43 INFO Slf4jLogger: Slf4jLogger started
> 14/05/02 17:31:43 INFO Remoting: Starting remoting
> 14/05/02 17:31:43 INFO Remoting: Remoting started; listening on addresses
> :[akka.tcp://spark@localhost:50843]
> 14/05/02 17:31:43 INFO Remoting: Remoting now listens on addresses:
> [akka.tcp://spark@localhost:50843]
> java.lang.ClassNotFoundException: org/apache/spark/serializer/JavaSerializer
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:270)
> at org.apache.spark.SparkEnv$.instantiateClass$1(SparkEnv.scala:165)
> at org.apache.spark.SparkEnv$.create(SparkEnv.scala:176)
> at org.apache.spark.executor.Executor.<init>(Executor.scala:106)
> at
> org.apache.spark.executor.MesosExecutorBackend.registered(MesosExecutorBackend.scala:56)
> Exception in thread "Thread-0" I0502 17:31:43.710039 14707 exec.cpp:412]
> Deactivating the executor libprocess
> The problem is that it can't find the class.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
