Pat Ferrel created SPARK-6069:
---------------------------------
Summary: Deserialization Error ClassNotFound
Key: SPARK-6069
URL: https://issues.apache.org/jira/browse/SPARK-6069
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.2.1
Environment: Standalone one worker cluster on localhost, or any cluster
Reporter: Pat Ferrel
Priority: Blocker
Fix For: 1.2.2
A class is contained in the jars passed in when creating a context. It is
registered with kryo. The class (Guava HashBiMap) is created correctly from an
RDD and broadcast but the deserialization fails with ClassNotFound.
The work around is to hard code the path to the jar and make it available on
all workers. Hard code because we are creating a library so there is no easy
way to pass in to the app something like:
spark.executor.extraClassPath /path/to/some.jar
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
