Hi Folks, 

 I have an assembly jar that I am submitting using spark-submit script
on a cluster I created with the spark-ec2 script. I keep running
into the java.lang.NoClassDefFoundError:
org/codehaus/jackson/annotate/JsonClass error on my workers even
though jar tf clearly shows that class being a part of my assembly
jar. I have the spark program working locally.
Here is the error
log:
https://gist.github.com/rbraley/cf5cd3457a89b1c0ac88

Anybody have any suggestions of things I can try? It seems 
http://mail-archives.apache.org/mod_mbox/incubator-spark-user/201406.mbox/%3c1403899110.65393.yahoomail...@web160503.mail.bf1.yahoo.com%3E
 that this is a similar error. I am open to recompiling spark to fix this, but 
I would like to run my job on my cluster rather than just locally. 

Thanks,
Ryan


Ryan Braley  |  Founder 
http://traintracks.io/ 

US: +1 (206) 866 5661
CN: +86 156 1153 7598
Coding the future. Decoding the game.

Reply via email to