Hi Andrew,
Thanks for the prompt response. I tried command line and it works fine. But, I
want to try from IDE for easier debugging and transparency into code execution.
I would try and see if there is any way to get the jar over to the executor
from within the IDE.
- Barrington
On Sep 21,
Hi,
I am running spark from my IDE (InteliJ) using YARN as my cluster manager.
However, the executor node is not able to find my main driver class
“LascoScript”. I keep getting java.lang.ClassNotFoundException.
I tried adding the jar of the main class by running the snippet below
val
Hi Barrington,
Have you tried running it from the command line? (i.e. bin/spark-submit
--master yarn-client --class YOUR_CLASS YOUR_JAR) Does it still fail? I am
not super familiar with running Spark through intellij, but the AFAIK the
classpaths are setup a little differently there. Also, Spark
