So, Im using Intellij 13.x, and Scala Spark jobs.
Make sure you have singletons (objects, not classes), then simply debug the
main function. You’ll need to set your master to some derivation of “local”,
but thats it. Spark Streaming is kinda wonky when debugging, but data-at-rest
behaves
Also, I'm following to master students at the University of Liège (one for
computing prob conditional density on massive data and the other
implementing a Markov Chain method on georasters), I proposed them to use
the Spark-Notebook to learn the framework, they're quite happy with it (so
far at
I am a Scala / Spark newbie (attending Paco Nathan's class).
What I need is some advice as to how to set up intellij (or eclipse) to be
able to attache to the process executing to the debugger. I know that this
is not feasible if the code is executing within the cluster. However, if
spark is
