Thanks Cheng. Yes, the problem is that the way to set up to run inside
Intellij changes v frequently. It is unfortunately not simply a one-time
investment to get IJ debugging working properly: the steps required are a
moving target approximately monthly to bi-monthly.
Doing remote debugging is probably a good choice to reduce the dev
environment volatility/maintenance.
2015-04-04 5:46 GMT-07:00 Cheng Lian lian.cs@gmail.com:
I found in general it's a pain to build/run Spark inside IntelliJ IDEA. I
guess most people resort to this approach so that they can leverage the
integrated debugger to debug and/or learn Spark internals. A more
convenient way I'm using recently is resorting to the remote debugging
feature. In this way, by adding driver/executor Java options, you may build
and start the Spark applications/tests/daemons in the normal way and attach
the debugger to it. I was using this to debug the HiveThriftServer2, and it
worked perfectly.
Steps to enable remote debugging:
1. Menu Run / Edit configurations...
2. Click the + button, choose Remote
3. Choose Attach or Listen in Debugger mode according to your actual
needs
4. Copy, edit, and add Java options suggested in the dialog to
`--driver-java-options` or `--executor-java-options`
5. If you're using attaching mode, first start your Spark program, then
start remote debugging in IDEA
6. If you're using listening mode, first start remote debugging in IDEA,
and then start your Spark program.
Hope this can be helpful.
Cheng
On 4/4/15 12:54 AM, sara mustafa wrote:
Thank you, it works with me when I changed the dependencies from provided
to
compile.
--
View this message in context: http://apache-spark-
developers-list.1001551.n3.nabble.com/IntelliJ-Runtime-
error-tp11383p11385.html
Sent from the Apache Spark Developers List mailing list archive at
Nabble.com.
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
