What is the proper way to specify java options for the Spark executors
using spark-submit? We had done this previously using
export SPARK_JAVA_OPTS='..
previously, for example to attach a debugger to each executor or add
-verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCTimeStamps
On spark-submit I
Hi Arun!
I think you can find info at
https://spark.apache.org/docs/latest/configuration.html
quote:
Spark provides three locations to configure the system:
* Spark properties
https://spark.apache.org/docs/latest/configuration.html#spark-propertiescontrol
most application