After clicking the github spark repo, it is clearly here:
https://github.com/apache/spark/tree/master/launcher/src/main/java/org/apache/spark/launcher
My intellij project sidebar was fully expanded and I was lost in anther folder.
Problem solved.
-
Hi,
It seems to me spark launches a process to read the spark-deaults.conf
and then launch another process to do the app stuff.
The code here should confirm it:
https://github.com/apache/spark/blob/master/bin/spark-class#L76
$RUNNER" -cp "$LAUNCH_CLASSPATH" org.apache.spark.launcher.Main "$@"