Github user misutoth commented on a diff in the pull request:
https://github.com/apache/spark/pull/20853#discussion_r175576249
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -245,6 +245,19 @@ object SparkSubmit extends CommandLineUtils with
Logging {
args: SparkSubmitArguments,
conf: Option[HadoopConfiguration] = None)
: (Seq[String], Seq[String], SparkConf, String) = {
+ try {
+ doPrepareSubmitEnvironment(args, conf)
+ } catch {
+ case e: SparkException =>
+ printErrorAndExit(e.getMessage)
+ throw new RuntimeException("Unreachable production code")
--- End diff --
Actually the directory deletion is hooked into JVM shutdown. So I will let
this to do the housekeeping for us and will avoid a new field either.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
