Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/19616#discussion_r165516090 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -784,6 +794,9 @@ private[spark] class Client( val env = new HashMap[String, String]() populateClasspath(args, hadoopConf, sparkConf, env, sparkConf.get(DRIVER_CLASS_PATH)) env("SPARK_YARN_STAGING_DIR") = stagingDirPath.toString + if (isClientUnmanagedAMEnabled) { + System.setProperty("SPARK_YARN_STAGING_DIR", stagingDirPath.toString) --- End diff -- Can this be propagated some other way? Using system properties is kinda hacky, and makes it dangerous to run another Spark app later in the same JVM.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org