Github user devaraj-kavali commented on a diff in the pull request:

    https://github.com/apache/spark/pull/19616#discussion_r168364257
  
    --- Diff: 
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 
---
    @@ -784,6 +794,9 @@ private[spark] class Client(
         val env = new HashMap[String, String]()
         populateClasspath(args, hadoopConf, sparkConf, env, 
sparkConf.get(DRIVER_CLASS_PATH))
         env("SPARK_YARN_STAGING_DIR") = stagingDirPath.toString
    +    if (isClientUnmanagedAMEnabled) {
    +      System.setProperty("SPARK_YARN_STAGING_DIR", stagingDirPath.toString)
    --- End diff --
    
    Changed it to get from the spark conf and the application id.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to