Github user loneknightpy commented on a diff in the pull request:
https://github.com/apache/spark/pull/19074#discussion_r139248521
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -311,12 +317,16 @@ object SparkSubmit extends CommandLineUtils {
}
// In client mode, download remote files.
+ var localPrimaryResource: String = null
+ var localJars: String = null
+ var localPyFiles: String = null
+ var localFiles: String = null
if (deployMode == CLIENT) {
--- End diff --
If you want to avoid download for yarn, can we just check the cluster mode
it here?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
