Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21771#discussion_r202531920
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1849,6 +1858,9 @@ class SparkContext(config: SparkConf) extends Logging
{
if (addedJars.putIfAbsent(key, timestamp).isEmpty) {
logInfo(s"Added JAR $path at $key with timestamp $timestamp")
postEnvironmentUpdate()
+ } else {
+ logWarning(s"The jar $path has been added already. Overwriting
of added jars " +
--- End diff --
This could confuse what it means with `spark.files.overwrite`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
