AngersZhuuuu commented on a change in pull request #31598:
URL: https://github.com/apache/spark/pull/31598#discussion_r582554110
##########
File path: core/src/main/scala/org/apache/spark/SparkContext.scala
##########
@@ -2690,7 +2690,10 @@ object SparkContext extends Logging {
setActiveContext(new SparkContext(config))
} else {
if (config.getAll.nonEmpty) {
- logWarning("Using an existing SparkContext; some configuration may
not take effect.")
+ logWarning("Using an existing SparkContext; some configuration may
not take effect." +
+ " For how to set these configuration correctly, you can refer to" +
+ " https://spark.apache.org/docs/latest/configuration.html"; +
Review comment:
Yea, updated.
Current demo warn log is
```
13:23:48.133 WARN org.apache.spark.sql.SparkSession$Builder: Since spark has
been submitted, such configurations `spark.driver.memory -> 1g` may not take
effect. For how to set these configuration correctly, you can refer to
https://spark.apache.org/docs/3.2.0-SNAPSHOT/configuration.html#dynamically-loading-spark-properties.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
