yabola commented on code in PR #44721:
URL: https://github.com/apache/spark/pull/44721#discussion_r1452986785
##########
core/src/main/scala/org/apache/spark/internal/config/package.scala:
##########
@@ -2025,6 +2025,15 @@ package object config {
.checkValue(v => v >= 0, "The threshold should be non-negative.")
.createWithDefault(1L * 1024 * 1024)
+ private[spark] val CLEAN_BROADCAST_AFTER_EXECUTION_END_ENABLED =
+ ConfigBuilder("spark.broadcast.cleanAfterExecutionEnd.enabled")
+ .doc("Whether to enable clean broadcast data after sql execution. If
enabled, " +
Review Comment:
@HyukjinKwon Thank you for your advice. But this parameter needs to be used
in `BroadcastManager#initialize` (core module), but the core module does not
import the SQL module. The core module use the parameters of the SQL module. I
don’t know if they are appropriate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
