This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new fcd83713889e [SPARK-53923][CORE] Rename `spark.executor.(log ->
logs).redirectConsoleOutputs`
fcd83713889e is described below
commit fcd83713889e2b0248342ca6b70106d406dab9e9
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Oct 15 11:58:17 2025 -0700
[SPARK-53923][CORE] Rename `spark.executor.(log ->
logs).redirectConsoleOutputs`
### What changes were proposed in this pull request?
This PR aims to rename `spark.executor.log.redirectConsoleOutputs` to
`spark.executor.logs.redirectConsoleOutputs` to be consistent with the existing
executor log configurations like the following.
```
spark.executor.logs.rolling.strategy
spark.executor.logs.rolling.time.interval
spark.executor.logs.rolling.maxSize
spark.executor.logs.rolling.maxRetainedFiles
spark.executor.logs.rolling.enableCompression
spark.executor.logs.redirectConsoleOutputs
```
### Why are the changes needed?
Although SPARK-52426 introduced two configurations consistently in the PR,
Apache Spark has different namespaces for Driver and Executor which are
`spark.driver.log.*` and `spark.executor.logs.*` respectively. Instead of
introducing a new config namespace, `spark.executor.log`, for this single new
configuration, we had better follow the existing naming rule.
- https://github.com/apache/spark/pull/51130
```
spark.driver.log.redirectConsoleOutputs
spark.executor.log.redirectConsoleOutputs
```
### Does this PR introduce _any_ user-facing change?
No this is not released yet.
### How was this patch tested?
Pass the CIs. Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #52624 from dongjoon-hyun/SPARK-53923.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
core/src/main/scala/org/apache/spark/internal/config/package.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/core/src/main/scala/org/apache/spark/internal/config/package.scala
b/core/src/main/scala/org/apache/spark/internal/config/package.scala
index 94fe31e1cd8c..9a4ef1fbd7f6 100644
--- a/core/src/main/scala/org/apache/spark/internal/config/package.scala
+++ b/core/src/main/scala/org/apache/spark/internal/config/package.scala
@@ -2889,7 +2889,7 @@ package object config {
.createWithDefault(Seq("stdout", "stderr"))
private[spark] val EXEC_REDIRECT_CONSOLE_OUTPUTS =
- ConfigBuilder("spark.executor.log.redirectConsoleOutputs")
+ ConfigBuilder("spark.executor.logs.redirectConsoleOutputs")
.doc("Comma-separated list of the console output kind for executor that
needs to redirect " +
"to logging system. Supported values are `stdout`, `stderr`. It only
takes affect when " +
s"`${PLUGINS.key}` is configured with
`org.apache.spark.deploy.RedirectConsolePlugin`.")
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
