[
https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod KC updated SPARK-44198:
-----------------------------
Description: Currently, the *sc.setLogLevel()* method only sets the log
level on the Spark driver, failing to reflect the desired log level on the
executors. This inconsistency can lead to difficulties in debugging and
monitoring Spark applications, as log messages from the executors may not align
with the expected log level set on the user code. (was: Currently, the
*sc.logLevel()* method only sets the log level on the Spark driver, failing to
reflect the desired log level on the executors. This inconsistency can lead to
difficulties in debugging and monitoring Spark applications, as log messages
from the executors may not align with the expected log level set on the user
code.)
> Inconsistent Log Level Setting between Spark Driver and Executors
> -----------------------------------------------------------------
>
> Key: SPARK-44198
> URL: https://issues.apache.org/jira/browse/SPARK-44198
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.5.0
> Reporter: Vinod KC
> Priority: Minor
>
> Currently, the *sc.setLogLevel()* method only sets the log level on the Spark
> driver, failing to reflect the desired log level on the executors. This
> inconsistency can lead to difficulties in debugging and monitoring Spark
> applications, as log messages from the executors may not align with the
> expected log level set on the user code.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
