[ https://issues.apache.org/jira/browse/SPARK-44198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod KC updated SPARK-44198: ----------------------------- Description: Currently, the *sc.setLogLevel()* method only sets the log level on the Spark driver, failing to reflect the desired log level on the executors. This inconsistency can lead to difficulties in debugging and monitoring Spark applications, as log messages from the executors may not align with the expected log level set on the user code. (was: Currently, the *sc.logLevel()* method only sets the log level on the Spark driver, failing to reflect the desired log level on the executors. This inconsistency can lead to difficulties in debugging and monitoring Spark applications, as log messages from the executors may not align with the expected log level set on the user code.) > Inconsistent Log Level Setting between Spark Driver and Executors > ----------------------------------------------------------------- > > Key: SPARK-44198 > URL: https://issues.apache.org/jira/browse/SPARK-44198 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 3.5.0 > Reporter: Vinod KC > Priority: Minor > > Currently, the *sc.setLogLevel()* method only sets the log level on the Spark > driver, failing to reflect the desired log level on the executors. This > inconsistency can lead to difficulties in debugging and monitoring Spark > applications, as log messages from the executors may not align with the > expected log level set on the user code. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org