dongjoon-hyun commented on a change in pull request #27849:
[SPARK-31081][UI][SQL] Make the display of stageId/stageAttemptId/taskId of sql
metrics configurable in UI
URL: https://github.com/apache/spark/pull/27849#discussion_r391186535
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
##########
@@ -135,6 +135,14 @@ object StaticSQLConf {
.intConf
.createWithDefault(1000)
+ val DISPLAY_TASK_ID_FOR_MAX_METRIC =
+ buildStaticConf("spark.sql.ui.displayTaskInfoForMaxMetric")
+ .doc("If turn on, Spark will display stageId-stageAttemptId-taskId of
the max metrics to " +
+ "tell where the max value comes from. It's useful to help debug job
quicker.")
+ .version("3.0.0")
Review comment:
@Ngone51 .
Since SPARK-31081 is filed as an `Improvement`, this should be `3.1.0`.
If you want to consider this as a bug or regression at 3.0.0, you had better
change JIRA first.
cc @rxin since he is the release manager of 3.0.0 (also cc @gatorsmile ).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
