cloud-fan commented on a change in pull request #27849: [SPARK-31081][UI][SQL]
Make the display of stageId/stageAttemptId/taskId of sql metrics configurable
in UI
URL: https://github.com/apache/spark/pull/27849#discussion_r391424573
##########
File path:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
##########
@@ -135,6 +135,14 @@ object StaticSQLConf {
.intConf
.createWithDefault(1000)
+ val DISPLAY_TASK_ID_FOR_MAX_METRIC =
+ buildStaticConf("spark.sql.ui.displayTaskInfoForMaxMetric")
+ .doc("If turn on, Spark will display stageId-stageAttemptId-taskId of
the max metrics to " +
+ "tell where the max value comes from. It's useful to help debug job
quicker.")
+ .version("3.0.0")
Review comment:
This is a UI issue to me. The SQL web UI is really hard to read now with the
stage id stuff. Ideally, we should revisit #26843 and think of a better way to
improve readability. But no one has proposed an idea yet.
This PR disables the stage id stuff, which seems like a good compromise for
3.0: we keep the UI unchanged, but for people who really need the stage id
info, they can still enable it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
