tgravescs commented on issue #26843: [SPARK-30209][SQL][WEB-UI] Display stageId, attemptId and taskId for max metrics in Spark UI. URL: https://github.com/apache/spark/pull/26843#issuecomment-572823588 I'm definitely open to ideas on improving the readability. We could split it off into its own () after min,med,max for instance. I don't agree with your complaint that we are exposing internal details, that is all the UI does. Its for the user, spark dev, spark support people to be able to see the details and debug it as necessary. The mapping of SQL operations to stages right now is terrible. This helps some as helps with the exec node to stage it ran in mapping, it will also help you debug issues where some task took much longer then others (max value). You can a lot more easily pinpoint that task. Another idea we could look at would be adding a radio button to disable it by default and then have it show up. I'm not sure how hard that would be but something we could investigate.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
