AngersZhuuuu commented on issue #28061: [SPARK-31270][CORE] Expose executor metrics in task detail table in StageLevel URL: https://github.com/apache/spark/pull/28061#issuecomment-609606587 > So I wonder it's not helpful that those metrics are displayed for each task. Such as Stage Executor Metrics, it show each executors's peak memory during this stage, but there is still a problem that during this stage, other stage's task will run in same executor too when executor's core num is bigger than 1. We just show each task's running status about JVM, as an SRE, we need to know task running status as many as possible. Any one of these metrics can help the user find problems and provide help.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
