Thomas Graves created SPARK-11185:
-------------------------------------
Summary: Add more task metrics to the "all Stages Page"
Key: SPARK-11185
URL: https://issues.apache.org/jira/browse/SPARK-11185
Project: Spark
Issue Type: Improvement
Components: Web UI
Affects Versions: 1.5.1
Reporter: Thomas Graves
The "All Stages Page" on the History page could have more information about the
stage to allow users to quickly see which stage potentially has long tasks.
Indicator or skewed data or bad nodes, etc.
Currently to get this information you have to click on every stage. If you
have a hundreds of stages this can be very cumbersome.
For instance pulling out the max task time and the median to the all stages
page would allow me to see the difference and if the max task time is much
greater then the median this stage may have had tasks with problems.
We already had some discussion about this under
https://github.com/apache/spark/pull/9051
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
