[
https://issues.apache.org/jira/browse/SPARK-11185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072870#comment-15072870
]
Derek Dagit commented on SPARK-11185:
-------------------------------------
[~pwendell], [~kayousterhout], [~andrewor14], [~irashid]
Let's figure out how we might address this use case. Do we think there is a way
to present this information without cluttering the UI?
> Add more task metrics to the "all Stages Page"
> ----------------------------------------------
>
> Key: SPARK-11185
> URL: https://issues.apache.org/jira/browse/SPARK-11185
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 1.5.1
> Reporter: Thomas Graves
>
> The "All Stages Page" on the History page could have more information about
> the stage to allow users to quickly see which stage potentially has long
> tasks. Indicator or skewed data or bad nodes, etc.
> Currently to get this information you have to click on every stage. If you
> have a hundreds of stages this can be very cumbersome.
> For instance pulling out the max task time and the median to the all stages
> page would allow me to see the difference and if the max task time is much
> greater then the median this stage may have had tasks with problems.
> We already had some discussion about this under
> https://github.com/apache/spark/pull/9051
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
