Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/9051#issuecomment-148576976
@andrewor14 did you see @tgravescs 's comment saying that (1) and (2) don't
really help his use case? He wants an easy way to spot stages that took a lot
of resources, and stage service time isn't a good measure of that -- since
service time can be small if there was a lot of parallelism, or large if there
wasn't much parallelism (although I do agree that the current duration is
misleading, but fixing that won't solve this issue).
I'd slightly prefer total task time (i.e., sum of times across all tasks)
or an option where we show average and max task time, because just showing the
max seems a little weird to me.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
