Kay Ousterhout created SPARK-6418:
-------------------------------------
Summary: Add simple per-stage visualization to the UI
Key: SPARK-6418
URL: https://issues.apache.org/jira/browse/SPARK-6418
Project: Spark
Issue Type: Improvement
Reporter: Kay Ousterhout
Assignee: Kay Ousterhout
Visualizing how tasks in a stage spend their time can be very helpful to
understanding performance. Many folks have started using the visualization
tools here: https://github.com/kayousterhout/trace-analysis (see the README at
the bottom) to analyze their jobs after they've finished running, but it would
be great if this functionality were natively integrated into Spark's UI.
I'd propose adding a relatively simple visualization to the stage detail page,
that's hidden by default but that users can view by clicking on a drop-down
menu. The plan is to implement this using D3; a mock up of how this would look
(that uses D3) is attached.
This is intended to be a much simpler and more limited version of SPARK-3468
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
