Kevin Mader created SPARK-4800:
----------------------------------
Summary: RDD Preview Feature in WebUI
Key: SPARK-4800
URL: https://issues.apache.org/jira/browse/SPARK-4800
Project: Spark
Issue Type: Improvement
Components: Spark Core, Web UI
Reporter: Kevin Mader
For debugging and monitoring analysis, it would be very useful to have an RDD
preview feature that would show 'previews' for persistent RDDs. These previews
could be very simple for known types DoubleRDD (mean, std, min, max) and could
be optionally extended by implementing a sub-class (showing histograms,
plotting Key-value pairs, etc)
The component would add an additional load if used to the Context since the RDD
"first", "count", etc methods would need to be invoked, but it could be kept
fairly lightweight.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
