Luca Canali created SPARK-22190:
-----------------------------------
Summary: Add Spark executor task metrics to Dropwizard metrics
Key: SPARK-22190
URL: https://issues.apache.org/jira/browse/SPARK-22190
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.2.0
Reporter: Luca Canali
Priority: Minor
I would like to propose to expose Spark executor task metrics using the
Dropwizard metrics. I have developed a simple implementation and run a few
tests using Graphite sink and Grafana visualization and this appears to me a
good source of information for monitoring and troubleshooting the progress of
Spark jobs. I attach a screenshot of an example graph generated with Grafana.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]