And here's some more info on Spark Metrics https://www.slideshare.net/JayeshThakrar/apache-bigdata2017sparkprofiling
From: Maximiliano Felice <[email protected]> Date: Monday, January 8, 2018 at 8:14 AM To: Irtiza Ali <[email protected]> Cc: <[email protected]> Subject: Re: Spark Monitoring using Jolokia Hi! I don't know very much about them, but I'm currently working in posting custom metrics into Graphite. I found useful the internals described in this library: https://github.com/groupon/spark-metrics<https://github.com/groupon/spark-metrics> Hope this at least can give you a hint. Best of luck! 2018-01-08 10:55 GMT-03:00 Irtiza Ali <[email protected]<mailto:[email protected]>>: Hello everyone, I am building a monitoring tool for the spark, for that I needs sparks metrics. I am using jolokia to get the metrics. I have a question that: Can I get all the metrics provided by the spark rest api using the Jolokia? How the spark rest api get the metrics internally? Thanks
