Spark REST APIs not working when application deployed in CLUSTER mode

Hi all, I am able to make the REST API calls in client mode but when I run the application in Cluster mode, I am getting the below exception in driver logs: java.lang.IncompatibleClassChangeError: com.sun.jersey.json.impl.provider.entity.JSONRootElementProvider and

Unable to get json for application jobs in spark 1.5.0

Hi all, I am trying to get the json for all the jobs running within my application whose UI port is 4040. I am making an HTTP GET request at the following URI: http://172.26.32.143:4040/api/v1/applications/gauravpipe/jobs But getting the following service unavailable exception: Error 503

Spark Monitoring to get Spark GCs and records processed

Hi all, I want to monitor Spark to get the following: 1. All the GC stats for Spark JVMs 2. Records successfully processed in a batch 3. Records failed in a batch 4. Getting historical data for batches,jobs,stages,tasks,etc, Please let me know how can I get these information in Spark. Regards,

Re: How to enable MetricsServlet sink in Spark 1.5.0?

Hi Saisai, As I mentioned, I am getting very less information using the /metrics/json URI and *also the /metrics/master/json and /metrics/applications/json URIs do not seem to be working*. Please verify the following at your end. The metrics dumped using /metrics/json is as folllows: {