this is set up to save history to the timeline service, something which works provided the applications are all set up to publish there too.
On 18 Feb 2016, at 22:22, Sutanu Das <sd2...@att.com<mailto:sd2...@att.com>> wrote: Hi Community, Challenged with Spark issues with Hortonworks (HDP 2.3.2_Spark 1.4.1) – The Spark History Server is NOT showing the Spark Running Jobs in Local Mode The local-host:4040/app/v1 is ALSO not working How can I look at my local Spark job? # Generated by Apache Ambari. Fri Feb 5 00:37:06 2016 spark.history.kerberos.keytab none spark.history.kerberos.principal none this tells the history server to use ATS spark.history.provider org.apache.spark.deploy.yarn.history.YarnHistoryProvider spark.history.ui.port 18080 spark.yarn.containerLauncherMaxThreads 25 spark.yarn.driver.memoryOverhead 2048 spark.yarn.executor.memoryOverhead 2048 spark.yarn.historyServer.address has-dal-0001.corp.wayport.net<http://has-dal-0001.corp.wayport.net/>:18080 spark.yarn.max.executor.failures 3 spark.yarn.preserve.staging.files false spark.yarn.queue default spark.yarn.scheduler.heartbeat.interval-ms 5000 this says: publish via it spark.yarn.services org.apache.spark.deploy.yarn.history.YarnHistoryService spark.yarn.submit.file.replication 3 There's some asynchronous publishing, so things don't appear immediately as the app starts, and the updates can take a bit to trickle out, but things look set up right to work both ways. I'll email you off the list and see if I can help track down what's happening -steve
