yes the webui works on yarn. You should be able to go to the Yarn ResourceManager UI and it will have a link to the web UI for a running spark application. You can also set it up to save the history and view it after it has finished. History info can be found here: Monitoring and Instrumentation - Spark 1.0.2 Documentation Monitoring and Instrumentation - Spark 1.0.2 Documentation Monitoring and Instrumentation There are several ways to monitor Spark applications: web UIs, metrics, and external instrumentation. Web Interfaces View on spark.apache.org Preview by Yahoo
Tom On Tuesday, August 19, 2014 12:49 AM, Debasish Das <debasish.da...@gmail.com> wrote: Hi, We are running the snapshots (new spark features) on YARN and I was wondering if the webui is available on YARN mode... The deployment document does not mention webui on YARN mode... Is it available ? Thanks. Deb
