Re: Spark Web UI in Mesos mode

2014-09-08 Thread Wonha Ryu
Hi, Spark master web UI is only for "standalone" clusters, where cluster resources are managed by Spark, not other resource managers. Mesos master's default port is 5050. Within Mesos, a Spark application is considered as one of many frameworks, so there's no Spark-specific support like accessing

Re: Web UI

2014-09-03 Thread Wonha Ryu
r the help! But I tried starting with “–master local[4]” and > when I load http://localhost:4040/json I just get forwarded to > http://localhost:4040/stages/, and it’s all human-readable HTML, no JSON. > > > > Best, > > Oliver > > > > > > *From:* Wonh

Re: Web UI

2014-09-03 Thread Wonha Ryu
Hi Oliver, Spark standalone master and worker support '/json' endpoint in web UI, which returns some of the information in JSON format. I wasn't able to find relevant documentation, though. - Wonha On Wed, Sep 3, 2014 at 12:12 PM, Ruebenacker, Oliver A < oliver.ruebenac...@altisource.com> wrote

Gathering Information about Standalone Cluster

2014-08-11 Thread Wonha Ryu
Hey all, Is there any kind of API to access information about resources, executors, and applications in a standalone cluster displayed in the web UI? Currently I'm using 1.0.x, but interested in experimenting with bleeding edge. Thanks, Wonha