Ah, yes, it will use private IPs, so you may need to update your FoxyProxy
settings to include the private IPs in the regex as well as the public IPs.
Also, yes, for completed applications you may use the Spark History Server
on port 18080. The YARN ProxyServer will automatically redirect to the
Thank you!
It seems that the the history server at port 18080 also gives access to the
Spark GUI as below
Following your tip, I see that the YARN ResourceManager GUI on 8088 indeed
has that ApplicationMaster link, though to a private rather than public IP;
replacing IPs brings me to the same
Hi Joshua,
What's the Spark version and what's your browser ?
I just tried on Spark 1.6-SNAPSHOT with firefox and it works fine.
Thanks
Regards
JB
On 10/13/2015 02:17 PM, Joshua Fox wrote:
I am accessing the Spark Jobs Web GUI, running on AWS EMR.
I can access this webapp (port 4040 as per
Joshua,
Since Spark is configured to run on YARN in EMR, instead of viewing the
Spark application UI at port 4040, you should instead start from the YARN
ResourceManager (on port 8088), then click on the ApplicationMaster link
for the Spark application you are interested in. This will take you to
Thanks for the update Joshua.
Let me try with Spark 1.4.1.
I keep you posted.
Regards
JB
On 10/13/2015 04:17 PM, Joshua Fox wrote:
* Spark 1.4.1, part of EMR emr-4.0.0
* Chrome Version 41.0.2272.118 (64-bit) on Ubuntu
On Tue, Oct 13, 2015 at 3:27 PM, Jean-Baptiste Onofré
- Spark 1.4.1, part of EMR emr-4.0.0
- Chrome Version 41.0.2272.118 (64-bit) on Ubuntu
On Tue, Oct 13, 2015 at 3:27 PM, Jean-Baptiste Onofré
wrote:
> Hi Joshua,
>
> What's the Spark version and what's your browser ?
>
> I just tried on Spark 1.6-SNAPSHOT with firefox