Re: SparkWebUI and Master URL on EC2

2016-07-21 Thread Ismaël Mejía
Hello, If you are using EMR you probably need to create a SSH tunnel so you can access the web ports of the master instance. https://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-ssh-tunnel.html Also verify that your EMR cluster is not behind a private VPC, in this case you

Re: SparkWebUI and Master URL on EC2

2016-07-21 Thread Jacek Laskowski
Hi, What's in the logs of spark-shell? There should be the host and port of web UI. what the public IP of the host where you execute spark-shell? Use it for 4040. I don't think you use Spark Standalone cluster (the other address with 8080) if you simply spark-shell (unless you've got spark.master

SparkWebUI and Master URL on EC2

2016-07-20 Thread KhajaAsmath Mohammed
Hi, I got an access to spark cluser and have intstatiated spark-shell on aws using command $spark-shell. Spark shell is started successfully but I am looking to access WebUI and Master URL. does anyone know how to access that in AWS. I tried http://IPMaster:4040 and http://IpMaster:8080 but it