Just to add why tunneling is not a good practice sometime: There could be some other ports/apps depeneding on other processes running on different ports. Lets say a web app running on port 8080 pulling info from other processes through rest api which will fail here since you only tunnel for 8080 and hence the ui/data will look ugly. On 9 Feb 2015 11:57, "Akhil Das" <ak...@sigmoidanalytics.com> wrote:
> Just make sure all ports (0-65535) are accessible across your cluster. And > you may also want to open these ports for your IP address instead of > tunneling: > > 8080, 8081, 18080, 19999, 50030, 50070, 60070, 4040-4045 > > > Thanks > Best Regards > > On Sat, Feb 7, 2015 at 10:38 AM, yangqch <davidyang...@gmail.com> wrote: > >> Hi folks, >> >> I am new to spark. I just get spark 1.2 to run on emr ami 3.3.1 (hadoop >> 2.4). >> I ssh to emr master node and submit the job or start the shell. Everything >> runs well except the webUI. >> >> In order to see the UI, I used ssh tunnel which forward my dev machine >> port >> to emr master node webUI port. >> >> When I open the webUI, at the very beginning of the application (during >> the >> spark launch time), the webUI is as nice as shown in many spark docs. >> However, once the YARN AmIpfilter started to work, the webUI becomes very >> ugly. No pictures can be displayed, only text can be shown (just like you >> view it in lynx). Meanwhile, in spark shell, it pops up >> "amfilter.AmIpFilter >> (AmIpFilter.java:doFilter(157)) - Could not find proxy-user cookie, so >> user >> will not be set”. >> >> Can anyone give me some help? Thank you! >> >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/WebUI-on-yarn-through-ssh-tunnel-affected-by-AmIpfilter-tp21540.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
