Hello, I've started an EMR cluster (Elastic MapReduce). Is the an way to fix the following problem (which i guess has been asked before).
In this scenario I'm not using a socks proxy (it all works with socks proxy), instead i've opened up the ports for the security groups that the master and slaves belong to 1. The public dns of the master is ec2-52-4-16-55.compute-1.amazonaws.com 2. the Resource Manager is here http://ec2-52-4-16-55.compute-1.amazonaws.com:9026/cluster 3. Now, when i click on a application(i would like to see the logs) http://ec2-52-4-16-55.compute-1.amazonaws.com:9026/cluster/app/application_1427740665582_0014 4. The logs link on this page takes me to http://ip-172-31-48-128.ec2.internal:9035/node/containerlogs/container_1427740665582_0014_01_000001/hadoop But this fails. Of course if i replace that address with the public one i get http://ec2-52-4-142-189.compute-1.amazonaws.com:9035/node/containerlogs/container_1427740665582_0014_01_000001/hadoop and this works. My Question: Is there a setting in the conf files so that the Hadoop Web UI uses the public ip address for all links as opposed to the internal addresses? Cheers Saptarshi
