In the script / environment which launches your Spark driver, try setting the SPARK_PUBLIC_DNS environment variable to point to a publicly-accessible hostname.
See https://spark.apache.org/docs/latest/configuration.html#environment-variables for more details. This environment variable also affects the Spark Standalone master and worker web UIs as well and will cause them to advertise a public hostname in URLs and UIs. On Mon, Dec 21, 2015 at 10:13 AM, carlilek <carli...@janelia.hhmi.org> wrote: > I administer an HPC cluster that runs Spark clusters as jobs. We run Spark > over the backend network (typically used for MPI), which is not accessible > outside the cluster. Until we upgraded to 1.5.1 (from 1.3.1), this did not > present a problem. Now the Application Detail UI link is returning the IP > address of the backend network of the driver machine rather than that > machine's hostname. Consequentially, users cannot access that page. I am > unsure what might have changed or how I might change the behavior back. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Applicaiton-Detail-UI-change-tp25756.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
