Github user gurvindersingh commented on the issue:
https://github.com/apache/spark/pull/13950
@ajbozarth That is strange. Here is the steps I used to test and its
working on my side
```
1. git clone https://github.com/apache/spark.git
2. edit .git/config to allow fetching pr and fetch pr
3. git checkout origin/pr/13950
4. build/sbt clean package
5. duplicate spark-defaults.conf.template to conf and add this option
spark.ui.reverseProxy true
6. Run Spark local cluster as
- ./bin/spark-class org.apache.spark.deploy.master.Master
- ./bin/spark-class org.apache.spark.deploy.worker.Worker
spark://<spark-master-ip>:7077
- ./bin/spark-shell --master=spark://<spark-master-ip>:7077
7. Ran sample task sc.parallelize(1 to 1000).reduce(_+_)
8 Go to http://<spark-master-ip>:8080
9. There you can go to application UI by going to application page and it
is proxied from master ip as http://<spark-master-ip>:8080/proxy/app-id/
10. Similarly on Stagetab and executors tab, I am able to access the links
url as http://<spark-master-ip>:8080/proxy/worker-id/logPage/....
```
Now To test running the spark master itself behind another proxy, stop the
current cluster.
```
1. Start a local proxy any tool you prefer.
- e.g. ssh -L 8000:localhost:8080 localhost
2. Enter new option in conf file as spark.ui.reverseProxyUrl
http://localhost:8000 (enter the proxy address here)
3. Start the cluster similar to step above and run sample task
4. Go to http://localhost:8000/ and you can access the master, worker and
application UI all through this URL without need to go to their UIs directly.
```
Regarding access to Master url for printing info for spark-shell, the
reverseProxyUrl is not always set. As it is not necessary to run master itself
behind reverse proxy. So can not use that to print information reliably about
app UI url.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
