Github user ajbozarth commented on the issue:
https://github.com/apache/spark/pull/13950
Ah I know what the issue is now. Your implementation needs the
`spark.ui.reverseProxy` conf set on every worker node to function. Since conf
files aren't included in tar balls my workers didn't have those configs set (I
used tar ball distributions of spark on my workers and a git clone on my
master). From my experience many spark clusters don't set conf files on their
workers, you may want to instead pass the value of `spark.ui.reverseProxy` to
each worker in some way rather than looking it up in the workers confs (this
happens in `ExecutorRunner.scala`).
@vanzin what's your opinion on this? Is it ok to assume the confs are set
for each slave or should you assume they aren't?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
