Github user gurvindersingh commented on the issue:
https://github.com/apache/spark/pull/13950
As I mentioned in my last comment, the current code assume that the conf
value is set on all components. E.g. Otherwise how you expect reverseProxyUrl
to work in spark-shell, every `SparkContext`has its own conf. As worker and
application has reference to master but seems only using RpcEndpoint, so not
possible to access the variable (as they usually are on different machines). So
if you can suggest any way of passing the proxy and proxyUrl config to worker
and application, I can implement it. I have no strong opinion on this, for my
use case I use docker images and this config value is set in the base image
from where master, worker and driver are built so they all have this conf value
in them.
Anyway as I said, point me in the direction of sharing the config/other
method to access proxy & proxyUrl on wokers and applications, I will add
support for the same.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
