Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/18370
so the issue here is that the gateway boxes have a different hadoop config
on purpose because from those boxes you need one proxy but on the actual yarn
nodes you don't need the proxy?
I thought someone had the exact other issue where they wanted the gateway
configs to work over the server side configs. I guess that is fine if its not
final.
I agree with you that its a bit hacky and not very nice we have to hardcode
the files.
I was actually thinking of the second approach you tried. Like you mention
it will definitely pull in all the defaults so that might be larger then the
config files but its going to depend on that setup. How large is that file (in
KB/MB)?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
