Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/7739#issuecomment-165466946
I'm a bit on the fence about this. Its kind of bringing us full circle to
what SPARK used to have when they had env variables, most of those applied
across everything. I think we chose to do them separate so users had the
option of setting different ones. I see the case for this makes it easier for
users in some cases but I also see it as possibly confusing and just more
maintenance and complexity in the spark code. My other concern here is now this
has different semantics then extraJavaOptions and extraLibraryPath as they
won't have a common option.
cc @pwendell as I think he originally added the configs to see if he
remember any discussion around common ones.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
