Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/1845#issuecomment-52591994
Hey Andrew I took a pass. Overall I think this is the best approach we can
do right now (using a bootstrap java process). I felt like there were several
attempts to overly generalize this that probably aren't worth doing now. I
think it's fine to just read the environment variables directly rather than
going through options. Also, the way it is now it adds some complexity where we
try to merge options. This could make some really confusing outcomes for users,
I'd just defer to the normal precedence we have in the rest of the spark submit
options where the flags take script precedence over values in the config file.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
