Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/1825#issuecomment-51638397
@liancheng The only slightly complicated thing is the pyspark shell is
launched in python, not bash, so we need to separate out the configs there as
well, which adds a third source of all the spark-submit options. This may be
fine as a temporary solution, seeing that the alternative of enumerating all of
ipython's options is less manageable.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]