Github user shearerp commented on the pull request:
https://github.com/apache/spark/pull/12528#issuecomment-212593947
The problem with IPYTHON and IPYTHON_OPTS is, it's not quite clear how to
get it to work as expected for both users of IPython shell and IPython
notebook. The latter has been deprecated in favor of the Jupyter notebook, and
with this change, the user's choice has become a bit fragile and unclear.
The other option is to have
- IPYTHON=1 by itself means the IPython shell
- you get the notebook if IPYTHON_OPTS starts with "notebook".
Specifically, the Jupyter notebook if it's installed, the IPython notebook if
it's not.
This requires a bit more convoluted logic in the pyspark shell script, but
maybe the backward compatibility is worth it?
See the JIRA discussion for more info:
https://issues.apache.org/jira/browse/SPARK-13973
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
