[
https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14701185#comment-14701185
]
Piotr Migdał commented on SPARK-9705:
-------------------------------------
Thanks, now it works perfectly!
(Before I tried to solve it that was but I missed that my `python` links to a
different version of python than my `ipython`.)
As a side note, right now my preferred way to lunch Spark in IPython Notebook
is with `findspark` (https://github.com/minrk/findspark) - as IPython Notebook
can be lunched in a normal way (`ipython notebook`) and `pyspark` can be used
as a normal library.
However, as I see it does not support setting Python version for Spark workers
(at least - not right now).
Again, I thought it was a problem with Spark/PySpark, but it was with the
`findspark` library.
> outdated Python 3 and IPython information
> -----------------------------------------
>
> Key: SPARK-9705
> URL: https://issues.apache.org/jira/browse/SPARK-9705
> Project: Spark
> Issue Type: Documentation
> Components: Documentation, PySpark
> Affects Versions: 1.4.0, 1.4.1, 1.5.0
> Reporter: Piotr Migdał
> Priority: Blocker
> Labels: documentation
> Original Estimate: 0.25h
> Remaining Estimate: 0.25h
>
> https://issues.apache.org/jira/browse/SPARK-4897 adds Python 3.4 support to
> 1.4.0 and above, but the official docs (1.4.1, but the same is for 1.4.0)
> says explicitly:
> "Spark 1.4.1 works with Python 2.6 or higher (but not Python 3)."
> Affected:
> https://spark.apache.org/docs/1.4.0/programming-guide.html
> https://spark.apache.org/docs/1.4.1/programming-guide.html
> There are some other Python-related things, which are outdated, e.g. this
> line:
> "For example, to launch the IPython Notebook with PyLab plot support:"
> (At least since IPython 3.0 PyLab/Matplotlib support happens inside a
> notebook; and the line "--pylab inline" is already removed.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
