[
https://issues.apache.org/jira/browse/SPARK-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695273#comment-14695273
]
Piotr Migdał commented on SPARK-9705:
-------------------------------------
I added it as I am having problems with running it on Python 3.4 (and it runs
smoothly on 2.7). So I was not sure whether it's a problem with my
installation/configuration or it isn't supported.
("Exception: Python in worker has different version 2.7 than that in driver
3.4, PySpark cannot run with different minor versions")
I was told by Josh Rosen that 3.4 is supported. However, it makes to sense for
me to write docs if I cannot run it on mine computer (maybe there are some
options needed?). The error is the same no matter if I run it from command line
(specifying paths to Python 3 libraries) or through a preferred option for me -
findspark in IPython Notebook.
> outdated Python 3 and IPython information
> -----------------------------------------
>
> Key: SPARK-9705
> URL: https://issues.apache.org/jira/browse/SPARK-9705
> Project: Spark
> Issue Type: Documentation
> Components: Documentation, PySpark
> Affects Versions: 1.4.0, 1.4.1, 1.5.0
> Reporter: Piotr Migdał
> Priority: Blocker
> Labels: documentation
> Original Estimate: 0.25h
> Remaining Estimate: 0.25h
>
> https://issues.apache.org/jira/browse/SPARK-4897 adds Python 3.4 support to
> 1.4.0 and above, but the official docs (1.4.1, but the same is for 1.4.0)
> says explicitly:
> "Spark 1.4.1 works with Python 2.6 or higher (but not Python 3)."
> Affected:
> https://spark.apache.org/docs/1.4.0/programming-guide.html
> https://spark.apache.org/docs/1.4.1/programming-guide.html
> There are some other Python-related things, which are outdated, e.g. this
> line:
> "For example, to launch the IPython Notebook with PyLab plot support:"
> (At least since IPython 3.0 PyLab/Matplotlib support happens inside a
> notebook; and the line "--pylab inline" is already removed.)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
