Erik Selin created SPARK-12268:
----------------------------------
Summary: pyspark shell uses execfile which breaks python3
compatibility
Key: SPARK-12268
URL: https://issues.apache.org/jira/browse/SPARK-12268
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 1.5.2, 1.6.1
Reporter: Erik Selin
The pyspark shell allows custom start scripts to run using the PYTHONSTARTUP
environment variable. The value specified there will get run at the end of the
shell startup by a call to execfile. However, execfile is deprecated in python3
and thus this does not work for python3 users. The simply fix is to follow the
2to3 recommendation and read, compile and exec the file manually as per this
PR: https://github.com/apache/spark/pull/10255
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
