Ondrej Kokes created SPARK-24516:
------------------------------------
Summary: PySpark Bindings for K8S - make Python 3 the default
Key: SPARK-24516
URL: https://issues.apache.org/jira/browse/SPARK-24516
Project: Spark
Issue Type: Improvement
Components: Kubernetes, PySpark
Affects Versions: 2.4.0
Reporter: Ondrej Kokes
Initial PySpark-k8s bindings have just been resolved (SPARK-23984), but the
default Python version there is 2. While you can override this by setting it to
3, I think we should have sensible defaults.
Python 3 has been around for ten years and is the clear successor, Python 2 has
only 18 months left in terms of support. There isn't a good reason to suggest
Python 2 should be used, not in 2018 and not when both versions are supported.
The relevant commit [is
here|https://github.com/apache/spark/commit/1a644afbac35c204f9ad55f86999319a9ab458c6#diff-6e882d5561424e7e6651eb46f10104b8R194],
the version is also [in the
documentation|https://github.com/apache/spark/commit/1a644afbac35c204f9ad55f86999319a9ab458c6#diff-b5527f236b253e0d9f5db5164bdb43e9R643].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
