Ondrej Kokes created SPARK-24516: ------------------------------------ Summary: PySpark Bindings for K8S - make Python 3 the default Key: SPARK-24516 URL: https://issues.apache.org/jira/browse/SPARK-24516 Project: Spark Issue Type: Improvement Components: Kubernetes, PySpark Affects Versions: 2.4.0 Reporter: Ondrej Kokes
Initial PySpark-k8s bindings have just been resolved (SPARK-23984), but the default Python version there is 2. While you can override this by setting it to 3, I think we should have sensible defaults. Python 3 has been around for ten years and is the clear successor, Python 2 has only 18 months left in terms of support. There isn't a good reason to suggest Python 2 should be used, not in 2018 and not when both versions are supported. The relevant commit [is here|https://github.com/apache/spark/commit/1a644afbac35c204f9ad55f86999319a9ab458c6#diff-6e882d5561424e7e6651eb46f10104b8R194], the version is also [in the documentation|https://github.com/apache/spark/commit/1a644afbac35c204f9ad55f86999319a9ab458c6#diff-b5527f236b253e0d9f5db5164bdb43e9R643]. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org