Repository: spark Updated Branches: refs/heads/master b2e325625 -> 19ada15d1
[SPARK-24516][K8S] Change Python default to Python3 ## What changes were proposed in this pull request? As this is targeted for 3.0.0 and Python2 will be deprecated by Jan 1st, 2020, I feel it is appropriate to change the default to Python3. Especially as these projects [found here](https://python3statement.org/) are deprecating their support. ## How was this patch tested? Unit and Integration tests Author: Ilan Filonenko <[email protected]> Closes #22810 from ifilonenko/SPARK-24516. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/19ada15d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/19ada15d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/19ada15d Branch: refs/heads/master Commit: 19ada15d1b15256de4e3bf2f4b17d87ea0d65cc3 Parents: b2e3256 Author: Ilan Filonenko <[email protected]> Authored: Wed Oct 24 23:29:47 2018 -0700 Committer: Felix Cheung <[email protected]> Committed: Wed Oct 24 23:29:47 2018 -0700 ---------------------------------------------------------------------- docs/running-on-kubernetes.md | 2 +- .../core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/19ada15d/docs/running-on-kubernetes.md ---------------------------------------------------------------------- diff --git a/docs/running-on-kubernetes.md b/docs/running-on-kubernetes.md index d629ed3..60c9279 100644 --- a/docs/running-on-kubernetes.md +++ b/docs/running-on-kubernetes.md @@ -816,7 +816,7 @@ specific to Spark on Kubernetes. </tr> <tr> <td><code>spark.kubernetes.pyspark.pythonVersion</code></td> - <td><code>"2"</code></td> + <td><code>"3"</code></td> <td> This sets the major Python version of the docker image used to run the driver and executor containers. Can either be 2 or 3. </td> http://git-wip-us.apache.org/repos/asf/spark/blob/19ada15d/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ---------------------------------------------------------------------- diff --git a/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala b/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala index c2ad80c..fff8fa4 100644 --- a/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala +++ b/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala @@ -223,7 +223,7 @@ private[spark] object Config extends Logging { .stringConf .checkValue(pv => List("2", "3").contains(pv), "Ensure that major Python version is either Python2 or Python3") - .createWithDefault("2") + .createWithDefault("3") val KUBERNETES_KERBEROS_KRB5_FILE = ConfigBuilder("spark.kubernetes.kerberos.krb5.path") --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
