[
https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786312#comment-17786312
]
Dongjoon Hyun commented on SPARK-45390:
---------------------------------------
Apache Spark 3.5 is released first on 2023-09-13 and Python 3.12 is released on
2023-10-02.
We don't promise to support all future unreleased Python versions, [~nchammas].
As you pointed out, this is designed to be an improvement for Apache Spark
4.0.0 only.
BTW, in order to support Python 3.12 in Apache Spark 3.5.x, we need much more
validation because all Python package ecosystem should work there without any
issues.
> Remove `distutils` usage
> ------------------------
>
> Key: SPARK-45390
> URL: https://issues.apache.org/jira/browse/SPARK-45390
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 4.0.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
>
> [PEP-632|https://peps.python.org/pep-0632] deprecated {{distutils}} module in
> Python {{3.10}} and dropped in Python {{3.12}} in favor of {{packaging}}
> package.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
