[
https://issues.apache.org/jira/browse/SPARK-45390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786455#comment-17786455
]
Dongjoon Hyun edited comment on SPARK-45390 at 11/15/23 6:00 PM:
-----------------------------------------------------------------
Your concern is legit like we had the same concern at Apache Spark 2.4.x. :)
For the following, let me ask you in this way. Do you think Python 3.12 support
all minimum Python package requirements of Spark 3.5? Have you test your
branch-3.5 with Python 3.12 + SPARK-45390 ?
bq. I'm not sure what you mean here.
was (Author: dongjoon):
Your concern is legit like we had the same concern at Apache Spark 2.4.x. :)
For the following, let me ask you in this way. Do you think Python 3.12 support
all minimum Python package requirements of Spark 3.5? Have you test your
branch-3.5 with Python 3.12 + SPARK-45390 ?
> I'm not sure what you mean here.
> Remove `distutils` usage
> ------------------------
>
> Key: SPARK-45390
> URL: https://issues.apache.org/jira/browse/SPARK-45390
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 4.0.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
>
> [PEP-632|https://peps.python.org/pep-0632] deprecated {{distutils}} module in
> Python {{3.10}} and dropped in Python {{3.12}} in favor of {{packaging}}
> package.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]