Kai-Michael Roesner created SPARK-47613:
-------------------------------------------
Summary: Issue with Spark Connect on Python 3.12
Key: SPARK-47613
URL: https://issues.apache.org/jira/browse/SPARK-47613
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.5.0, 3.4.1
Reporter: Kai-Michael Roesner
When trying to create a remote Spark session with PySpark on Python 3.12 a
{{ModuleNotFoundError: No module named 'distutils'}} excpetion is thrown. In
Python 3.12 {{distutils}} was removed from the stdlib. As a workaround we can
{{import setuptools}} before creating the session. See also [this question on
SOF|https://stackoverflow.com/questions/78207291] and the
[answer|https://stackoverflow.com/a/78212125/11474852] by Anderson Bravalheri.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
