Aimilios Tsouvelekakis created SPARK-43160:
----------------------------------------------
Summary: Remove typing.io references as it is being deprecated
from python 3.12
Key: SPARK-43160
URL: https://issues.apache.org/jira/browse/SPARK-43160
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 3.4.0, 3.3.2, 3.2.4
Reporter: Aimilios Tsouvelekakis
Python 3.11 gives a deprecation warning to the following:
{code:java}
/python/3.11.1/lib/python3.11/site-packages/pyspark/broadcast.py:38:
DeprecationWarning: typing.io is deprecated, import directly from typing
instead. typing.io will be removed in Python 3.12.
from typing.io import BinaryIO # type: ignore[import]{code}
The only reference comes from:
{code:java}
spark % git grep typing.io
python/pyspark/broadcast.py:from typing.io import BinaryIO # type:
ignore[import] {code}
I will fix the import so it does not cause any deprecation problem.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
