[
https://issues.apache.org/jira/browse/SPARK-43029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17709917#comment-17709917
]
Bjørn Jørgensen commented on SPARK-43029:
-----------------------------------------
[It is deprecated in
3.4.0|https://github.com/apache/spark/blob/0e9e34c1bd9bd16ad5efca77ce2763eb950f3103/python/pyspark/pandas/frame.py#L2069]
3.4.0 is in RC 7 now. So it will soon be out.
> PySpark Breaks with Pandas 2.0
> ------------------------------
>
> Key: SPARK-43029
> URL: https://issues.apache.org/jira/browse/SPARK-43029
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 3.3.2
> Environment: Linux
> Python 3.10.10
> PySpark 3.3.2
> Reporter: Phillip Cloud
> Priority: Major
>
> PySpark is apparently using {{iteritems}}, which was removed in and
> deprecated long before pandas 2.0 and this makes PySpark unusable with pandas
> 2.0.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
