[
https://issues.apache.org/jira/browse/SPARK-35343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-35343.
-----------------------------------
Fix Version/s: 3.2.0
Assignee: Xinrong Meng
Resolution: Fixed
Issue resolved by pull request 32592
https://github.com/apache/spark/pull/32592
> Make the conversion from/to pandas data-type-based for non-ExtensionDtypes
> --------------------------------------------------------------------------
>
> Key: SPARK-35343
> URL: https://issues.apache.org/jira/browse/SPARK-35343
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 3.2.0
> Reporter: Xinrong Meng
> Assignee: Xinrong Meng
> Priority: Major
> Fix For: 3.2.0
>
>
> The conversion from/to pandas includes logic for checking data types and
> behaving accordingly.
> That makes code hard to change or maintain.
> Since we have introduced the Ops class per non-ExtensionDtypes data type, we
> ought to make the conversion from/to pandas data-type-based.
> Ops class per ExtensionDtype and its data-type-based from/to pandas will be
> implemented in a separate PR.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
