[
https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-36762.
-----------------------------------
Fix Version/s: 3.2.0
Assignee: dgd_contributor
Resolution: Fixed
Issue resolved by pull request 34005
https://github.com/apache/spark/pull/34005
> Fix Series.isin when Series has NaN values
> ------------------------------------------
>
> Key: SPARK-36762
> URL: https://issues.apache.org/jira/browse/SPARK-36762
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 3.2.0, 3.3.0
> Reporter: dgd_contributor
> Assignee: dgd_contributor
> Priority: Major
> Fix For: 3.2.0
>
>
> {code:python}
> >>> pser = pd.Series([None, 5, None, 3, 2, 1, None, 0, 0])
> >>> psser = ps.from_pandas(pser)
> >>> pser.isin([1, 3, 5, None])
> 0 False
> 1 True
> 2 False
> 3 True
> 4 False
> 5 True
> 6 False
> 7 False
> 8 False
> dtype: bool
> >>> psser.isin([1, 3, 5, None])
> 0 None
>
> 1 True
> 2 None
> 3 True
> 4 None
> 5 True
> 6 None
> 7 None
> 8 None
> dtype: object
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
