[ 
https://issues.apache.org/jira/browse/SPARK-61473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated SPARK-61473:
-----------------------------------
    Labels: pull-request-available  (was: )

> Raise PySpark's errors for the operands that Column operators and methods do 
> not take, in the Python client
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-61473
>                 URL: https://issues.apache.org/jira/browse/SPARK-61473
>             Project: Spark
>          Issue Type: Bug
>          Components: Connect
>    Affects Versions: connect-rust-4.3.0
>            Reporter: Hyukjin Kwon
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: connect-rust-4.3.0
>
>
> Column operators such as +, ==, ** and &, and methods such as eqNullSafe, 
> bitwiseOR and contains, take a list, an ndarray, a NumPy integer or bool, 
> bytes and bytearray, and raise UNSUPPORTED_DATA_TYPE for a tuple, dict, set 
> or Row. PySpark's _bin_op takes only a Column or a None, bool, int, float, 
> str, date, time, datetime, timedelta or Decimal, and raises the 
> AttributeError of other._expr for the rest. Column.otherwise, Column.when, 
> isin and getItem also take a 1-D ndarray, where PySpark raises 
> UNSUPPORTED_DATA_TYPE.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to