Hyukjin Kwon created SPARK-61473:
------------------------------------

             Summary: Raise PySpark's errors for the operands that Column 
operators and methods do not take, in the Python client
                 Key: SPARK-61473
                 URL: https://issues.apache.org/jira/browse/SPARK-61473
             Project: Spark
          Issue Type: Bug
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Hyukjin Kwon


Column operators such as +, ==, ** and &, and methods such as eqNullSafe, 
bitwiseOR and contains, take a list, an ndarray, a NumPy integer or bool, bytes 
and bytearray, and raise UNSUPPORTED_DATA_TYPE for a tuple, dict, set or Row. 
PySpark's _bin_op takes only a Column or a None, bool, int, float, str, date, 
time, datetime, timedelta or Decimal, and raises the AttributeError of 
other._expr for the rest. Column.otherwise, Column.when, isin and getItem also 
take a 1-D ndarray, where PySpark raises UNSUPPORTED_DATA_TYPE.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to