Xinrong Meng created SPARK-35452:
------------------------------------
Summary: Introduce ComplexTypeOps
Key: SPARK-35452
URL: https://issues.apache.org/jira/browse/SPARK-35452
Project: Spark
Issue Type: Sub-task
Components: PySpark
Affects Versions: 3.2.0
Reporter: Xinrong Meng
StructType, ArrayType, MapType, and BinaryType are not accepted by DataTypeOps
now.
We should handle these complex types.
Please note that arithmetic operations might be applied to these complex types,
for example, ps.Series([[1,2,3]]) + ps.Series([[4,5,6]]) should work the same
as pd.Series([[1,2,3]]) + pd.Series([[4,5,6]]).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
