Hyukjin Kwon created SPARK-61137:
------------------------------------
Summary: Make StructType give back the same StructField objects in
the Python client as PySpark does
Key: SPARK-61137
URL: https://issues.apache.org/jira/browse/SPARK-61137
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
PySpark's StructType holds its StructField objects. So struct["f1"], struct[0],
iteration and struct.fields give back the same objects: struct["f1"] is
struct.fields[0].
The client's StructType gives a new StructField object at each access, so these
are not identical. Apache Spark's test_struct_type fails on this client
(assertIs). The client's StructType should give back the same StructField
objects, as PySpark's does.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
