Hyukjin Kwon created SPARK-61245:
------------------------------------
Summary: Cover the uncovered Python shim paths of the drop-in, and
read protobuf options as PySpark does
Key: SPARK-61245
URL: https://issues.apache.org/jira/browse/SPARK-61245
Project: Spark
Issue Type: Test
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
The Python shims of the drop-in had many uncovered branches (pandas Arrow
input, UDF return types, SQLContext, the client, avro and protobuf functions).
This adds offline tests whose expected values match PySpark 4.3.0. One
divergence was found: from_protobuf and to_protobuf accepted a Column as
options, while PySpark raises TypeError for it.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
