[
https://issues.apache.org/jira/browse/SPARK-59116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-59116.
----------------------------------
Resolution: Fixed
> Complete PySpark 4.2.0 behavioral parity for the Rust drop-in (window
> functions, chained when, lag/lead, json_tuple, parameterized SQL, struct to
> Row, na.fill, nested/empty createDataFrame)
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-59116
> URL: https://issues.apache.org/jira/browse/SPARK-59116
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: connect-rust-4.2.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> Complete PySpark 4.2.0 behavioral parity for the Rust drop-in; drove an
> exhaustive differential harness (real PySpark 4.2.0 vs the drop-in) to zero
> (143/143). Fixes window functions, chained when, lag/lead offset/default,
> json_tuple variadic, parameterized spark.sql args, struct->Row conversion,
> na.fill value types, single-field DDL schema, and empty/array<struct>
> createDataFrame. Verified: harness 143/143, batteries 32/32+83/83+56/56,
> offline 236, fmt/build/ruff clean.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
