HyukjinKwon opened a new pull request, #250: URL: https://github.com/apache/spark-connect-rust/pull/250
### What changes were proposed in this pull request? [SPARK-61049](https://issues.apache.org/jira/browse/SPARK-61049): the `DataFrameNaFunctions` of `df.na` and the `DataFrameStatFunctions` of `df.stat` now have the `df` of PySpark Connect's, the DataFrame itself, so `df.na.df is df`. ### Why are the changes needed? The client had no `df` of them: `df.na.df` raised an `AttributeError`. ### Does this PR introduce _any_ user-facing change? Yes. `df.na.df` and `df.stat.df` are the DataFrame, as in PySpark 4.3.0. ### How was this patch tested? - A new live test checks that `df.na.df` and `df.stat.df` are `df`, and runs functions of them. It passes with official PySpark 4.3.0, and fails without this change. - A new offline test checks the same of a DataFrame of an offline session. - The lib tests of both crates (574 passed), the build of all tests, also with `wasm-udf`, the offline Python suites (1813 passed, 8 skipped), and the live drop-in and Arrow suites (112 passed) and live cases (10 passed) against a local Spark 4.3.0 server. Clippy reports no diagnostics in the changed lines. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Opus 5.5 This pull request and its description were written by Isaac. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
