JingsongLi opened a new issue, #1307: URL: https://github.com/apache/paimon-rust/issues/1307
SQLContext currently maintains local implementations of several functions that are already provided by the matching `datafusion-spark` package. It also lacks Spark function families such as `pmod`, `collect_set` and `try_sum`. Integrate the upstream Spark function packages and expression planner, remove duplicate local algorithms, and retain Paimon-specific functions and the three-argument `date_diff` extension. Adopt the upstream function semantics by default and document the differences from existing DataFusion defaults. The integration should preserve application-function precedence and REST definition portability, normalize supported Arrow dictionary/NULL inputs, and cover aggregate FILTER, DISTINCT, empty-window and partial-state boundaries without duplicating upstream aggregation algorithms. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
