JingsongLi opened a new pull request, #1427: URL: https://github.com/apache/paimon-rust/pull/1427
### Purpose `SQLContext` currently rejects `SORT BY`, `GROUP_CONCAT(... SEPARATOR ...)`, and `SHOW CREATE VIEW`. Add these SQL compatibility features to the DataFusion integration. Linked issue: not linked. ### Brief change log - Plan `SORT BY` with DataFusion's native partition-preserving `SortExec`. Preserve aliases, hidden sort keys, set-query ordering, CTE scope, limits, and pipe operators. - Lower `GROUP_CONCAT` to native typed aggregation followed by consistent string conversion. Support separators, NULL handling, aggregate ordering and positions, filtering, and single-expression DISTINCT; evaluate row arguments once. - Return fully qualified view DDL with declared output types. Preserve temporary-view creation namespaces, quoted identifiers, stored dialect queries, and stable repeated export/recreation without planning catalog view dependencies. - Document unsupported combinations explicitly: `SORT BY` with `ORDER BY` or `DISTINCT ON`; multi-expression `GROUP_CONCAT DISTINCT`; and ordinal aggregate ordering over volatile expressions (precompute the value in a subquery). ### Tests - `RUST_MIN_STACK=16777216 cargo test --locked -p paimon-datafusion --all-targets` — 1,259 tests passed with default features. - `cargo +1.98.0 fmt --all -- --check` — passed. - `cargo +1.98.0 clippy --no-deps --locked -p paimon-datafusion --all-targets -- -D warnings` — passed. - Regression coverage includes partition preservation, UNION and pipe/CTE scope, volatile evaluation and ordering, NULL/empty groups, authoritative view types, namespace binding, earlier narrowing casts, and repeated DDL round trips. ### API and Format Expands the SQL surface. No public Rust API or storage format changes. `SHOW CREATE VIEW` uses the same four result columns as `SHOW CREATE TABLE`. ### Documentation Updated `docs/src/sql.md` with syntax, semantics, and compatibility boundaries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
