rank-p opened a new pull request, #26280: URL: https://github.com/apache/datafusion/pull/26280
## Which issue does this PR close? Closes #26278. ## Rationale for this change Ignoring NULLs in file bounds can make a combined scan appear sorted, causing `ORDER BY` to return rows in the wrong order. ## What changes are included in this PR? Include NULLs in file bounds using NULL counts, schema nullability, and sort options. Keep the existing sort-pushdown policy. ## What is the testing strategy for this PR? - Add a regression covering both sort directions, NULL placement, and exact/missing/estimated NULL counts. It fails without the fix. - Passed 184 crate tests, 12,580 extended Rust tests, 533 SQL test files, and 110 CLI tests. - CI-style lint checks pass except the security audit, which flags five existing `quinn-proto 0.11.15` advisories. Separate `--all-features` Clippy warnings remain in unchanged optimizer code. - Local file-grouping benchmark: approximately 1.60 → 1.67 ms for 1,000 files. ## Are there any user-facing changes? Correct NULL placement when sorting across files. No public API changes. AI assistance: Codex. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
