asolimando opened a new pull request, #27145: URL: https://github.com/apache/datafusion/pull/27145
## Which issue does this PR close? - Closes #27108. - Reverts #25790. ## Rationale for this change On TPC-H Q18, DataFusion 56 takes about 233 s and 22 GB of peak memory on an M3 Max, compared with about 7 s and 4 GB on 55.1.0. On x86_64 the process runs out of memory (#27108). @devanbenz traced the regression to #25790: the new Decimal filter selectivity estimate changes the join order of the plan. As agreed in https://github.com/apache/datafusion/issues/24461#issuecomment-6657320631, this PR reverts #25790 before the 56 release. A follow-up issue tracks the work to re-land the change. ## What changes are included in this PR? This reverts commit 6145a0949f4399267744480952bb61766c9582c5. The only conflict was `filter_statistics_decimal.slt`, which #25790 added and #26761 later edited. This PR deletes it. ## What is the testing strategy for this PR? The existing tests, which pass locally. ## Are there any user-facing changes? Filters on Decimal columns use the selectivity estimate from 55.x again. ---- Disclaimer: I used AI to assist in the code generation, I have manually reviewed the output and it matches my intention and understanding. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
