alamb opened a new issue, #26661: URL: https://github.com/apache/datafusion/issues/26661
### Is your feature request related to a problem or challenge? @toschmidt of TU-Munich (an influential database research group) posted the following: - https://github.com/dbolympics/dbolympics/issues/2 Here is the site: https://dbolympics.com/ He invited us to review the configuration of DataFusion to make sure it got a fair evaluation. We currently don't look great in the results: <img width="1130" height="632" alt="Image" src="https://github.com/user-attachments/assets/3563c90b-9c74-414b-ba3c-339577a6f14e"; /> ### Describe the solution you'd like I would like to investigate DataFusions results and make sure we understand (and document) what it would take to improve the system with this benchmark Given the fact that we are in good (commercial) company with ClickHouse, and the pedigree of the author (the same research lab that published the various query optimizer papers, on which the systems at the top left are based) I am not overly concerned about DataFusion's actual competitiveness in real world queries. However, TUM is influential and I suspect this benchmark will show up in the research literature shortly I suspect the benchmark skews heavily towards join ordering and systems which use the TUM -inspired algorithms will do well on, but that would be good to confirm. ### Describe alternatives you've considered I think the first thing to do is reproduce the results Then ideally we would identity the categories were we need to do better. The benchmark site also makes some vague mention that it penalizes correctness but I haven't figured out how that is incorporated yet <img width="1322" height="640" alt="Image" src="https://github.com/user-attachments/assets/e5d66bae-84c5-4ee5-84df-a2a48d8e16e8"; /> ### Additional context Related to a similar post recently the polars folks put out that similarly show good join results (TPC-H/TPC-DS): - https://github.com/apache/datafusion/issues/26169 ### Willingness to contribute None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
