alamb commented on PR #15466: URL: https://github.com/apache/datafusion/pull/15466#issuecomment-2797605664
> Still seeing if this is just noise, but here are flame graphs for Q14 from my machine if anyone else wants to stare at them: My theory is that the improvement is due to @rluvaton 's PR to improve concat - https://github.com/apache/arrow-rs/pull/7309 I thought it might be related to improved pre-fetching / fewer IOs due to - https://github.com/apache/arrow-rs/pull/7334 However, I tried an experiment on main to reduce IO and it doesn't seem to have changed anything - https://github.com/apache/datafusion/pull/15670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
