BlakeOrth commented on issue #17214: URL: https://github.com/apache/datafusion/issues/17214#issuecomment-3756567968
@alamb (and everyone else who helped contribute to this effort!) I just wanted to quickly report back and issue a sincere "thank you" to all the work that went into designing, writing, reviewing and testing the changes this epic implemented. Here's some very "real world" results that show the difference this has made for our application that leverages DataFusion. I upgraded to DataFusion 52.0.0 at the end of the day on Jan 12, and the difference in our request access pattern to our backing storage has been very obvious! <img width="1336" height="1533" alt="Image" src="https://github.com/user-attachments/assets/b20f36fd-b0e0-4d20-813c-64dc822eafe5"; /> Even better, the Y-axis for this data is "request rate" (Sorry to omit the actual rates, I don't want to leak too many details of our proprietary software) which suggests that we have functionally replaced "waiting on list results" with "reading actual data"! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
