Dandandan commented on issue #7001: URL: https://github.com/apache/datafusion/issues/7001#issuecomment-5375180158
Do we have any ideas to improve this further? The coalescing has been improved recently, also the morsel scanning helps load balancing at the scan level (while still having some back pressure). Also I added some improvement (strength reduce) and we improved hashing performance which all helped. I think some other features like benefiting more from (almost) sorted data / clustering might be interesting here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
