avantgardnerio commented on issue #23194: URL: https://github.com/apache/datafusion/issues/23194#issuecomment-4846178779
@alamb — circling back to your #23093 [comment](https://github.com/apache/datafusion/issues/23093#issuecomment-4770428368) : > handle at a higher level — for example building some sort of more 'adaptive query processing' into DataFusion. Now that AQE/AQP has been fleshed out with an implementation and substantive discussion, I'm curious to know if you still prefer: 1. the AQE direction in this issue 2. or the in-operator method like the 4 examples above (halo rows, prefix scan, adaptive agg, parallel sort) I'd like to proceed with whichever one is the most viable route, because presently we only utilize 1/4000th of our cores while executing unpartitioned window functions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
