Dandandan commented on PR #6938: URL: https://github.com/apache/arrow-datafusion/pull/6938#issuecomment-1633243733
@alamb this is just some WIP on top of to implement https://github.com/apache/arrow-datafusion/issues/6892 For this change I'm seeing some positive and some negative changes (timing wise). Memory wise will likely be better as there is one fewer aggregate (so doesn't need to keep the higher-cardinality states in memory of the partial aggregate), but it seems the `RepartitionExec` at this point can be slower than the partial aggregate + `RepartitionExec` 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
