alamb commented on issue #10316: URL: https://github.com/apache/datafusion/issues/10316#issuecomment-2091665546
> What comes to my mind is that if we can successfully bring the `statistics` to `SortPreservingMerge`, it could handle this work without a separate operator (This will probably need a change in `statistics` API to return statistics for each partition). I think this approach would work as well -- or maybe just a flag on the `SortPreservingMerge` and a different stream rather than an entirely `ExecutionPlan` 🤔 Per partition statistics is an interesting idea 🤔 -- it certainly makes sense for things like data sources. I wonder how generally useful it could be -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
