akupchinskiy opened a new issue, #2187: URL: https://github.com/apache/datafusion-comet/issues/2187
### What is the problem the feature request solves? Datafusion optimizer [wraps some operators](https://github.com/apache/datafusion/blob/3eceedcde3c8a1aba61f05ccc39edf4728b5728c/datafusion/physical-optimizer/src/coalesce_batches.rs#L63) which might produce multiple small batches with CoalesceBatchesExec node. In Comet, this technique is already applied to SMJ with filter. Shouldn't it be extended to other plans (Filter/HashJoin)? It might be especially beneficial for workloads where sort merge join -> hash join replacement is enforced. ### Describe the potential solution _No response_ ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
