houqp commented on issue #112: URL: https://github.com/apache/arrow-datafusion/issues/112#issuecomment-945373608
My bad, should `CoalesceBatchesExec` was the wrong one, it coalesces by batch size, not partition count. `CoalescePartitionsExec` is the correct one. However, currently it is restricted to only produce one partition, so there is more work than just connecting it to a logical plan node :( Will need to make that partition count configurable first. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
