Andy Grove created ARROW-11068:
----------------------------------
Summary: [Rust] [DataFusion] Wrap HashJoinExec in CoalesceBatchExec
Key: ARROW-11068
URL: https://issues.apache.org/jira/browse/ARROW-11068
Project: Apache Arrow
Issue Type: Improvement
Components: Rust - DataFusion
Reporter: Andy Grove
Assignee: Andy Grove
Fix For: 3.0.0
Once [https://github.com/apache/arrow/pull/9043] is merged, we should extend
this to wrap join output as well.
Rather than hard-code a list of operators that need to be wrapped, we should
find a more generic mechanism so that plans can declare if their input and/or
output batches should be coalesced (similar to how we handle partitioning) and
this would allow custom operators outside of DataFusion to benefit from this
optimization.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
