Andy Grove created ARROW-11068: ---------------------------------- Summary: [Rust] [DataFusion] Wrap HashJoinExec in CoalesceBatchExec Key: ARROW-11068 URL: https://issues.apache.org/jira/browse/ARROW-11068 Project: Apache Arrow Issue Type: Improvement Components: Rust - DataFusion Reporter: Andy Grove Assignee: Andy Grove Fix For: 3.0.0
Once [https://github.com/apache/arrow/pull/9043] is merged, we should extend this to wrap join output as well. Rather than hard-code a list of operators that need to be wrapped, we should find a more generic mechanism so that plans can declare if their input and/or output batches should be coalesced (similar to how we handle partitioning) and this would allow custom operators outside of DataFusion to benefit from this optimization. -- This message was sent by Atlassian Jira (v8.3.4#803005)