Andy Grove created ARROW-4681:
---------------------------------
Summary: [Rust] [DataFusion] Implement parallel query execution
using threads
Key: ARROW-4681
URL: https://issues.apache.org/jira/browse/ARROW-4681
Project: Apache Arrow
Issue Type: Improvement
Components: Rust, Rust - DataFusion
Affects Versions: 0.12.0
Reporter: Andy Grove
Assignee: Andy Grove
Fix For: 0.13.0
I am planning on tackling this soon. The basic plan is to change the table
scan() method to return multiple scanners (one per partition) so that the query
execution can process each partition on a separate thread.
This will involve changing some of the DataFusion APIs to use Arc instead of Rc.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)