[
https://issues.apache.org/jira/browse/ARROW-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Grove updated ARROW-5227:
------------------------------
Description:
This story (maybe it should have been an epic with hindsight) is to
re-implement query execution in DataFusion using a physical plan that supports
partitions and parallel execution.
This will replace the current query execution which happens directly from the
logical plan.
The new physical plan is based on traits and is therefore extensible by other
projects that use Arrow. For example, another project could add physical plans
for distributed compute.
See design doc at
[https://docs.google.com/document/d/1ATZGIs8ry_kJeoTgmJjLrg6Ssb5VE7lNzWuz_4p6EWk/edit?usp=sharing]
for more info
was:
Implement parallel query execution to take advantage of multiple cores when
running queries.
See design doc at
[https://docs.google.com/document/d/1ATZGIs8ry_kJeoTgmJjLrg6Ssb5VE7lNzWuz_4p6EWk/edit?usp=sharing]
for more info
> [Rust] [DataFusion] Implement parallel query execution
> ------------------------------------------------------
>
> Key: ARROW-5227
> URL: https://issues.apache.org/jira/browse/ARROW-5227
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Rust, Rust - DataFusion
> Reporter: Andy Grove
> Assignee: Andy Grove
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> This story (maybe it should have been an epic with hindsight) is to
> re-implement query execution in DataFusion using a physical plan that
> supports partitions and parallel execution.
> This will replace the current query execution which happens directly from the
> logical plan.
> The new physical plan is based on traits and is therefore extensible by other
> projects that use Arrow. For example, another project could add physical
> plans for distributed compute.
> See design doc at
> [https://docs.google.com/document/d/1ATZGIs8ry_kJeoTgmJjLrg6Ssb5VE7lNzWuz_4p6EWk/edit?usp=sharing]
> for more info
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
