[jira] [Commented] (ARROW-9420) [Rust][DataFusion] Add repartition/shuffle plan

2020-07-14 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157350#comment-17157350 ] Andy Grove commented on ARROW-9420: --- I have created a new Jira to replace this one, since the changes I

[jira] [Commented] (ARROW-9420) [Rust][DataFusion] Add repartition/shuffle plan

2020-07-14 Thread Jorge (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157211#comment-17157211 ] Jorge commented on ARROW-9420: -- Thanks a lot for the clarification. Makes a lot of sense. I am a bit unsure

[jira] [Commented] (ARROW-9420) [Rust][DataFusion] Add repartition/shuffle plan

2020-07-13 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156757#comment-17156757 ] Andy Grove commented on ARROW-9420: --- My ultimate goal is for all query evaluation to be in DataFusion,

[jira] [Commented] (ARROW-9420) [Rust][DataFusion] Add repartition/shuffle plan

2020-07-13 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156756#comment-17156756 ] Andy Grove commented on ARROW-9420: --- DataFusion is an in-memory single process query engine. Ballista

[jira] [Commented] (ARROW-9420) [Rust][DataFusion] Add repartition/shuffle plan

2020-07-13 Thread Jorge (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156753#comment-17156753 ] Jorge commented on ARROW-9420: -- Yes, that was also my thinking. What is the relationship of Ballista with

[jira] [Commented] (ARROW-9420) [Rust][DataFusion] Add repartition/shuffle plan

2020-07-13 Thread Andy Grove (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156731#comment-17156731 ] Andy Grove commented on ARROW-9420: --- I don't think we would need any integration with SQL or the