andygrove opened a new pull request, #2755: URL: https://github.com/apache/datafusion-ballista/pull/2755
# Which issue does this PR close? Not intended to close an issue. This is a draft integration branch and is not meant to be merged as is. # Rationale for this change I am using this branch (`comet-native`) to test Ballista with Comet native executors. It collects the open PRs that Comet native execution depends on, so they can be exercised together before each one lands on `main`. # What changes are included in this PR? The branch combines the following open PRs, which are reviewed separately: - #2721 let custom `ExecutionPlan` nodes restrict themselves to a task's partitions - #2722 plan a range `RepartitionExec` as a shuffle stage instead of dropping it - #2723 let hash shuffles place rows by a client-computed partition id It also carries a small change on top of #2722: `PinSubmittedShufflesRule` keeps a submitted range repartition as a stage boundary. Already merged to `main` and kept in sync by merging `main` into this branch: #2682 (run submitted physical plans through the adaptive planner) and #2743 (embedder rules for adaptive query planning). # Are there any user-facing changes? Whatever the PRs above change. This PR adds nothing beyond them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
