This is an automated email from the ASF dual-hosted git repository.

avantgardnerio pushed a commit to branch tpch-ci-multi-partition-smoke
in repository https://gitbox.apache.org/repos/asf/datafusion-ballista.git

commit e20168885df29a44402b21b95bb5fe153a414959
Author: Brent Gardner <[email protected]>
AuthorDate: Tue Jul 21 03:15:21 2026 -0600

    ci(tpch): add AQE-on smoke pass with multi-partition tasks
    
    Existing CI runs at the default max_partitions_per_task=1 (one task per
    input partition), which never exercises the multi-partition-task path.
    Add a third suite invocation that flips it to 0 (unbounded, budget-capped
    at vcores=4) alongside AQE on, so the mode we actually plan to ship gets
    end-to-end verification against SF10.
    
    Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
---
 .github/workflows/tpch.yml | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/.github/workflows/tpch.yml b/.github/workflows/tpch.yml
index 4be3eb535..fac2d28d5 100644
--- a/.github/workflows/tpch.yml
+++ b/.github/workflows/tpch.yml
@@ -179,6 +179,11 @@ jobs:
             --verify \
             -c datafusion.optimizer.prefer_hash_join=false \
             -c ballista.planner.adaptive.enabled=true
+          run_suite "AQE on, multi-partition tasks" \
+            --verify \
+            -c datafusion.optimizer.prefer_hash_join=false \
+            -c ballista.planner.adaptive.enabled=true \
+            -c ballista.scheduler.max_partitions_per_task=0
 
       - name: Upload cluster logs on failure
         if: failure()


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to