This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.0 by this push:
new e103e58dc464 [SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20
for all GitHub Action jobs
e103e58dc464 is described below
commit e103e58dc464d40eb2d2e155aaceaeddd27ae6d9
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Sat Feb 7 21:55:31 2026 -0800
[SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20 for all GitHub
Action jobs
### What changes were proposed in this pull request?
This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action
jobs.
### Why are the changes needed?
ASF Infra team directly requested us via email in (privatespark) mailing
list.
- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q
Here is `GitHub Action` syntax.
-
https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel
<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02"
src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af";
/>
### Does this PR introduce _any_ user-facing change?
No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR
contributor's GitHub repo. This job will be limited.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: `Opus 4.5` on `Claude Code`
Closes #54204 from dongjoon-hyun/SPARK-55423.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit de345288830c257bcac4ef6cca7c1be3c031b4f5)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/benchmark.yml | 1 +
.github/workflows/build_and_test.yml | 2 ++
.github/workflows/maven_test.yml | 1 +
.github/workflows/publish_snapshot.yml | 1 +
.github/workflows/python_macos_test.yml | 1 +
5 files changed, 6 insertions(+)
diff --git a/.github/workflows/benchmark.yml b/.github/workflows/benchmark.yml
index 9bfe79cfa2fe..48ff6aa37898 100644
--- a/.github/workflows/benchmark.yml
+++ b/.github/workflows/benchmark.yml
@@ -127,6 +127,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
split: ${{fromJSON(needs.matrix-gen.outputs.matrix)}}
env:
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 0f0495a9926a..8db7538c8318 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -229,6 +229,7 @@ jobs:
timeout-minutes: 120
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
@@ -495,6 +496,7 @@ jobs:
image: ${{ needs.precondition.outputs.image_pyspark_url_link }}
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
diff --git a/.github/workflows/maven_test.yml b/.github/workflows/maven_test.yml
index 5b1dc47e897f..4ca99bf942bc 100644
--- a/.github/workflows/maven_test.yml
+++ b/.github/workflows/maven_test.yml
@@ -54,6 +54,7 @@ jobs:
timeout-minutes: 150
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
diff --git a/.github/workflows/publish_snapshot.yml
b/.github/workflows/publish_snapshot.yml
index 3cf799d13735..d35fefccb6db 100644
--- a/.github/workflows/publish_snapshot.yml
+++ b/.github/workflows/publish_snapshot.yml
@@ -36,6 +36,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
# keep in sync with default value of workflow_dispatch input 'branch'
branch: ${{ fromJSON( inputs.branch || '["master", "branch-3.5"]' ) }}
diff --git a/.github/workflows/python_macos_test.yml
b/.github/workflows/python_macos_test.yml
index 49b953122386..bce464fe0826 100644
--- a/.github/workflows/python_macos_test.yml
+++ b/.github/workflows/python_macos_test.yml
@@ -51,6 +51,7 @@ jobs:
runs-on: macos-15
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
