This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new 10b405d16d17 [SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20
for all GitHub Action jobs
10b405d16d17 is described below
commit 10b405d16d172c6a3a9d081fe98733fd58014835
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Sat Feb 7 21:55:31 2026 -0800
[SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20 for all GitHub
Action jobs
### What changes were proposed in this pull request?
This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action
jobs.
### Why are the changes needed?
ASF Infra team directly requested us via email in (privatespark) mailing
list.
- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q
Here is `GitHub Action` syntax.
-
https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel
<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02"
src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af";
/>
### Does this PR introduce _any_ user-facing change?
No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR
contributor's GitHub repo. This job will be limited.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: `Opus 4.5` on `Claude Code`
Closes #54204 from dongjoon-hyun/SPARK-55423.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit de345288830c257bcac4ef6cca7c1be3c031b4f5)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/benchmark.yml | 1 +
.github/workflows/build_and_test.yml | 2 ++
.github/workflows/maven_test.yml | 1 +
.github/workflows/publish_snapshot.yml | 1 +
.github/workflows/python_hosted_runner_test.yml | 1 +
5 files changed, 6 insertions(+)
diff --git a/.github/workflows/benchmark.yml b/.github/workflows/benchmark.yml
index 3e90bb329be5..eb42160c378d 100644
--- a/.github/workflows/benchmark.yml
+++ b/.github/workflows/benchmark.yml
@@ -136,6 +136,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
split: ${{fromJSON(needs.matrix-gen.outputs.matrix)}}
env:
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 5735dc6ad208..742990622712 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -231,6 +231,7 @@ jobs:
timeout-minutes: 120
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
@@ -503,6 +504,7 @@ jobs:
image: ${{ needs.precondition.outputs.image_pyspark_url_link }}
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
diff --git a/.github/workflows/maven_test.yml b/.github/workflows/maven_test.yml
index 7828c4bdc6ed..580593f1cfe5 100644
--- a/.github/workflows/maven_test.yml
+++ b/.github/workflows/maven_test.yml
@@ -59,6 +59,7 @@ jobs:
timeout-minutes: 150
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
diff --git a/.github/workflows/publish_snapshot.yml
b/.github/workflows/publish_snapshot.yml
index b20c34d8ec5a..0608ba1fd1f1 100644
--- a/.github/workflows/publish_snapshot.yml
+++ b/.github/workflows/publish_snapshot.yml
@@ -36,6 +36,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
# keep in sync with default value of workflow_dispatch input 'branch'
branch: ${{ fromJSON( inputs.branch || '["master", "branch-4.0",
"branch-3.5"]' ) }}
diff --git a/.github/workflows/python_hosted_runner_test.yml
b/.github/workflows/python_hosted_runner_test.yml
index c0fe016326d4..659171b901d3 100644
--- a/.github/workflows/python_hosted_runner_test.yml
+++ b/.github/workflows/python_hosted_runner_test.yml
@@ -62,6 +62,7 @@ jobs:
timeout-minutes: 120
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
