This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 98e64ff0166f [SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20
for all GitHub Action jobs
98e64ff0166f is described below
commit 98e64ff0166fd4c6c8042dc8e65ef90ab827792e
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Sat Feb 7 21:55:31 2026 -0800
[SPARK-55423][INFRA] Set `strategy.max-parrallel` to 20 for all GitHub
Action jobs
This PR aims to set `strategy.max-parrallel` to 20 for all GitHub Action
jobs.
ASF Infra team directly requested us via email in (privatespark) mailing
list.
- https://lists.apache.org/thread/voqz9tp3m8wj00lp0y81n25qgvc90f3q
Here is `GitHub Action` syntax.
-
https://docs.github.com/en/actions/reference/workflows-and-actions/workflow-syntax#jobsjob_idstrategymax-parallel
<img width="762" height="112" alt="Screenshot 2026-02-07 at 21 09 02"
src="https://github.com/user-attachments/assets/770d1b81-390b-49d1-8518-70cb20eb93af";
/>
No Apache Spark behavior change.
- Technically, for the PR builder, we use more 20 jobs on the PR
contributor's GitHub repo. This job will be limited.
Pass the CIs.
Generated-by: `Opus 4.5` on `Claude Code`
Closes #54204 from dongjoon-hyun/SPARK-55423.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit de345288830c257bcac4ef6cca7c1be3c031b4f5)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/benchmark.yml | 1 +
.github/workflows/build_and_test.yml | 3 +++
.github/workflows/publish_snapshot.yml | 1 +
3 files changed, 5 insertions(+)
diff --git a/.github/workflows/benchmark.yml b/.github/workflows/benchmark.yml
index 23888ed8ac64..5109f417c9ff 100644
--- a/.github/workflows/benchmark.yml
+++ b/.github/workflows/benchmark.yml
@@ -120,6 +120,7 @@ jobs:
runs-on: ubuntu-22.04
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
split: ${{fromJSON(needs.matrix-gen.outputs.matrix)}}
env:
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 19b284124e82..284e82c50b38 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -137,6 +137,7 @@ jobs:
runs-on: ubuntu-22.04
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
@@ -351,6 +352,7 @@ jobs:
image: ${{ needs.precondition.outputs.image_url }}
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- ${{ inputs.java }}
@@ -731,6 +733,7 @@ jobs:
name: Java ${{ matrix.java }} build with Maven
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
java:
- 11
diff --git a/.github/workflows/publish_snapshot.yml
b/.github/workflows/publish_snapshot.yml
index d326e0b429e0..5b57eba715ec 100644
--- a/.github/workflows/publish_snapshot.yml
+++ b/.github/workflows/publish_snapshot.yml
@@ -29,6 +29,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
fail-fast: false
+ max-parallel: 20
matrix:
branch:
- master
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
