This is an automated email from the ASF dual-hosted git repository.
gaogaotiantian pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new 591a380d43c1 [SPARK-57621][3.5][INFRA] Make branch-3.5 scheduled build
workflows self-contained
591a380d43c1 is described below
commit 591a380d43c17ee256aecd7f2180b99757567980
Author: Tian Gao <[email protected]>
AuthorDate: Thu Jun 25 12:55:13 2026 -0700
[SPARK-57621][3.5][INFRA] Make branch-3.5 scheduled build workflows
self-contained
### What changes were proposed in this pull request?
This PR makes the `branch-3.5` scheduled build workflow files
self-contained, following the same approach as the `branch-4.0` work
(SPARK-57398) and the `branch-4.1` / `branch-4.x` efforts:
- Rewrites `build_scala213.yml` so it is triggered by `workflow_dispatch`
only (the dormant `schedule:` trigger is removed; scheduled runs on a
non-default branch never fire anyway), drops the inherited `branch: master` (so
it builds `branch-3.5`), and uses a generic, non-branch-tagged name.
- Adds `build_python_3.9.yml`, the equivalent of
`build_branch35_python.yml`.
The per-build configurations are relocated from the active
`build_branch35*.yml` files on `master` so the coverage matches what
`branch-3.5` schedules today.
Notes:
- `build_and_test.yml` on `branch-3.5` already defaults `branch` to
`branch-3.5`, so the callers omit `branch`.
- Unlike `branch-4.0`, `branch-3.5` runs Python directly on the runner
(`python3.9`) rather than via container images, so `PYSPARK_IMAGE_TO_TEST` /
`PYTHON_TO_TEST` are left empty (matching every existing `branch-3.5` workflow).
### Why are the changes needed?
This is the `branch-3.5` side of decoupling our scheduled CIs (cf. the
`branch-4.x`, `branch-4.1`, and `branch-4.0` efforts). Scheduled workflows only
fire from the default branch, so `branch-3.5` CI should consist of
self-contained, dispatchable workflow files on `branch-3.5` that a single
scheduler on `master` can trigger. This PR prepares those targets; a follow-up
on `master` will add the scheduler and remove the `build_branch35*.yml` files.
### Does this PR introduce _any_ user-facing change?
No. CI only.
### How was this patch tested?
These workflows can be triggered manually via `workflow_dispatch` once
merged.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Claude Opus 4.8)
This pull request and its description were written by Isaac.
Closes #56679 from gaogaotiantian/branch35-scheduled-ci.
Authored-by: Tian Gao <[email protected]>
Signed-off-by: Tian Gao <[email protected]>
---
.../{build_scala213.yml => build_python_3.9.yml} | 16 +++-------------
.github/workflows/build_scala213.yml | 13 ++++++-------
2 files changed, 9 insertions(+), 20 deletions(-)
diff --git a/.github/workflows/build_scala213.yml
b/.github/workflows/build_python_3.9.yml
similarity index 75%
copy from .github/workflows/build_scala213.yml
copy to .github/workflows/build_python_3.9.yml
index cae0981ee1e8..84f969f3c1c8 100644
--- a/.github/workflows/build_scala213.yml
+++ b/.github/workflows/build_python_3.9.yml
@@ -17,11 +17,10 @@
# under the License.
#
-name: "Build (master, Scala 2.13, Hadoop 3, JDK 8)"
+name: "Build / Python-only (Python 3.9)"
on:
- schedule:
- - cron: '0 19 * * *'
+ workflow_dispatch:
jobs:
run-build:
@@ -32,18 +31,9 @@ jobs:
if: github.repository == 'apache/spark'
with:
java: 8
- branch: master
hadoop: hadoop3
- envs: >-
- {
- "SCALA_PROFILE": "scala2.13"
- }
jobs: >-
{
- "build": "true",
"pyspark": "true",
- "sparkr": "true",
- "tpcds-1g": "true",
- "docker-integration-tests": "true",
- "lint" : "true"
+ "pyspark-pandas": "true"
}
diff --git a/.github/workflows/build_scala213.yml
b/.github/workflows/build_scala213.yml
index cae0981ee1e8..ddf1d05428d6 100644
--- a/.github/workflows/build_scala213.yml
+++ b/.github/workflows/build_scala213.yml
@@ -17,11 +17,10 @@
# under the License.
#
-name: "Build (master, Scala 2.13, Hadoop 3, JDK 8)"
+name: "Build / Scala 2.13 (Hadoop 3, JDK 8)"
on:
- schedule:
- - cron: '0 19 * * *'
+ workflow_dispatch:
jobs:
run-build:
@@ -32,18 +31,18 @@ jobs:
if: github.repository == 'apache/spark'
with:
java: 8
- branch: master
hadoop: hadoop3
envs: >-
{
- "SCALA_PROFILE": "scala2.13"
+ "SCALA_PROFILE": "scala2.13",
+ "ORACLE_DOCKER_IMAGE_NAME": "gvenzl/oracle-xe:21.3.0"
}
jobs: >-
{
"build": "true",
- "pyspark": "true",
"sparkr": "true",
"tpcds-1g": "true",
"docker-integration-tests": "true",
- "lint" : "true"
+ "k8s-integration-tests": "true",
+ "lint": "true"
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
