This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new 70e5d2aa7a99 [SPARK-48202][INFRA] Spin off `pyspark` tests from `build_branch35.yml` Daily CI 70e5d2aa7a99 is described below commit 70e5d2aa7a992a6f4ff9c7d8e3752ce1d3d488f2 Author: Dongjoon Hyun <dh...@apple.com> AuthorDate: Wed May 8 10:47:52 2024 -0700 [SPARK-48202][INFRA] Spin off `pyspark` tests from `build_branch35.yml` Daily CI ### What changes were proposed in this pull request? This PR aims to create `build_branch35_python.yml` in order to spin off `pyspark` tests from `build_branch35.yml` Daily CI. ### Why are the changes needed? Currently, `build_branch35.yml` creates more than 15 test pipelines concurrently which is beyond of ASF Infra policy. - https://github.com/apache/spark/actions/workflows/build_branch35.yml We had better offload this to `Python only Daily CI` like `master` branch's `Python Only` Daily CI. - https://github.com/apache/spark/actions/workflows/build_python_3.10.yml ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #46479 from dongjoon-hyun/SPARK-48202. Authored-by: Dongjoon Hyun <dh...@apple.com> Signed-off-by: Dongjoon Hyun <dh...@apple.com> --- .github/workflows/build_branch35.yml | 1 - .../{build_branch35.yml => build_branch35_python.yml} | 13 +++---------- 2 files changed, 3 insertions(+), 11 deletions(-) diff --git a/.github/workflows/build_branch35.yml b/.github/workflows/build_branch35.yml index 55616c2f1f01..2ec080d5722c 100644 --- a/.github/workflows/build_branch35.yml +++ b/.github/workflows/build_branch35.yml @@ -43,7 +43,6 @@ jobs: jobs: >- { "build": "true", - "pyspark": "true", "sparkr": "true", "tpcds-1g": "true", "docker-integration-tests": "true", diff --git a/.github/workflows/build_branch35.yml b/.github/workflows/build_branch35_python.yml similarity index 74% copy from .github/workflows/build_branch35.yml copy to .github/workflows/build_branch35_python.yml index 55616c2f1f01..1585534d33ba 100644 --- a/.github/workflows/build_branch35.yml +++ b/.github/workflows/build_branch35_python.yml @@ -17,7 +17,7 @@ # under the License. # -name: "Build (branch-3.5, Scala 2.13, Hadoop 3, JDK 8)" +name: "Build / Python-only (branch-3.5)" on: schedule: @@ -36,17 +36,10 @@ jobs: hadoop: hadoop3 envs: >- { - "SCALA_PROFILE": "scala2.13", - "PYTHON_TO_TEST": "", - "ORACLE_DOCKER_IMAGE_NAME": "gvenzl/oracle-xe:21.3.0" + "PYTHON_TO_TEST": "" } jobs: >- { - "build": "true", "pyspark": "true", - "sparkr": "true", - "tpcds-1g": "true", - "docker-integration-tests": "true", - "k8s-integration-tests": "true", - "lint" : "true" + "pyspark-pandas": "true" } --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org