This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push: new d5cec45 [SPARK-36198][TESTS] Skip UNIDOC generation in PySpark GHA job d5cec45 is described below commit d5cec45c0b0feaf2dd6014cf82bf0d7d25f5ac87 Author: William Hyun <will...@apache.org> AuthorDate: Sun Jul 18 17:52:28 2021 -0700 [SPARK-36198][TESTS] Skip UNIDOC generation in PySpark GHA job ### What changes were proposed in this pull request? This PR aims to skip UNIDOC generation in PySpark GHA job. ### Why are the changes needed? PySpark GHA jobs do not need to generate Java/Scala doc. This will save about 13 minutes in total. -https://github.com/apache/spark/runs/3098268973?check_suite_focus=true ``` ... ======================================================================== Building Unidoc API Documentation ======================================================================== [info] Building Spark unidoc using SBT with these arguments: -Phadoop-3.2 -Phive-2.3 -Pscala-2.12 -Phive-thriftserver -Pmesos -Pdocker-integration-tests -Phive -Pkinesis-asl -Pspark-ganglia-lgpl -Pkubernetes -Phadoop-cloud -Pyarn unidoc ... [info] Main Java API documentation successful. [success] Total time: 192 s (03:12), completed Jul 18, 2021 6:08:40 PM ``` ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the GHA. Closes #33407 from williamhyun/SKIP_UNIDOC. Authored-by: William Hyun <will...@apache.org> Signed-off-by: Dongjoon Hyun <dongj...@apache.org> (cherry picked from commit c336f73ccddc1d163caa0a619919f3bbc9bf34ab) Signed-off-by: Dongjoon Hyun <dongj...@apache.org> --- .github/workflows/build_and_test.yml | 1 + dev/run-tests.py | 2 +- 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml index 62f37d3..66a0eda 100644 --- a/.github/workflows/build_and_test.yml +++ b/.github/workflows/build_and_test.yml @@ -170,6 +170,7 @@ jobs: HIVE_PROFILE: hive2.3 GITHUB_PREV_SHA: ${{ github.event.before }} SPARK_LOCAL_IP: localhost + SKIP_UNIDOC: true steps: - name: Checkout Spark repository uses: actions/checkout@v2 diff --git a/dev/run-tests.py b/dev/run-tests.py index 3055dcc..97523e7 100755 --- a/dev/run-tests.py +++ b/dev/run-tests.py @@ -397,7 +397,7 @@ def build_spark_assembly_sbt(extra_profiles, checkstyle=False): if checkstyle: run_java_style_checks(build_profiles) - if not os.environ.get("AMPLAB_JENKINS"): + if not os.environ.get("AMPLAB_JENKINS") and not os.environ.get("SKIP_UNIDOC"): build_spark_unidoc_sbt(extra_profiles) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org