This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 12707981ad7 [SPARK-45973][SPARK-45982][INFRA][FOLLOWUPS] Restore
apt-get/r installations for branch-3.3/3.4/3.5
12707981ad7 is described below
commit 12707981ad789ef145acedd6a12ee3e6390ec1a4
Author: Ruifeng Zheng <[email protected]>
AuthorDate: Mon Nov 20 00:09:35 2023 -0800
[SPARK-45973][SPARK-45982][INFRA][FOLLOWUPS] Restore apt-get/r
installations for branch-3.3/3.4/3.5
### What changes were proposed in this pull request?
Restore apt-get/r installations for branch-3.3/3.4/3.5
### Why are the changes needed?
to restore daily builds for branch-3.3/3.4/3.5
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
ci
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #43904 from zhengruifeng/infra_apt_r_followup.
Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/build_and_test.yml | 27 +++++++++++++++++++++++++++
1 file changed, 27 insertions(+)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index a2e2b1b2c2d..b56314133cb 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -712,10 +712,37 @@ jobs:
- name: Python code generation check
if: inputs.branch != 'branch-3.3' && inputs.branch != 'branch-3.4'
run: if test -f ./dev/connect-check-protos.py; then
PATH=$PATH:$HOME/buf/bin PYTHON_EXECUTABLE=python3.9
./dev/connect-check-protos.py; fi
+ # Should delete this section after SPARK 3.5 EOL.
+ - name: Install JavaScript linter dependencies for branch-3.3, branch-3.4,
branch-3.5
+ if: inputs.branch == 'branch-3.3' || inputs.branch == 'branch-3.4' ||
inputs.branch == 'branch-3.5'
+ run: |
+ apt update
+ apt-get install -y nodejs npm
- name: JS linter
run: ./dev/lint-js
+ # Should delete this section after SPARK 3.5 EOL.
+ - name: Install R linter dependencies for branch-3.3, branch-3.4,
branch-3.5
+ if: inputs.branch == 'branch-3.3' || inputs.branch == 'branch-3.4' ||
inputs.branch == 'branch-3.5'
+ run: |
+ apt update
+ apt-get install -y libcurl4-openssl-dev libgit2-dev libssl-dev
libxml2-dev \
+ libfontconfig1-dev libharfbuzz-dev libfribidi-dev libfreetype6-dev
libpng-dev \
+ libtiff5-dev libjpeg-dev
+ Rscript -e "install.packages(c('devtools'),
repos='https://cloud.r-project.org/')"
+ Rscript -e "devtools::install_version('lintr', version='2.0.1',
repos='https://cloud.r-project.org')"
- name: Install R linter dependencies and SparkR
run: ./R/install-dev.sh
+ # Should delete this section after SPARK 3.5 EOL.
+ - name: Install dependencies for documentation generation for branch-3.3,
branch-3.4, branch-3.5
+ if: inputs.branch == 'branch-3.3' || inputs.branch == 'branch-3.4' ||
inputs.branch == 'branch-3.5'
+ run: |
+ # pandoc is required to generate PySpark APIs as well in nbsphinx.
+ apt-get update -y
+ apt-get install -y libcurl4-openssl-dev pandoc
+ apt-get install -y ruby ruby-dev
+ Rscript -e "install.packages(c('devtools', 'testthat', 'knitr',
'rmarkdown', 'markdown', 'e1071', 'roxygen2', 'ggplot2', 'mvtnorm', 'statmod'),
repos='https://cloud.r-project.org/')"
+ Rscript -e "devtools::install_version('pkgdown', version='2.0.1',
repos='https://cloud.r-project.org')"
+ Rscript -e "devtools::install_version('preferably', version='0.4',
repos='https://cloud.r-project.org')"
- name: Install dependencies for documentation generation
run: |
# TODO(SPARK-32407): Sphinx 3.1+ does not correctly index nested
classes.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
