[
https://issues.apache.org/jira/browse/ARROW-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacob Wujciak-Jens updated ARROW-16401:
---------------------------------------
Description:
Analyze the different task in the [existing
workflow|https://github.com/ursa-labs/arrow-r-nightly/blob/master/.github/workflows/build-and-test-all.yml]
and look for redundancies and missing functionality in Crossbow and PR jobs.
Result:
Most functions are already covered in arrow/crossbow jobs only minor
modification for uploading the binaries/package to a nightly repo necessary,
see ARROW-16040 for discussion on where to host them.
Nightly R Jobs (Crossbow):
- homebrew-r-autobrew:
- homebrew-r-brew:
- test-r-devdocs:
- test-r-install-local:
- test-fedora-r-clang-sanitizer:
- test-r-arrow-backwards-compatibility:
- test-r-depsource-bundled:
- test-r-depsource-system:
- test-r-dev-duckdb:
- test-r-gcc-11:
- test-r-gcc-12:
- test-r-linux-as-cran:
- test-r-linux-rchk:
- test-r-linux-valgrind:
- test-r-minimal-build:
- test-r-offline-maximal:
- test-r-offline-minimal:
- test-r-rhub-debian-gcc-devel-lto-latest:
- test-r-rhub-debian-gcc-release-custom-ccache:
- test-r-rhub-ubuntu-gcc-release-latest:
- test-r-rocker-r-base-latest:
- test-r-rstudio-r-base-4.1-centos7-devtoolset-8:
- test-r-rstudio-r-base-4.1-focal:
- test-r-rstudio-r-base-4.1-opensuse15:
- test-r-rstudio-r-base-4.1-opensuse42:
- test-r-ubuntu-22.04:
- test-r-versions:
- test-ubuntu-18.04-r-sanitizer:
PR Job (Arrow):
- AMD64 Ubuntu 20.04 R 4.1 Force-Tests true
- AMD64 Ubuntu 20.04 R 4.1 Force-Tests false
- rstudio/r-base:4.0-centos7 <- update
- rhub/debian-gcc-devel:latest
- AMD64 Windows C++ RTools 35 mingw32
- AMD64 Windows C++ RTools 35 mingw64
- AMD64 Windows C++ RTools 40 mingw32
- AMD64 Windows C++ RTools 40 mingw64
- AMD64 Windows C++ RTools 40 ucrt64
- AMD64 Windows R 3.6 RTools 35
- AMD64 Windows R 4.1 RTools 40
- AMD64 Windows R devel RTools 42
arrow-r-nightly Jobs:
- Source packages
- C++ Binary ubuntu-18.04
- C++ Binary centos-7
- C++ Binary Windows RTools (40 only)
- Test linux source build
- Test binary rhub/ubuntu-gcc-release
- Test binary rstudio/r-base:4.1-bionic
- Test binary rstudio/r-base:4.1-centos7
- Test binary rocker/r-ver:3.6.3
- Test binary rocker/r-ver
- Test binary rhub/fedora-clang-devel
- windows-latest 4.0
- windows-latest 4.1
- macos-10.15 4.0
- macos-10.15 4.1
arrow-r-nightly Functions:
- modify version string to include date
- pkgdown -> obsolet
- upload and test R source package
- build & upload libarrow
- build, test & upload macos/linux/windows binaries for \{arrow}
Missing from Arrow/Crossbow:
- CB: macos-10.13 nightly (CRAN tests on it) -> travis?
- CB: macos M1 nightly tests & binaries
- AR: macos on PR
- CB/AR: uploading the libarrow, R source and R binaries to the nightly repo*
- CB?: testing the nightly repo source package <- necessary?
was:
Analyze the different task in the [existing
workflow|https://github.com/ursa-labs/arrow-r-nightly/blob/master/.github/workflows/build-and-test-all.yml]
and look for redundancies and missing functionality in Crossbow and PR jobs.
Result:
Nightly R Jobs (Crossbow):
- homebrew-r-autobrew:
- homebrew-r-brew:
- test-r-devdocs:
- test-r-install-local:
- test-fedora-r-clang-sanitizer:
- test-r-arrow-backwards-compatibility:
- test-r-depsource-bundled:
- test-r-depsource-system:
- test-r-dev-duckdb:
- test-r-gcc-11:
- test-r-gcc-12:
- test-r-linux-as-cran:
- test-r-linux-rchk:
- test-r-linux-valgrind:
- test-r-minimal-build:
- test-r-offline-maximal:
- test-r-offline-minimal:
- test-r-rhub-debian-gcc-devel-lto-latest:
- test-r-rhub-debian-gcc-release-custom-ccache:
- test-r-rhub-ubuntu-gcc-release-latest:
- test-r-rocker-r-base-latest:
- test-r-rstudio-r-base-4.1-centos7-devtoolset-8:
- test-r-rstudio-r-base-4.1-focal:
- test-r-rstudio-r-base-4.1-opensuse15:
- test-r-rstudio-r-base-4.1-opensuse42:
- test-r-ubuntu-22.04:
- test-r-versions:
- test-ubuntu-18.04-r-sanitizer:
PR Job (Arrow):
- AMD64 Ubuntu 20.04 R 4.1 Force-Tests true
- AMD64 Ubuntu 20.04 R 4.1 Force-Tests false
- rstudio/r-base:4.0-centos7 <- update
- rhub/debian-gcc-devel:latest
- AMD64 Windows C++ RTools 35 mingw32
- AMD64 Windows C++ RTools 35 mingw64
- AMD64 Windows C++ RTools 40 mingw32
- AMD64 Windows C++ RTools 40 mingw64
- AMD64 Windows C++ RTools 40 ucrt64
- AMD64 Windows R 3.6 RTools 35
- AMD64 Windows R 4.1 RTools 40
- AMD64 Windows R devel RTools 42
arrow-r-nightly Jobs:
- Source packages
- C++ Binary ubuntu-18.04
- C++ Binary centos-7
- C++ Binary Windows RTools (40 only)
- Test linux source build
- Test binary rhub/ubuntu-gcc-release
- Test binary rstudio/r-base:4.1-bionic
- Test binary rstudio/r-base:4.1-centos7
- Test binary rocker/r-ver:3.6.3
- Test binary rocker/r-ver
- Test binary rhub/fedora-clang-devel
- windows-latest 4.0
- windows-latest 4.1
- macos-10.15 4.0
- macos-10.15 4.1
arrow-r-nightly Functions:
- modify version string to include date
- pkgdown -> obsolet
- upload and test R source package
- build & upload libarrow
- build, test & upload macos/linux/windows binaries for \{arrow}
Missing from Arrow/Crossbow:
- CB: macos-10.13 nightly (CRAN tests on it) -> travis?
- CB: macos M1 nightly tests & binaries
- AR: macos on PR
- CB/AR: uploading the libarrow, R source and R binaries to the nightly repo*
- CB?: testing the nightly repo source package <- necessary?
> [R][CI] Dissect arrow-r-nightly workflow into Crossbow tasks
> ------------------------------------------------------------
>
> Key: ARROW-16401
> URL: https://issues.apache.org/jira/browse/ARROW-16401
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: Continuous Integration, R
> Reporter: Jacob Wujciak-Jens
> Assignee: Jacob Wujciak-Jens
> Priority: Major
> Fix For: 9.0.0
>
>
> Analyze the different task in the [existing
> workflow|https://github.com/ursa-labs/arrow-r-nightly/blob/master/.github/workflows/build-and-test-all.yml]
> and look for redundancies and missing functionality in Crossbow and PR jobs.
>
> Result:
> Most functions are already covered in arrow/crossbow jobs only minor
> modification for uploading the binaries/package to a nightly repo necessary,
> see ARROW-16040 for discussion on where to host them.
> Nightly R Jobs (Crossbow):
> - homebrew-r-autobrew:
> - homebrew-r-brew:
> - test-r-devdocs:
> - test-r-install-local:
> - test-fedora-r-clang-sanitizer:
> - test-r-arrow-backwards-compatibility:
> - test-r-depsource-bundled:
> - test-r-depsource-system:
> - test-r-dev-duckdb:
> - test-r-gcc-11:
> - test-r-gcc-12:
> - test-r-linux-as-cran:
> - test-r-linux-rchk:
> - test-r-linux-valgrind:
> - test-r-minimal-build:
> - test-r-offline-maximal:
> - test-r-offline-minimal:
> - test-r-rhub-debian-gcc-devel-lto-latest:
> - test-r-rhub-debian-gcc-release-custom-ccache:
> - test-r-rhub-ubuntu-gcc-release-latest:
> - test-r-rocker-r-base-latest:
> - test-r-rstudio-r-base-4.1-centos7-devtoolset-8:
> - test-r-rstudio-r-base-4.1-focal:
> - test-r-rstudio-r-base-4.1-opensuse15:
> - test-r-rstudio-r-base-4.1-opensuse42:
> - test-r-ubuntu-22.04:
> - test-r-versions:
> - test-ubuntu-18.04-r-sanitizer:
> PR Job (Arrow):
> - AMD64 Ubuntu 20.04 R 4.1 Force-Tests true
> - AMD64 Ubuntu 20.04 R 4.1 Force-Tests false
> - rstudio/r-base:4.0-centos7 <- update
> - rhub/debian-gcc-devel:latest
> - AMD64 Windows C++ RTools 35 mingw32
> - AMD64 Windows C++ RTools 35 mingw64
> - AMD64 Windows C++ RTools 40 mingw32
> - AMD64 Windows C++ RTools 40 mingw64
> - AMD64 Windows C++ RTools 40 ucrt64
> - AMD64 Windows R 3.6 RTools 35
> - AMD64 Windows R 4.1 RTools 40
> - AMD64 Windows R devel RTools 42
> arrow-r-nightly Jobs:
> - Source packages
> - C++ Binary ubuntu-18.04
> - C++ Binary centos-7
> - C++ Binary Windows RTools (40 only)
> - Test linux source build
> - Test binary rhub/ubuntu-gcc-release
> - Test binary rstudio/r-base:4.1-bionic
> - Test binary rstudio/r-base:4.1-centos7
> - Test binary rocker/r-ver:3.6.3
> - Test binary rocker/r-ver
> - Test binary rhub/fedora-clang-devel
> - windows-latest 4.0
> - windows-latest 4.1
> - macos-10.15 4.0
> - macos-10.15 4.1
> arrow-r-nightly Functions:
> - modify version string to include date
> - pkgdown -> obsolet
> - upload and test R source package
> - build & upload libarrow
> - build, test & upload macos/linux/windows binaries for \{arrow}
> Missing from Arrow/Crossbow:
> - CB: macos-10.13 nightly (CRAN tests on it) -> travis?
> - CB: macos M1 nightly tests & binaries
> - AR: macos on PR
> - CB/AR: uploading the libarrow, R source and R binaries to the nightly repo*
> - CB?: testing the nightly repo source package <- necessary?
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
