This is an automated email from the ASF dual-hosted git repository.
apitrou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 3c2e74ce9c GH-37373: [CI] Make integration build a bit leaner (#37366)
3c2e74ce9c is described below
commit 3c2e74ce9c9ad195a2db53dea2fc241e77cacf0b
Author: Antoine Pitrou <[email protected]>
AuthorDate: Thu Aug 31 19:30:39 2023 +0200
GH-37373: [CI] Make integration build a bit leaner (#37366)
### Rationale for this change
Some CI builds on GitHub Actions occasionally fail for disk space issues.
The conda-integration build is one of them:
https://github.com/apache/arrow/actions/runs/5966046880/attempts/2?pr=37341
### What changes are included in this PR?
1. Disable more C++ components in the integration build.
2. Remove intermediate build artifacts at the end of a C++ CI build (object
files).
3. Remove intermediate build directories at the end of a Rust CI build.
### Are these changes tested?
Self-tested by definition.
### Are there any user-facing changes?
No.
* Closes: #37373
Authored-by: Antoine Pitrou <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
---
ci/docker/conda-integration.dockerfile | 2 ++
ci/scripts/cpp_build.sh | 3 +++
ci/scripts/rust_build.sh | 5 +++++
3 files changed, 10 insertions(+)
diff --git a/ci/docker/conda-integration.dockerfile
b/ci/docker/conda-integration.dockerfile
index da315776b5..d6fad57b9f 100644
--- a/ci/docker/conda-integration.dockerfile
+++ b/ci/docker/conda-integration.dockerfile
@@ -67,11 +67,13 @@ ENV ARROW_ACERO=OFF \
ARROW_FLIGHT=ON \
ARROW_FLIGHT_SQL=ON \
ARROW_GANDIVA=OFF \
+ ARROW_GCS=OFF \
ARROW_HDFS=OFF \
ARROW_JEMALLOC=OFF \
ARROW_JSON=OFF \
ARROW_ORC=OFF \
ARROW_PARQUET=OFF \
ARROW_S3=OFF \
+ ARROW_SUBSTRAIT=OFF \
ARROW_USE_GLOG=OFF \
CMAKE_UNITY_BUILD=ON
diff --git a/ci/scripts/cpp_build.sh b/ci/scripts/cpp_build.sh
index d73f4ad230..a420cb64cb 100755
--- a/ci/scripts/cpp_build.sh
+++ b/ci/scripts/cpp_build.sh
@@ -190,6 +190,9 @@ cmake \
export CMAKE_BUILD_PARALLEL_LEVEL=${CMAKE_BUILD_PARALLEL_LEVEL:-$[${n_jobs} +
1]}
time cmake --build . --target install
+# Save disk space by removing large temporary build products
+find . -name "*.o" -delete
+
popd
if [ -x "$(command -v ldconfig)" ]; then
diff --git a/ci/scripts/rust_build.sh b/ci/scripts/rust_build.sh
index 3532ea3d5c..2dfc0f1b18 100755
--- a/ci/scripts/rust_build.sh
+++ b/ci/scripts/rust_build.sh
@@ -56,4 +56,9 @@ pushd ${source_dir}
# build only the integration testing binaries
cargo build -p arrow-integration-testing
+# Save disk space by removing large temporary build products
+rm -rf target/debug/deps
+rm -rf target/debug/build
+rm -rf target/debug/incremental
+
popd