This is an automated email from the ASF dual-hosted git repository.
yuanzhou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new c2503951e6 [INFRA] Minor follow-up for PR #11482, remove SPARK_HOME
setting from cudf docker build (#11490)
c2503951e6 is described below
commit c2503951e6f752014fae371621b909f472b1f17f
Author: PHILO-HE <[email protected]>
AuthorDate: Mon Jan 26 23:11:40 2026 +0800
[INFRA] Minor follow-up for PR #11482, remove SPARK_HOME setting from cudf
docker build (#11490)
The SPARK_HOME was set with nonexistent directory. It seems not really used.
Follow-up for #11482.
---
dev/docker/cudf/Dockerfile | 5 +----
1 file changed, 1 insertion(+), 4 deletions(-)
diff --git a/dev/docker/cudf/Dockerfile b/dev/docker/cudf/Dockerfile
index 597ec33fd0..f8b05e75fb 100644
--- a/dev/docker/cudf/Dockerfile
+++ b/dev/docker/cudf/Dockerfile
@@ -16,8 +16,6 @@
#
FROM ghcr.io/facebookincubator/velox-dev:adapters
-ENV SPARK_HOME=/opt/spark-3.4.4-bin-hadoop3
-ENV PATH=$SPARK_HOME/bin:$PATH
ENV CUDA_ARCHITECTURES=70
ENV
LD_LIBRARY_PATH=/opt/gluten/ep/build-velox/build/velox_ep/_build/release/_deps/curl-build/lib:$LD_LIBRARY_PATH
@@ -25,15 +23,14 @@ ENV
LD_LIBRARY_PATH=/opt/gluten/ep/build-velox/build/velox_ep/_build/release/_de
RUN yum install -y sudo patch maven perl && \
dnf remove -y cuda-toolkit-12* && dnf install -y cuda-toolkit-13-1; \
dnf autoremove -y && dnf clean all; \
+ rm -rf /opt/rh/gcc-toolset-12 && ln -s /opt/rh/gcc-toolset-14
/opt/rh/gcc-toolset-12; \
ln -sf /usr/local/bin/cmake /usr/bin && \
git clone --depth=1 https://github.com/apache/incubator-gluten /opt/gluten
&& \
cd /opt/gluten/.github/workflows/util/ && \
- ./install-spark-resources.sh 3.4 && \
cd /opt/gluten && \
source /opt/rh/gcc-toolset-14/enable && \
bash ./dev/buildbundle-veloxbe.sh --run_setup_script=OFF --build_arrow=ON
--spark_version=3.4 --build_tests=ON --build_benchmarks=ON --enable_gpu=ON && \
rm -rf /opt/gluten && \
- rm -rf /opt/spark-3.4.4-bin-hadoop3 && \
rm -rf /root/.cache/ccache
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
