This is an automated email from the ASF dual-hosted git repository.
yuanzhou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 4dfdfd77b5 [GLUTEN-6887][VL] Daily Update Velox Version (2024_11_26)
(#8042)
4dfdfd77b5 is described below
commit 4dfdfd77b52f2f98fa0cf32eca143b47e4bd11b5
Author: Gluten Performance Bot
<[email protected]>
AuthorDate: Tue Nov 26 16:25:00 2024 +0800
[GLUTEN-6887][VL] Daily Update Velox Version (2024_11_26) (#8042)
Upstream Velox's New Commits:
f33b40da0 by zhli1142015, feat(ABFS): Add dependency for ABFS Auth support
(11633)
22392b175 by duanmeng, feat: Specifiy target tracing driver IDs (11560)
2b5e9f1a5 by Yenda Li, fix:Support hashing ipaddress (11640)
97bd72825 by Xiaoxuan Meng, feat: Add skewed partition balancer (11635)
97e47daf5 by Jacob Wujciak-Jens, build(ci): Fix scheduled.yml syntax (11652)
e27867ca2 by Jia Ke, fix: Move the thread local parameter from method to
member parameter in HdfsReadFile (11580)
---
.github/workflows/velox_backend.yml | 22 ++++++++++++++--------
ep/build-velox/src/get_velox.sh | 2 +-
2 files changed, 15 insertions(+), 9 deletions(-)
diff --git a/.github/workflows/velox_backend.yml
b/.github/workflows/velox_backend.yml
index d7445d1a27..56b43975ac 100644
--- a/.github/workflows/velox_backend.yml
+++ b/.github/workflows/velox_backend.yml
@@ -56,9 +56,8 @@ concurrency:
jobs:
build-native-lib-centos-7:
runs-on: ubuntu-20.04
- container: apache/gluten:vcpkg-centos-7
steps:
- - uses: actions/checkout@v2
+ - uses: actions/checkout@v4
- name: Get Ccache
uses: actions/cache/restore@v3
with:
@@ -68,10 +67,17 @@ jobs:
ccache-centos7-release-default
- name: Build Gluten native libraries
run: |
- df -a
- cd $GITHUB_WORKSPACE/
- bash dev/ci-velox-buildstatic-centos-7.sh
- ccache -s
+ docker pull apache/gluten:vcpkg-centos-7
+ docker run -v $GITHUB_WORKSPACE:/work -w /work
apache/gluten:vcpkg-centos-7 bash -c "
+ df -a
+ cd /work
+ export CCACHE_DIR=/work/.ccache
+ bash dev/ci-velox-buildstatic-centos-7.sh
+ ccache -s
+ mkdir -p /work/.m2/repository/org/apache/arrow/
+ cp -r /root/.m2/repository/org/apache/arrow/*
/work/.m2/repository/org/apache/arrow/
+ "
+
- name: "Save ccache"
uses: actions/cache/save@v3
id: ccache
@@ -85,7 +91,7 @@ jobs:
- uses: actions/upload-artifact@v3
with:
name: arrow-jars-centos-7-${{github.sha}}
- path: /root/.m2/repository/org/apache/arrow/
+ path: .m2/repository/org/apache/arrow/
run-tpc-test-ubuntu:
needs: build-native-lib-centos-7
@@ -163,7 +169,7 @@ jobs:
strategy:
fail-fast: false
matrix:
- os: [ "centos:7", "centos:8" ]
+ os: [ "centos:8" ] #TODO: add centos7 tests back with docker run
spark: [ "spark-3.2", "spark-3.3", "spark-3.4", "spark-3.5" ]
java: [ "java-8", "java-11", "java-17" ]
# Spark supports JDK17 since 3.3 and later, see
https://issues.apache.org/jira/browse/SPARK-33772
diff --git a/ep/build-velox/src/get_velox.sh b/ep/build-velox/src/get_velox.sh
index d95f742a55..bcab2e31db 100755
--- a/ep/build-velox/src/get_velox.sh
+++ b/ep/build-velox/src/get_velox.sh
@@ -17,7 +17,7 @@
set -exu
VELOX_REPO=https://github.com/oap-project/velox.git
-VELOX_BRANCH=2024_11_24
+VELOX_BRANCH=2024_11_26
VELOX_HOME=""
OS=`uname -s`
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
