This is an automated email from the ASF dual-hosted git repository.
yuanzhou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
The following commit(s) were added to refs/heads/main by this push:
new 5db9de560 [GLUTEN-6887][VL] Daily Update Velox Version (2024_08_26)
(#7002)
5db9de560 is described below
commit 5db9de560154b40e504cd4087b4884f48b2dae41
Author: Gluten Performance Bot
<[email protected]>
AuthorDate: Mon Aug 26 22:35:25 2024 +0800
[GLUTEN-6887][VL] Daily Update Velox Version (2024_08_26) (#7002)
Upstream Velox's New Commits:
d33cdb251 by Jia Ke, Add RowsStreamingWindowBuild to avoid OOM in Window
operator (9025)
3d10ccfc1 by Ke, Make processConfigs function pure virtual (10827)
8d45b3c78 by Deepak Majeti, Set CRC32 checksum algorithm for S3 multipart
upload (10801)
52c1daaa1 by snadukudy, Add CI migration blog post (10532)
d46459c32 by Yang Zhang, Add write IO metrics and print physical written
bytes in PlanNodeStatstoString (10806)
b5cd1e896 by Krishna Pai, Refactor RowTranslationUtil::toElementRows (10820)
eaec1d349 by Zuyu ZHANG, Fix build errors in Presto due to misconfigured
generated proto file paths (10807)
2111fb59a by Jialiang Tan, Add disable pool management option to memory
manager (10817)
b81dcaa9b by yingsu00, Allow column names to contain space (10784)
b228e0921 by Deepak Majeti, Set ARROW_DEPENDENCY_SOURCE=AUTO for arrow
build (10819)
---
ep/build-velox/src/get_velox.sh | 2 +-
ep/build-velox/src/modify_velox.patch | 17 +++++++++--------
2 files changed, 10 insertions(+), 9 deletions(-)
diff --git a/ep/build-velox/src/get_velox.sh b/ep/build-velox/src/get_velox.sh
index b5da02c47..0948b88de 100755
--- a/ep/build-velox/src/get_velox.sh
+++ b/ep/build-velox/src/get_velox.sh
@@ -17,7 +17,7 @@
set -exu
VELOX_REPO=https://github.com/oap-project/velox.git
-VELOX_BRANCH=2024_08_23
+VELOX_BRANCH=2024_08_26
VELOX_HOME=""
OS=`uname -s`
diff --git a/ep/build-velox/src/modify_velox.patch
b/ep/build-velox/src/modify_velox.patch
index a218fa704..7221aa031 100644
--- a/ep/build-velox/src/modify_velox.patch
+++ b/ep/build-velox/src/modify_velox.patch
@@ -1,8 +1,8 @@
diff --git a/CMake/resolve_dependency_modules/arrow/CMakeLists.txt
b/CMake/resolve_dependency_modules/arrow/CMakeLists.txt
-index 56b673e87..ef48ae9d9 100644
+index ddf1fac71..ef48ae9d9 100644
--- a/CMake/resolve_dependency_modules/arrow/CMakeLists.txt
+++ b/CMake/resolve_dependency_modules/arrow/CMakeLists.txt
-@@ -14,16 +14,13 @@
+@@ -14,17 +14,13 @@
project(Arrow)
if(VELOX_ENABLE_ARROW)
@@ -16,6 +16,7 @@ index 56b673e87..ef48ae9d9 100644
set(ARROW_PREFIX "${CMAKE_CURRENT_BINARY_DIR}/arrow_ep")
set(ARROW_CMAKE_ARGS
- -DARROW_PARQUET=OFF
+- -DARROW_DEPENDENCY_SOURCE=AUTO
+ -DARROW_PARQUET=ON
+ -DARROW_FILESYSTEM=ON
+ -DARROW_PROTOBUF_USE_SHARED=OFF
@@ -24,7 +25,7 @@ index 56b673e87..ef48ae9d9 100644
-DARROW_WITH_THRIFT=ON
-DARROW_WITH_LZ4=ON
-DARROW_WITH_SNAPPY=ON
-@@ -37,18 +34,16 @@ if(VELOX_ENABLE_ARROW)
+@@ -38,18 +34,16 @@ if(VELOX_ENABLE_ARROW)
-DCMAKE_INSTALL_PREFIX=${ARROW_PREFIX}/install
-DCMAKE_BUILD_TYPE=${CMAKE_BUILD_TYPE}
-DARROW_BUILD_STATIC=ON
@@ -48,7 +49,7 @@ index 56b673e87..ef48ae9d9 100644
set_property(TARGET thrift PROPERTY INTERFACE_INCLUDE_DIRECTORIES
${THRIFT_INCLUDE_DIR})
-@@ -67,6 +62,9 @@ if(VELOX_ENABLE_ARROW)
+@@ -68,6 +62,9 @@ if(VELOX_ENABLE_ARROW)
arrow_ep
PREFIX ${ARROW_PREFIX}
URL ${VELOX_ARROW_SOURCE_URL}
@@ -70,10 +71,10 @@ index 69e7f2044..777eb5ec1 100644
+
FetchContent_MakeAvailable(simdjson)
diff --git a/CMakeLists.txt b/CMakeLists.txt
-index cc180b86c..7ca6fa727 100644
+index 7f7cbc92f..52adb1250 100644
--- a/CMakeLists.txt
+++ b/CMakeLists.txt
-@@ -236,10 +236,15 @@ if(VELOX_ENABLE_ABFS)
+@@ -242,10 +242,15 @@ if(VELOX_ENABLE_ABFS)
endif()
if(VELOX_ENABLE_HDFS)
@@ -93,7 +94,7 @@ index cc180b86c..7ca6fa727 100644
add_definitions(-DVELOX_ENABLE_HDFS3)
endif()
-@@ -380,7 +385,7 @@ resolve_dependency(Boost 1.77.0 COMPONENTS
${BOOST_INCLUDE_LIBRARIES})
+@@ -385,7 +390,7 @@ resolve_dependency(Boost 1.77.0 COMPONENTS
${BOOST_INCLUDE_LIBRARIES})
# for reference. find_package(range-v3)
set_source(gflags)
@@ -115,7 +116,7 @@ index 23ef279c2..7e4c2f2b2 100644
+ glog::glog
+ gflags::gflags)
diff --git
a/velox/connectors/hive/storage_adapters/abfs/RegisterAbfsFileSystem.cpp
b/velox/connectors/hive/storage_adapters/abfs/RegisterAbfsFileSystem.cpp
-index 5a566770f..8c2a48cc2 100644
+index a8b0df52a..254c56b70 100644
--- a/velox/connectors/hive/storage_adapters/abfs/RegisterAbfsFileSystem.cpp
+++ b/velox/connectors/hive/storage_adapters/abfs/RegisterAbfsFileSystem.cpp
@@ -38,7 +38,6 @@ std::shared_ptr<FileSystem> abfsFileSystemGenerator(
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
