rajatma1993 opened a new issue, #8659:
URL: https://github.com/apache/incubator-gluten/issues/8659
### Problem description
[CH]
Hi Team, I am working on Building Gluten with the Click House Backend and
benchmark it , But my build is Failing after adding the option to build with
the Benchmark_local_engine executable.
Below is Cmake command I am using to build
sudo cmake -G Ninja "-DCMAKE_C_COMPILER=$CC" "-DCMAKE_CXX_COMPILER=$CXX" \
"-DCMAKE_BUILD_TYPE=Release" \
"-DENABLE_PROTOBUF=1"
"-DENABLE_EMBEDDED_COMPILER=$ENABLE_EMBEDDED_COMPILER" \
"-DENABLE_TESTS=OFF" \
"-DWERROR=OFF" \
"-DENABLE_JEMALLOC=1" \
"-DENABLE_MULTITARGET_CODE=ON" \
"-DENABLE_GWP_ASAN=OFF" \
"-DENABLE_EXTERN_LOCAL_ENGINE=ON" \
"-DENABLE_THINLTO=false" \
"-DENABLE_BENCHMARKS=ON" \
..
Below are versions i am using
HADOOP - 3.6.1
spark 3.3.1
java 8
maven 3.6.3
clang 18
### System information
Gluten Version: 1.4.0-SNAPSHOT
Commit:
https://github.com/apache/incubator-gluten/commit/291ff35722430ebcab98f957a3daa0b787d111d6
CMake Version: 3.28.3
System: Linux-6.8.0-1021-aws
Arch: x86_64
CPU Name: Model name: Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz
C++ Compiler: /usr/bin/clang++-18
C++ Compiler Version: 18.1.8
C Compiler: /usr/bin/clang-18
C Compiler Version: 18.1.8
CMake Prefix Path:
/usr/local;/usr;/;/usr/local/lib/python3.10/dist-packages/cmake/data;/usr/local;/usr/X11R6;/usr/pkg;/opt
### CMake log
```bash
[0/2] Re-checking globbed directories...
[14039/14069] Building CXX object
utils/extern-local-engine/tests/CMakeFiles/benchmark_local_engine.dir/benchmark_local_engine.cpp.o
FAILED:
utils/extern-local-engine/tests/CMakeFiles/benchmark_local_engine.dir/benchmark_local_engine.cpp.o
/usr/bin/ccache /usr/bin/clang++-18 --target=x86_64-linux-gnu
--sysroot=/home/rajatma/ClickHouse/cmake/linux/../../contrib/sysroot/linux-x86_64/x86_64-linux-gnu/libc
-DBOOST_ASIO_HAS_STD_INVOKE_RESULT=1 -DBOOST_ASIO_STANDALONE=1
-DBOOST_TIMER_ENABLE_DEPRECATED=1 -DBSONCXX_STATIC -DCARES_STATICLIB
-DDUMMY_BACKTRACE -DENABLE_MULTITARGET_CODE=1 -DENABLE_SQIDS -DFIU_ENABLE
-DHAVE_BZLIB_H=1 -DHAVE_CONFIG_H -DHAVE_FUTIMESAT=1 -DHAVE_ICONV=1
-DHAVE_LIBLZMA=1 -DHAVE_LIBZSTD=1 -DHAVE_LINUX_FS_H=1 -DHAVE_LINUX_TYPES_H=1
-DHAVE_LZMA_H=1 -DHAVE_STRUCT_STAT_ST_MTIM_TV_NSEC=1 -DHAVE_SYS_STATFS_H=1
-DHAVE_ZLIB_H=1 -DHAVE_ZSTD_H=1 -DHAVE_ZSTD_compressStream=1
-DINCBIN_SILENCE_BITCODE_WARNING -DINTREE -DMAJOR_IN_SYSMACROS=1
-DMONGOCXX_STATIC -DPOCO_ENABLE_CPP11 -DPOCO_HAVE_FD_EPOLL
-DPOCO_OS_FAMILY_UNIX -DSIMSIMD_DYNAMIC_DISPATCH
-DSTD_EXCEPTION_HAS_STACK_TRACE=1 -DUNALIGNED_OK -DUSEARCH_CAN_COMPILE_BF16
-DUSEARCH_CAN_COMPILE_FLOAT16 -DUSEARCH_USE_FP16LIB -DUSEARCH_USE_SIMSIMD
-DUSE_CLICKHOUSE_THR
EADS=1 -DWITH_COVERAGE=0 -DWITH_GZFILEOP -DX86_64 -DXXH_INLINE_ALL
-DZLIB_COMPAT -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS
-D_LIBUNWIND_IS_NATIVE_ONLY -I/home/rajatma/ClickHouse/build/includes/configs
-I/usr/lib/jvm/default-java/include -I/usr/lib/jvm/default-java/include/linux
-I/home/rajatma/ClickHouse/build/utils/extern-local-engine/proto
-I/home/rajatma/ClickHouse/contrib/thrift/lib/cpp/src
-I/home/rajatma/ClickHouse/build/contrib/thrift-cmake
-I/home/rajatma/ClickHouse/utils/extern-local-engine
-I/home/rajatma/ClickHouse/src -I/home/rajatma/ClickHouse/base
-I/home/rajatma/ClickHouse/contrib/orc/c++/include
-I/home/rajatma/ClickHouse/contrib/arrow-cmake/cpp/src/orc/c++/include
-I/home/rajatma/ClickHouse/contrib/llvm-project/utils/bazel/llvm-project-overlay/llvm/include
-I/home/rajatma/ClickHouse/contrib/libdivide-cmake
-I/home/rajatma/ClickHouse/utils/extern-local-engine/tests/benchmark_local_engine
-I/home/rajatma/ClickHouse/build/contrib/llvm-project/libcxx/include/c++/v1 -I/
home/rajatma/ClickHouse/base/glibc-compatibility/memcpy
-I/home/rajatma/ClickHouse/build/src -I/home/rajatma/ClickHouse/base/base/..
-I/home/rajatma/ClickHouse/build/base/base/..
-I/home/rajatma/ClickHouse/contrib/cctz/include
-I/home/rajatma/ClickHouse/contrib/re2
-I/home/rajatma/ClickHouse/base/pcg-random/.
-I/home/rajatma/ClickHouse/contrib/libfiu/libfiu
-I/home/rajatma/ClickHouse/contrib/libssh/include
-I/home/rajatma/ClickHouse/build/contrib/libssh/include
-I/home/rajatma/ClickHouse/contrib/miniselect/include
-I/home/rajatma/ClickHouse/contrib/zstd/lib
-I/home/rajatma/ClickHouse/contrib/pocketfft
-I/home/rajatma/ClickHouse/contrib/libarchive-cmake
-I/home/rajatma/ClickHouse/contrib/libarchive/libarchive
-I/home/rajatma/ClickHouse/contrib/libfarmhash
-I/home/rajatma/ClickHouse/src/Common/mysqlxx/.
-I/home/rajatma/ClickHouse/contrib/libmetrohash/src
-I/home/rajatma/ClickHouse/contrib/murmurhash/include
-I/home/rajatma/ClickHouse/contrib/idna/include -isystem /home/rajatma/ClickHo
use/build/contrib/llvm-project/llvm/include -isystem
/home/rajatma/ClickHouse/build/contrib/orc/c++/include -isystem
/home/rajatma/ClickHouse/contrib/azure/sdk/storage/azure-storage-blobs/inc
-isystem /home/rajatma/ClickHouse/contrib/azure/sdk/core/azure-core/inc
-isystem
/home/rajatma/ClickHouse/contrib/azure/sdk/storage/azure-storage-common/inc
-isystem /home/rajatma/ClickHouse/contrib/llvm-project/llvm/include -isystem
/home/rajatma/ClickHouse/contrib/libdivide -isystem
/home/rajatma/ClickHouse/utils/extern-local-engine/tests/PUBLIC -isystem
/home/rajatma/ClickHouse/utils/extern-local_engine -isystem
/home/rajatma/ClickHouse/contrib/llvm-project/libcxx/include -isystem
/home/rajatma/ClickHouse/contrib/llvm-project/libcxxabi/include -isystem
/home/rajatma/ClickHouse/contrib/libunwind/include -isystem
/home/rajatma/ClickHouse/contrib/arrow/cpp/src -isystem
/home/rajatma/ClickHouse/build/contrib/arrow-cmake/cpp/src -isystem
/home/rajatma/ClickHouse/contrib/arrow-cmake/cpp/src -isyst
em /home/rajatma/ClickHouse/contrib/boost -isystem
/home/rajatma/ClickHouse/contrib/google-protobuf/src -isystem
/home/rajatma/ClickHouse/contrib/zlib-ng -isystem
/home/rajatma/ClickHouse/build/contrib/zlib-ng-cmake -isystem
/home/rajatma/ClickHouse/contrib/abseil-cpp -isystem
/home/rajatma/ClickHouse/contrib/jemalloc-cmake/include -isystem
/home/rajatma/ClickHouse/contrib/sparsehash-c11 -isystem
/home/rajatma/ClickHouse/contrib/incbin -isystem
/home/rajatma/ClickHouse/contrib/numactl -isystem
/home/rajatma/ClickHouse/contrib/cityhash102/include -isystem
/home/rajatma/ClickHouse/base/poco/Net/include -isystem
/home/rajatma/ClickHouse/base/poco/Foundation/include -isystem
/home/rajatma/ClickHouse/base/poco/NetSSL_OpenSSL/include -isystem
/home/rajatma/ClickHouse/base/poco/Crypto/include -isystem
/home/rajatma/ClickHouse/contrib/openssl-cmake/linux_x86_64/include -isystem
/home/rajatma/ClickHouse/contrib/openssl/include -isystem
/home/rajatma/ClickHouse/base/poco/Util/include -isystem
/home/rajatma/ClickHouse/base/poco/JSON/include -isystem
/home/rajatma/ClickHouse/base/poco/XML/include -isystem
/home/rajatma/ClickHouse/contrib/replxx/include -isystem
/home/rajatma/ClickHouse/contrib/fmtlib-cmake/../fmtlib/include -isystem
/home/rajatma/ClickHouse/contrib/magic_enum/include/magic_enum -isystem
/home/rajatma/ClickHouse/contrib/double-conversion -isystem
/home/rajatma/ClickHouse/contrib/dragonbox/include -isystem
/home/rajatma/ClickHouse/contrib/libdivide-cmake/. -isystem
/home/rajatma/ClickHouse/contrib/pdqsort -isystem
/home/rajatma/ClickHouse/contrib/xz/src/liblzma/api -isystem
/home/rajatma/ClickHouse/contrib/aws/src/aws-cpp-sdk-core/include -isystem
/home/rajatma/ClickHouse/contrib/aws/src/aws-cpp-sdk-identity-management/include
-isystem /home/rajatma/ClickHouse/build/contrib/aws-cmake/include -isystem
/home/rajatma/ClickHouse/contrib/aws/generated/src/aws-cpp-sdk-sts/include
-isystem
/home/rajatma/ClickHouse/contrib/aws/generated/src/aws-cpp-sdk-cognito-iden
tity/include -isystem
/home/rajatma/ClickHouse/contrib/aws/generated/src/aws-cpp-sdk-s3/include
-isystem /home/rajatma/ClickHouse/contrib/aws-c-auth/include -isystem
/home/rajatma/ClickHouse/contrib/aws-c-common/include -isystem
/home/rajatma/ClickHouse/contrib/aws-c-io/include -isystem
/home/rajatma/ClickHouse/contrib/aws-crt-cpp/include -isystem
/home/rajatma/ClickHouse/contrib/aws-c-mqtt/include -isystem
/home/rajatma/ClickHouse/contrib/aws-c-sdkutils/include -isystem
/home/rajatma/ClickHouse/contrib/azure/sdk/identity/azure-identity/inc -isystem
/home/rajatma/ClickHouse/contrib/snappy -isystem
/home/rajatma/ClickHouse/build/contrib/snappy-cmake -isystem
/home/rajatma/ClickHouse/contrib/libbcrypt -isystem
/home/rajatma/ClickHouse/contrib/msgpack-c/include -isystem
/home/rajatma/ClickHouse/build/contrib/liburing/src/include-compat -isystem
/home/rajatma/ClickHouse/build/contrib/liburing/src/include -isystem
/home/rajatma/ClickHouse/contrib/liburing/src/include -isystem /home/rajat
ma/ClickHouse/contrib/fast_float/include -isystem
/home/rajatma/ClickHouse/contrib/QAT-ZSTD-Plugin/src -isystem
/home/rajatma/ClickHouse/contrib/libhdfs3/include -isystem
/home/rajatma/ClickHouse/contrib/wyhash -isystem
/home/rajatma/ClickHouse/contrib/consistent-hashing -isystem
/home/rajatma/ClickHouse/contrib/croaring/cpp -isystem
/home/rajatma/ClickHouse/contrib/croaring/include -isystem
/home/rajatma/ClickHouse/contrib/librdkafka-cmake/include -isystem
/home/rajatma/ClickHouse/contrib/librdkafka/src -isystem
/home/rajatma/ClickHouse/build/contrib/librdkafka-cmake/auxdir -isystem
/home/rajatma/ClickHouse/contrib/cppkafka/include -isystem
/home/rajatma/ClickHouse/contrib/NuRaft/include -isystem
/home/rajatma/ClickHouse/base/poco/Redis/include -isystem
/home/rajatma/ClickHouse/base/poco/MongoDB/include -isystem
/home/rajatma/ClickHouse/contrib/mongo-c-driver/src/libbson/src -isystem
/home/rajatma/ClickHouse/build/contrib/mongo-c-driver/src/libbson/src -isystem
/home/rajatma/ClickH
ouse/contrib/mongo-c-driver/src/common -isystem
/home/rajatma/ClickHouse/contrib/mongo-c-driver/src/libmongoc/src -isystem
/home/rajatma/ClickHouse/contrib/mongo-c-driver/src/utf8proc-2.8.0 -isystem
/home/rajatma/ClickHouse/contrib/mongo-c-driver/src/uthash -isystem
/home/rajatma/ClickHouse/contrib/c-ares/src/lib -isystem
/home/rajatma/ClickHouse/contrib/c-ares/include -isystem
/home/rajatma/ClickHouse/contrib/c-ares-cmake/linux -isystem
/home/rajatma/ClickHouse/contrib/mongo-cxx-driver/src/bsoncxx/include/bsoncxx/v_noabi
-isystem
/home/rajatma/ClickHouse/contrib/mongo-cxx-driver/src/bsoncxx/lib/bsoncxx/v_noabi
-isystem
/home/rajatma/ClickHouse/build/contrib/mongo-cxx-driver/src/bsoncxx/lib/bsoncxx/v_noabi
-isystem
/home/rajatma/ClickHouse/contrib/mongo-cxx-driver/src/mongocxx/include/mongocxx/v_noabi
-isystem
/home/rajatma/ClickHouse/contrib/mongo-cxx-driver/src/mongocxx/lib/mongocxx/v_noabi
-isystem
/home/rajatma/ClickHouse/build/contrib/mongo-cxx-driver/src/mongocxx/lib/mongocxx/
v_noabi -isystem
/home/rajatma/ClickHouse/build/contrib/mariadb-connector-c-cmake/include-public
-isystem /home/rajatma/ClickHouse/contrib/mariadb-connector-c/include -isystem
/home/rajatma/ClickHouse/contrib/mariadb-connector-c/libmariadb -isystem
/home/rajatma/ClickHouse/build/src/Server/grpc_protos -isystem
/home/rajatma/ClickHouse/contrib/grpc/include -isystem
/home/rajatma/ClickHouse/contrib/s2geometry/src -isystem
/home/rajatma/ClickHouse/contrib/s2geometry-cmake -isystem
/home/rajatma/ClickHouse/contrib/AMQP-CPP/include -isystem
/home/rajatma/ClickHouse/contrib/AMQP-CPP -isystem
/home/rajatma/ClickHouse/contrib/libuv/include -isystem
/home/rajatma/ClickHouse/contrib/sqlite-amalgamation -isystem
/home/rajatma/ClickHouse/contrib/rocksdb/include -isystem
/home/rajatma/ClickHouse/contrib/libpqxx/include -isystem
/home/rajatma/ClickHouse/contrib/postgres/src/interfaces/libpq -isystem
/home/rajatma/ClickHouse/contrib/postgres/src/include -isystem
/home/rajatma/ClickHouse/contrib/po
stgres-cmake -isystem
/home/rajatma/ClickHouse/contrib/datasketches-cpp/common/include -isystem
/home/rajatma/ClickHouse/contrib/datasketches-cpp/count/include -isystem
/home/rajatma/ClickHouse/contrib/datasketches-cpp/theta/include -isystem
/home/rajatma/ClickHouse/contrib/libstemmer_c/include -isystem
/home/rajatma/ClickHouse/contrib/wordnet-blast -isystem
/home/rajatma/ClickHouse/contrib/lemmagen-c/include -isystem
/home/rajatma/ClickHouse/contrib/ulid-c/include -isystem
/home/rajatma/ClickHouse/contrib/usearch/include -isystem
/home/rajatma/ClickHouse/contrib/FP16/include -isystem
/home/rajatma/ClickHouse/contrib/SimSIMD/include -isystem
/home/rajatma/ClickHouse/build/contrib/prometheus-protobufs-cmake -isystem
/home/rajatma/ClickHouse/contrib/morton-nd/include -isystem
/home/rajatma/ClickHouse/contrib/xxHash -isystem
/home/rajatma/ClickHouse/contrib/icu/icu4c/source/i18n -isystem
/home/rajatma/ClickHouse/contrib/icu/icu4c/source/common -isystem
/home/rajatma/ClickHouse/contrib/
fastops -isystem /home/rajatma/ClickHouse/contrib/aklomp-base64/include
-isystem /home/rajatma/ClickHouse/contrib/cld2/public -isystem
/home/rajatma/ClickHouse/contrib/sqids-cpp/include -isystem
/home/rajatma/ClickHouse/contrib/h3/src/h3lib/include -isystem
/home/rajatma/ClickHouse/build/contrib/h3/src/h3lib/include -isystem
/home/rajatma/ClickHouse/contrib/vectorscan/src -isystem
/home/rajatma/ClickHouse/contrib/vectorscan-cmake/common -isystem
/home/rajatma/ClickHouse/contrib/simdjson/include -isystem
/home/rajatma/ClickHouse/contrib/rapidjson/include -isystem
/home/rajatma/ClickHouse/contrib/google-benchmark/src/../include
--gcc-toolchain=/home/rajatma/ClickHouse/cmake/linux/../../contrib/sysroot/linux-x86_64
-fdiagnostics-color=always -Wno-enum-constexpr-conversion -fsized-deallocation
-pipe -mssse3 -msse4.1 -msse4.2 -mpclmul -mpopcnt -fasynchronous-unwind-tables
-ffile-prefix-map=/home/rajatma/ClickHouse=. -falign-functions=32
-mbranches-within-32B-boundaries -ffp-contract=off
-fdiagnostics-absolute-paths -fstrict-vtable-pointers -Wall -Wextra
-Wframe-larger-than=65536 -Weverything -Wpedantic -Wvla-cxx-extension
-Wno-zero-length-array -Wno-c++98-compat-pedantic -Wno-c++98-compat
-Wno-c++20-compat -Wno-sign-conversion -Wno-implicit-int-conversion
-Wno-implicit-int-float-conversion -Wno-ctad-maybe-unsupported
-Wno-disabled-macro-expansion -Wno-documentation-unknown-command
-Wno-double-promotion -Wno-exit-time-destructors -Wno-float-equal
-Wno-global-constructors -Wno-missing-prototypes
-Wno-missing-variable-declarations -Wno-padded -Wno-switch-enum
-Wno-undefined-func-template -Wno-unused-template -Wno-weak-template-vtables
-Wno-weak-vtables -Wno-thread-safety-negative -Wno-enum-constexpr-conversion
-Wno-unsafe-buffer-usage -Wno-switch-default -w -ffunction-sections
-fdata-sections -O3 -DNDEBUG -std=c++23 -fPIE -D OS_LINUX
-Wno-deprecated-declarations -Wno-poison-system-directories -nostdinc++ -fPIC
-Wno-reserved-identifier -Wno-deprecated -MD -MT utils
/extern-local-engine/tests/CMakeFiles/benchmark_local_engine.dir/benchmark_local_engine.cpp.o
-MF
utils/extern-local-engine/tests/CMakeFiles/benchmark_local_engine.dir/benchmark_local_engine.cpp.o.d
-o
utils/extern-local-engine/tests/CMakeFiles/benchmark_local_engine.dir/benchmark_local_engine.cpp.o
-c
/home/rajatma/ClickHouse/utils/extern-local-engine/tests/benchmark_local_engine.cpp
/home/rajatma/incubator-gluten/cpp-ch/local-engine/tests/benchmark_local_engine.cpp:560:5:
error: unknown type name 'CHJIT'
560 | CHJIT chjit;
| ^
/home/rajatma/incubator-gluten/cpp-ch/local-engine/tests/benchmark_local_engine.cpp:562:17:
error: use of undeclared identifier 'ColumnData'
562 | std::vector<ColumnData> columns(arguments.size() + 1);
| ^
/home/rajatma/incubator-gluten/cpp-ch/local-engine/tests/benchmark_local_engine.cpp:566:22:
error: use of undeclared identifier 'getColumnData'
566 | columns[i] = getColumnData(column.get());
| ^
/home/rajatma/incubator-gluten/cpp-ch/local-engine/tests/benchmark_local_engine.cpp:572:37:
error: use of undeclared identifier 'getColumnData'
572 | columns[arguments.size()] =
getColumnData(result_column.get());
| ^
4 errors generated.
[14040/14069] Building CXX object
programs/server/CMakeFiles/clickhouse-server-lib.dir/Server.cpp.o
ninja: build stopped: subcommand failed.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
