A-little-bit-of-data commented on issue #10102: URL: https://github.com/apache/incubator-gluten/issues/10102#issuecomment-3077722885
> > [211/211] Linking CXX executable vcpkg-test Environment variable VCPKG_FORCE_SYSTEM_BINARIES must be set on arm, s390x, ppc64le and riscv platforms. The command '/bin/sh -c source /opt/rh/gcc-toolset-11/enable && git clone -b branch-1.4 [apache/incubator-gluten.git](https://github.com/apache/incubator-gluten.git) && cd incubator-gluten && ./dev/builddeps-veloxbe.sh --run_setup_script=OFF --enable_s3=ON --enable_gcs=ON --enable_abfs=ON --enable_vcpkg=ON --build_arrow=ON && mvn clean package -Pbackends-velox -Pspark-3.5 -DskipTests' returned a non-zero code: 1 > > How to verify this Environment variable VCPKG_FORCE_SYSTEM_BINARIES? I compiled it on the arm architecture.I used the image of apache/gluten:1.4-vcpkg-centos-8 > > Oh, centos-7 doesn't support ARM. centos8 support but we never tried to use the image build from centos8 on ubuntu20. you may try I switched to X86 architecture to compile, and the compiled dockerfile is: ``` FROM apache/gluten:vcpkg-centos-7 # Build Gluten Jar RUN source /opt/rh/devtoolset-11/enable && \ git clone -b branch-1.4 https://github.com/apache/incubator-gluten.git && \ cd incubator-gluten && \ ./dev/builddeps-veloxbe.sh --run_setup_script=OFF --enable_s3=ON --enable_gcs=ON --enable_abfs=ON --enable_vcpkg=ON --build_arrow=ON && \ mvn clean package -Pbackends-velox -Pspark-3.5 -DskipTests ``` After compiling, put /incubator-gluten/package/target/gluten-velox-bundle-spark3.5_2.12-linux_amd64-1.4.0.jar in the spark jars directory, then start the cluster to view the logs. ``` 25/07/16 17:13:18 INFO Discovery: Start discovering components in the current classpath... 25/07/16 17:13:18 INFO Discovery: Discovered component files: org.apache.gluten.backendsapi.velox.VeloxBackend. Duration: 70 ms. 25/07/16 17:13:18 INFO package: Components registered within order: velox 25/07/16 17:13:18 INFO GlutenDriverPlugin: Gluten build info: ============================================================== Components: Velox Component Velox Branch: <unknown> Component Velox Revision: <unknown> Component Velox Revision Time: <unknown> Gluten Version: 1.4.0 GCC Version: <unknown> Java Version: <unknown> Scala Version: 2.12.15 Spark Version: 3.5.2 Hadoop Version: 3.3.4 Gluten Branch: branch-1.4 Gluten Revision: 50dd117dadb9fe3e9bba5c5002168e1294b2e2bb Gluten Revision Time: 2025-06-06 15:51:55 +0800 Gluten Build Time: 2025-07-16T06:16:11Z Gluten Repo URL: https://hk.gh-proxy.com/https://github.com/apache/incubator-gluten.git ============================================================== 25/07/16 17:13:18 INFO VeloxListenerApi: Memory overhead is not set. Setting it to 1288490188 automatically. Gluten doesn't follow Spark's calculation on default value of this option because the actual required memory overhead will depend on off-heap usage than on on-heap usage. 25/07/16 17:13:18 INFO SparkDirectoryUtil: Created local directory at /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836 25/07/16 17:13:18 INFO JniWorkspace: Creating JNI workspace in root directory /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7 25/07/16 17:13:18 INFO JniWorkspace: JNI workspace /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754 created in root directory /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7 25/07/16 17:13:19 INFO JniLibLoader: Read real path /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libgluten.so for libPath /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libgluten.so 25/07/16 17:13:19 INFO JniLibLoader: Library /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libgluten.so has been loaded using path-loading method 25/07/16 17:13:19 INFO JniLibLoader: Library /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libgluten.so has been loaded 25/07/16 17:13:19 INFO JniLibLoader: Successfully loaded library linux/amd64/libgluten.so 25/07/16 17:13:20 INFO JniLibLoader: Read real path /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libvelox.so for libPath /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libvelox.so 25/07/16 17:13:20 INFO JniLibLoader: Library /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libvelox.so has been loaded using path-loading method 25/07/16 17:13:20 INFO JniLibLoader: Library /var/data/spark-f59074c0-3c5f-488a-b29c-679e62ab1a59/gluten-b1b9b1ad-c680-4632-8175-e35f87099836/jni/85f2aba6-e18b-4925-830a-9a21acc801b7/gluten-2942424804660574754/linux/amd64/libvelox.so has been loaded 25/07/16 17:13:20 INFO JniLibLoader: Successfully loaded library linux/amd64/libvelox.so W20250716 17:13:20.953872 31 MemoryArbitrator.cpp:84] Query memory capacity[921.00MB] is set for NOOP arbitrator which has no capacity enforcement 25/07/16 17:13:20 INFO DriverPluginContainer: Initialized driver component for plugin org.apache.gluten.GlutenPlugin. ``` Why does this happen: ``` Component Velox Branch: <unknown> Component Velox Revision: <unknown> Component Velox Revision Time: <unknown> GCC Version: <unknown> Java Version: <unknown> ``` In the compiled container, ldd --version ldd (GNU libc) 2.17 Copyright (C) 2012 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. Written by Roland McGrath and Ulrich Drepper. java -version openjdk version "1.8.0_412" OpenJDK Runtime Environment (build 1.8.0_412-b08) OpenJDK 64-Bit Server VM (build 25.412-b08, mixed mode) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
