jinchengchenghh commented on code in PR #9559:
URL: https://github.com/apache/incubator-gluten/pull/9559#discussion_r2079265383
##########
backends-velox/src/main/scala/org/apache/gluten/backendsapi/velox/VeloxListenerApi.scala:
##########
@@ -204,9 +204,17 @@ class VeloxListenerApi extends ListenerApi with Logging {
if (StringUtils.isNotBlank(libPath)) { // Path based load. Ignore all
other loadees.
JniLibLoader.loadFromPath(libPath)
} else {
+ if (
+ conf.getBoolean(
+ GlutenConfig.COLUMNAR_CUDF_ENABLED.key,
+ GlutenConfig.COLUMNAR_CUDF_ENABLED.defaultValue.get)
+ ) {
+ loader.load(s"$platformLibDir/${System.mapLibraryName("cudf")}")
+ }
Review Comment:
If I don't load it, this exception will throw
```
25/05/08 09:16:11 WARN JniLibLoader: Successfully loaded library
linux/amd64/libgluten.so
java.lang.UnsatisfiedLinkError:
/tmp/gluten-43efb362-c111-4abe-90db-883530afcef8/jni/c68c098b-ed1a-46bd-ba1c-c0099dda9ad0/gluten-5382945303932056321/linux/amd64/libvelox.so:
libcudf.so: cannot open shared object file: No such file or directory
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1934)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1817)
at java.lang.Runtime.load0(Runtime.java:782)
at java.lang.System.load(System.java:1100)
at org.apache.gluten.jni.JniLibLoader.loadFromPath0(JniLibLoader.java:64)
at org.apache.gluten.jni.JniLibLoader.loadWithLink(JniLibLoader.java:131)
at org.apache.gluten.jni.JniLibLoader.load(JniLibLoader.java:85)
```
```
[root@533b3b8b49de amd64]# ldd libvelox.so
ldd: warning: you do not have execution permission for `./libvelox.so'
linux-vdso.so.1 (0x00007fff3a7dd000)
libgluten.so => /opt/gluten/cpp/build/releases/libgluten.so
(0x00007fb985fee000)
libfolly.so.0.58.0-dev => /usr/local/lib/libfolly.so.0.58.0-dev
(0x00007fb984b4b000)
libre2.so.9 => /lib64/libre2.so.9 (0x00007fb984ad0000)
libicui18n.so.67 => /lib64/libicui18n.so.67 (0x00007fb9847ca000)
libicuuc.so.67 => /lib64/libicuuc.so.67 (0x00007fb9845df000)
libicudata.so.67 => /lib64/libicudata.so.67 (0x00007fb982ac4000)
libcudf.so => /opt/gluten/cpp/build/releases/libcudf.so
(0x00007fb96fef5000)
```
```
[root@533b3b8b49de opt]# cd linux/amd64/lib
libcudf.so libgluten.so libvelox.so
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
