jinwenjie123 opened a new issue, #1552:
URL: https://github.com/apache/datafusion-comet/issues/1552
### What is the problem the feature request solves?
I am running a benchmark to evaluate the performance of Spark 3.4 with Comet
in an AWS environment. I built the Comet JAR on my local machine (macOS), but
encountered the following error:
`Driver WARN org.apache.comet.NativeBase Failed to load comet library
java.lang.UnsupportedOperationException: Unsupported OS/arch, cannot find
/org/apache/comet/linux/amd64/libcomet.so. Please try building from source.
at org.apache.comet.NativeBase.bundleLoadLibrary(NativeBase.java:114)
~[comet-spark-spark3.4_2.13-0.8.0-SNAPSHOT.jar:0.8.0-SNAPSHOT]
...
Comet extension is disabled due to an error while loading the native
library, falling back to Spark.`
It seems the Comet JAR I built on macOS is not compatible with the driver's
environment. I assume I need to specify the target OS and architecture when
building the JAR.
Could you provide guidance on how to specify the target environment when
building the Comet JAR to solve this issue ?
Thanks!
### Describe the potential solution
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
