Hey Ayush, thanks for the advice!
Building 3.3.6 from an EL9.4 machine resulted in the following:
[root@localhost bin]# JAVA_HOME=/etc/alternatives/java_sdk_openjdk/
./hadoop checknative -a
2024-05-25 19:05:56,068 INFO bzip2.Bzip2Factory: Successfully loaded &
initialized native-bzip2 library system-native
2024-05-25 19:05:56,071 INFO zlib.ZlibFactory: Successfully loaded &
initialized native-zlib library
2024-05-25 19:05:56,097 INFO nativeio.NativeIO: The native code was
built without PMDK support.
Native library checking:
hadoop: true
/root/build/hadoop-3.3.6-src/hadoop-dist/target/hadoop-3.3.6/lib/native/libhadoop.so.1.0.0
zlib: true /lib64/libz.so.1
zstd : true /lib64/libzstd.so.1
bzip2: true /lib64/libbz2.so.1
openssl: false EVP_CIPHER_CTX_block_size
ISA-L: true /lib64/libisal.so.2
PMDK: false The native code was built without PMDK support.
No mention of lz4, though lz4[-devel] packages were installed on the
compiling host as per the BUILDING instructions. Is there a build option
I'm missing? I'm using:
* mvn -X package -Pdist,native -DskipTests -Dtar -Dmaven.javadoc.skip=true
Unfortunately the hbase "org.apache.hadoop.util.NativeLibraryChecker",
using this freshly made hadoop native library, also failed to load lz4
in the same way as the initial message with no extra information from debug:
2024-05-25T19:03:42,320 WARN [main] lz4.Lz4Compressor:
java.lang.UnsatisfiedLinkError: 'void
org.apache.hadoop.io.compress.lz4.Lz4Compressor.initIDs()'
Exception in thread "main" java.lang.UnsatisfiedLinkError:
'java.lang.String
org.apache.hadoop.io.compress.lz4.Lz4Compressor.getLibraryName()'
at
org.apache.hadoop.io.compress.lz4.Lz4Compressor.getLibraryName(Native
Method)
at
org.apache.hadoop.io.compress.Lz4Codec.getLibraryName(Lz4Codec.java:73)
at
org.apache.hadoop.util.NativeLibraryChecker.main(NativeLibraryChecker.java:109)
Thanks for your help!
On 5/25/24 4:16 PM, Ayush Saxena wrote:
above things don't work then enable debug logging &
then run the checknative command and capture the log & exception as
here [2] & they might give you an an
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
For additional commands, e-mail: user-h...@hadoop.apache.org
