[
https://issues.apache.org/jira/browse/FLINK-29212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600828#comment-17600828
]
Chesnay Schepler commented on FLINK-29212:
------------------------------------------
Do you know if there is any risk of conflicts when installing the native hadoop
libraries between whatever Hadoop version the user provides and our filesystem
plugins?
> Properly load Hadoop native libraries in Flink docker images
> ------------------------------------------------------------
>
> Key: FLINK-29212
> URL: https://issues.apache.org/jira/browse/FLINK-29212
> Project: Flink
> Issue Type: Bug
> Components: Documentation, flink-docker
> Affects Versions: 1.17.0
> Reporter: Robert Metzger
> Priority: Minor
>
> On startup, Flink logs:
> {code:java}
> 2022-09-04 12:36:03.559 [main] WARN org.apache.hadoop.util.NativeCodeLoader
> - Unable to load native-hadoop library for your platform... using
> builtin-java classes where applicable
> {code}
> Hadoop native libraries are used for:
> - Compression Codecs (bzip2, lz4, zlib)
> - Native IO utilities for HDFS Short-Circuit Local Reads and Centralized
> Cache Management in HDFS
> - CRC32 checksum implementation
> (Source:
> https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/NativeLibraries.html)
> Resolving this for the docker images we are providing should be easy, remove
> one unnecessary WARNing and provide performance benefits for some users.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
