This is an automated email from the ASF dual-hosted git repository.
jlprat pushed a commit to branch 3.9
in repository https://gitbox.apache.org/repos/asf/kafka.git
The following commit(s) were added to refs/heads/3.9 by this push:
new c7d02127b19 KAFKA-17227: Update zstd-jni lib (#16763)
c7d02127b19 is described below
commit c7d02127b19612b606f1b85f2ac88e82725121fb
Author: Josep Prat <[email protected]>
AuthorDate: Mon Aug 5 09:51:46 2024 +0200
KAFKA-17227: Update zstd-jni lib (#16763)
* KAFKA-17227: Update zstd-jni lib
* Add note in upgrade docs
* Change zstd-jni version in docker native file and add warning in
dependencies.gradle file
* Add reference to snappy in upgrade
Reviewers: Chia-Ping Tsai <[email protected]>, Mickael Maison
<[email protected]>
---
LICENSE-binary | 2 +-
docker/native/native-image-configs/resource-config.json | 4 ++--
docs/upgrade.html | 11 +++++++++++
gradle/dependencies.gradle | 3 ++-
4 files changed, 16 insertions(+), 4 deletions(-)
diff --git a/LICENSE-binary b/LICENSE-binary
index 0ca280efeda..817bc3d6e55 100644
--- a/LICENSE-binary
+++ b/LICENSE-binary
@@ -327,7 +327,7 @@ pcollections-4.0.1, see: licenses/pcollections-MIT
---------------------------------------
BSD 2-Clause
-zstd-jni-1.5.6-3 see: licenses/zstd-jni-BSD-2-clause
+zstd-jni-1.5.6-4 see: licenses/zstd-jni-BSD-2-clause
---------------------------------------
BSD 3-Clause
diff --git a/docker/native/native-image-configs/resource-config.json
b/docker/native/native-image-configs/resource-config.json
index 121f24b6372..324d979e8db 100644
--- a/docker/native/native-image-configs/resource-config.json
+++ b/docker/native/native-image-configs/resource-config.json
@@ -25,9 +25,9 @@
}, {
"pattern":"\\Qkafka/kafka-version.properties\\E"
}, {
- "pattern":"\\Qlinux/amd64/libzstd-jni-1.5.6-3.so\\E"
+ "pattern":"\\Qlinux/amd64/libzstd-jni-1.5.6-4.so\\E"
}, {
- "pattern":"\\Qlinux/aarch64/libzstd-jni-1.5.6-3.so\\E"
+ "pattern":"\\Qlinux/aarch64/libzstd-jni-1.5.6-4.so\\E"
}, {
"pattern":"\\Qnet/jpountz/util/linux/amd64/liblz4-java.so\\E"
}, {
diff --git a/docs/upgrade.html b/docs/upgrade.html
index be12f0441d8..5c0387460bb 100644
--- a/docs/upgrade.html
+++ b/docs/upgrade.html
@@ -19,6 +19,17 @@
<script id="upgrade-template" type="text/x-handlebars-template">
+<h4><a id="upgrade_3_9_0" href="#upgrade_3_9_0">Upgrading to 3.9.0 from any
version 0.8.x through 3.8.x</a></h4>
+ <h5><a id="upgrade_390_notable" href="#upgrade_390_notable">Notable
changes in 3.9.0</a></h5>
+ <ul>
+ <li>In case you run your Kafka clusters with no execution permission
for the <code>/tmp</code> partition, Kafka will not work properly. It might
either refuse to start or fail
+ when producing and consuming messages. This is due to the
compression libraries <code>zstd-jni</code> and <code>snappy</code>.
+ To remediate this problem you need to pass the following JVM flags
to Kafka <code>ZstdTempFolder</code> and <code>org.xerial.snappy.tempdir</code>
pointing to a directory with execution permissions.
+ For example, this could be done via the <code>KAFKA_OPTS</code>
environment variable like follows: <code>export
KAFKA_OPTS="-DZstdTempFolder=/opt/kafka/tmp
-Dorg.xerial.snappy.tempdir=/opt/kafka/tmp"</code>.
+ This is a known issue for version 3.8.0 as well.
+ </li>
+ </ul>
+
<h4><a id="upgrade_3_8_0" href="#upgrade_3_8_0">Upgrading to 3.8.0 from any
version 0.8.x through 3.7.x</a></h4>
<h5><a id="upgrade_380_notable" href="#upgrade_380_notable">Notable
changes in 3.8.0</a></h5>
diff --git a/gradle/dependencies.gradle b/gradle/dependencies.gradle
index a2845d0107c..c67167731e7 100644
--- a/gradle/dependencies.gradle
+++ b/gradle/dependencies.gradle
@@ -157,7 +157,8 @@ versions += [
spotbugs: "4.8.0",
zinc: "1.9.2",
zookeeper: "3.8.4",
- zstd: "1.5.6-3",
+ // When updating the zstd version, please do as well in
docker/native/native-image-configs/resource-config.json
+ zstd: "1.5.6-4",
junitPlatform: "1.10.2"
]
