This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push:
new fef7bf9 [SPARK-36244][BUILD] Upgrade zstd-jni to 1.5.0-3 to avoid a
bug about buffer size calculation
fef7bf9 is described below
commit fef7bf9fcc22e0e26a97a705b11f14ae36907d0c
Author: Kousuke Saruta <saru...@oss.nttdata.com>
AuthorDate: Wed Jul 21 19:37:05 2021 -0700
[SPARK-36244][BUILD] Upgrade zstd-jni to 1.5.0-3 to avoid a bug about
buffer size calculation
### What changes were proposed in this pull request?
This PR upgrades `zstd-jni` from `1.5.0-2` to `1.5.0-3`.
`1.5.0-3` was released few days ago.
This release resolves an issue about buffer size calculation, which can
affect usage in Spark.
https://github.com/luben/zstd-jni/releases/tag/v1.5.0-3
### Why are the changes needed?
It might be a corner case that skipping length is greater than `2^31 - 1`
but it's possible to affect Spark.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI.
Closes #33464 from sarutak/upgrade-zstd-jni-1.5.0-3.
Authored-by: Kousuke Saruta <saru...@oss.nttdata.com>
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
(cherry picked from commit dcb7db5370cffc1c309671195a325bef7829ec10)
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
---
dev/deps/spark-deps-hadoop-2.7-hive-2.3 | 2 +-
dev/deps/spark-deps-hadoop-3.2-hive-2.3 | 2 +-
pom.xml | 2 +-
3 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-2.7-hive-2.3
b/dev/deps/spark-deps-hadoop-2.7-hive-2.3
index 818899a..e0a4af0 100644
--- a/dev/deps/spark-deps-hadoop-2.7-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-2.7-hive-2.3
@@ -243,4 +243,4 @@ xz/1.8//xz-1.8.jar
zjsonpatch/0.3.0//zjsonpatch-0.3.0.jar
zookeeper-jute/3.6.2//zookeeper-jute-3.6.2.jar
zookeeper/3.6.2//zookeeper-3.6.2.jar
-zstd-jni/1.5.0-2//zstd-jni-1.5.0-2.jar
+zstd-jni/1.5.0-3//zstd-jni-1.5.0-3.jar
diff --git a/dev/deps/spark-deps-hadoop-3.2-hive-2.3
b/dev/deps/spark-deps-hadoop-3.2-hive-2.3
index bd80eb9..49c362c 100644
--- a/dev/deps/spark-deps-hadoop-3.2-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3.2-hive-2.3
@@ -211,4 +211,4 @@ xz/1.8//xz-1.8.jar
zjsonpatch/0.3.0//zjsonpatch-0.3.0.jar
zookeeper-jute/3.6.2//zookeeper-jute-3.6.2.jar
zookeeper/3.6.2//zookeeper-3.6.2.jar
-zstd-jni/1.5.0-2//zstd-jni-1.5.0-2.jar
+zstd-jni/1.5.0-3//zstd-jni-1.5.0-3.jar
diff --git a/pom.xml b/pom.xml
index 3054401..5dc4cd4 100644
--- a/pom.xml
+++ b/pom.xml
@@ -709,7 +709,7 @@
<dependency>
<groupId>com.github.luben</groupId>
<artifactId>zstd-jni</artifactId>
- <version>1.5.0-2</version>
+ <version>1.5.0-3</version>
</dependency>
<dependency>
<groupId>com.clearspring.analytics</groupId>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
