This is an automated email from the ASF dual-hosted git repository.
yangjie01 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 6c7ebe85f33 [SPARK-46067][BUILD] Upgrade commons-compress to 1.25.0
6c7ebe85f33 is described below
commit 6c7ebe85f334f3ee510eb6916980b0feb513e890
Author: yangjie01 <[email protected]>
AuthorDate: Fri Nov 24 11:01:28 2023 +0800
[SPARK-46067][BUILD] Upgrade commons-compress to 1.25.0
### What changes were proposed in this pull request?
This pr aims to upgrade Apache commons-compress from 1.24.0 to 1.25.0
### Why are the changes needed?
The new version of Apache Commons Compress mainly include the following
changes:
1. The ability to restrict autodetection in CompressorStreamFactory has
been added [COMPRESS-648](https://issues.apache.org/jira/browse/COMPRESS-648)
2. The performance of BlockLZ4CompressorOutputStream has been improved.
[COMPRESS-649](https://issues.apache.org/jira/browse/COMPRESS-649)
3. The issue of LZ4 compressor throwing IndexOutOfBoundsException has been
fixed. [COMPRESS-650](https://issues.apache.org/jira/browse/COMPRESS-650)
4. Now, IOException is thrown instead of ArrayIndexOutOfBoundsException
when reading Zip with data descriptor entries.
[COMPRESS-647](https://issues.apache.org/jira/browse/COMPRESS-647)
The full release notes as follows:
-
https://commons.apache.org/proper/commons-compress/changes-report.html#a1.25.0
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Pass GitHub Actions
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #43974 from LuciferYang/SPARK-46067.
Authored-by: yangjie01 <[email protected]>
Signed-off-by: yangjie01 <[email protected]>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 2 +-
pom.xml | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 940ee4a8be2..5a96f3fe9b9 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -40,7 +40,7 @@ commons-codec/1.16.0//commons-codec-1.16.0.jar
commons-collections/3.2.2//commons-collections-3.2.2.jar
commons-collections4/4.4//commons-collections4-4.4.jar
commons-compiler/3.1.9//commons-compiler-3.1.9.jar
-commons-compress/1.24.0//commons-compress-1.24.0.jar
+commons-compress/1.25.0//commons-compress-1.25.0.jar
commons-crypto/1.1.0//commons-crypto-1.1.0.jar
commons-dbcp/1.4//commons-dbcp-1.4.jar
commons-io/2.15.0//commons-io-2.15.0.jar
diff --git a/pom.xml b/pom.xml
index c65794a25c9..ac096a19804 100644
--- a/pom.xml
+++ b/pom.xml
@@ -192,7 +192,7 @@
<snappy.version>1.1.10.5</snappy.version>
<netlib.ludovic.dev.version>3.0.3</netlib.ludovic.dev.version>
<commons-codec.version>1.16.0</commons-codec.version>
- <commons-compress.version>1.24.0</commons-compress.version>
+ <commons-compress.version>1.25.0</commons-compress.version>
<commons-io.version>2.15.0</commons-io.version>
<!-- org.apache.commons/commons-lang/-->
<commons-lang2.version>2.6</commons-lang2.version>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]