This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push: new 0a7023f55dd [SPARK-45734][BUILD] Upgrade commons-io to 2.15.0 0a7023f55dd is described below commit 0a7023f55ddc43ab9f0802b84b248fbc646a91aa Author: yangjie01 <yangji...@baidu.com> AuthorDate: Tue Oct 31 22:01:38 2023 -0700 [SPARK-45734][BUILD] Upgrade commons-io to 2.15.0 ### What changes were proposed in this pull request? This pr upgrade commons-io from 2.14.0 to 2.15.0 ### Why are the changes needed? The updates of `commons-io` 2.15.0 mainly focus on fixing bugs in file and stream handling, adding new file and stream handling features, and optimizing the performance of file content comparison: 1. Bug fixes: This version fixes multiple bugs, mainly in file and stream handling. For example, it fixes the encoding matching issue of `XmlStreamReader` (IO-810), the issue that `FileUtils.listFiles` and `FileUtils.iterateFiles` methods failed to close their internal streams (IO-811), and the issue that `StreamIterator` failed to close its internal stream (IO-811). In addition, it also fixes the null pointer exception information of `RandomAccessFileMode.create(Path)`, and the issue [...] 2. New features: This version adds some new classes and methods, such as `org.apache.commons.io.channels.FileChannels`, `RandomAccessFiles#contentEquals(RandomAccessFile, RandomAccessFile)`, `RandomAccessFiles#reset(RandomAccessFile)`, and `org.apache.commons.io.StreamIterator`. In addition, it also added `MessageDigestInputStream` and deprecated `MessageDigestCalculatingInputStream`. 3. Performance optimization: This version optimizes the performance of `PathUtils.fileContentEquals(Path, Path, LinkOption[], OpenOption[])`, `PathUtils.fileContentEquals(Path, Path)`, and `FileUtils.contentEquals(File, File)`. From the release notes, the related performance has improved by about 60%. The full release notes as follow: - https://commons.apache.org/proper/commons-io/changes-report.html#a2.15.0 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Pass GitHub Actions ### Was this patch authored or co-authored using generative AI tooling? No Closes #43592 from LuciferYang/commons-io-215. Lead-authored-by: yangjie01 <yangji...@baidu.com> Co-authored-by: YangJie <yangji...@baidu.com> Signed-off-by: Dongjoon Hyun <dh...@apple.com> --- dev/deps/spark-deps-hadoop-3-hive-2.3 | 2 +- pom.xml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3 b/dev/deps/spark-deps-hadoop-3-hive-2.3 index b5e345ecf0e..6fa0f738cf1 100644 --- a/dev/deps/spark-deps-hadoop-3-hive-2.3 +++ b/dev/deps/spark-deps-hadoop-3-hive-2.3 @@ -43,7 +43,7 @@ commons-compiler/3.1.9//commons-compiler-3.1.9.jar commons-compress/1.24.0//commons-compress-1.24.0.jar commons-crypto/1.1.0//commons-crypto-1.1.0.jar commons-dbcp/1.4//commons-dbcp-1.4.jar -commons-io/2.14.0//commons-io-2.14.0.jar +commons-io/2.15.0//commons-io-2.15.0.jar commons-lang/2.6//commons-lang-2.6.jar commons-lang3/3.13.0//commons-lang3-3.13.0.jar commons-logging/1.1.3//commons-logging-1.1.3.jar diff --git a/pom.xml b/pom.xml index 9f550456cbc..d545c743928 100644 --- a/pom.xml +++ b/pom.xml @@ -192,7 +192,7 @@ <netlib.ludovic.dev.version>3.0.3</netlib.ludovic.dev.version> <commons-codec.version>1.16.0</commons-codec.version> <commons-compress.version>1.24.0</commons-compress.version> - <commons-io.version>2.14.0</commons-io.version> + <commons-io.version>2.15.0</commons-io.version> <!-- org.apache.commons/commons-lang/--> <commons-lang2.version>2.6</commons-lang2.version> <!-- org.apache.commons/commons-lang3/--> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org