This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new ba84447c9b1b [SPARK-56878][BUILD] Upgrade Parquet to 1.17.1
ba84447c9b1b is described below
commit ba84447c9b1b2e3d39a53ec72875f809ee4f58c6
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Mon May 18 09:13:34 2026 -0700
[SPARK-56878][BUILD] Upgrade Parquet to 1.17.1
### What changes were proposed in this pull request?
This PR aims to upgrade Apache Parquet to 1.17.1 for **Apache Spark 5.0.0**
based on our new release plan.
- [SPIP: Accelerating Apache Spark Release
Cadence](https://docs.google.com/document/d/1gBoZ4KH5zQUWpgK3M7zAN7p6Glz4S_e9bO3PvQA9sQs/edit?tab=t.0#heading=h.vj8hviw7ebqz).
### Why are the changes needed?
To bring the latest bug fixes and dependency updates from Apache Parquet
1.17.1.
- [[ANNOUNCE] Apache Parquet Java 1.17.1
(2027-05-11)](https://lists.apache.org/thread/fgyd7m7klggmk6t2fj9lt3qhgzxx8pry)
- https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.17.1
- apache/parquet-java#3113
- apache/parquet-java#3460
- apache/parquet-java#3538
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 4.7
Closes #55903 from dongjoon-hyun/SPARK-56878.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 12 ++++++------
pom.xml | 2 +-
2 files changed, 7 insertions(+), 7 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index d4e1113d5686..bc8f63b5600a 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -241,12 +241,12 @@ orc-shims/2.3.0//orc-shims-2.3.0.jar
oro/2.0.8//oro-2.0.8.jar
osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
paranamer/2.8.3//paranamer-2.8.3.jar
-parquet-column/1.17.0//parquet-column-1.17.0.jar
-parquet-common/1.17.0//parquet-common-1.17.0.jar
-parquet-encoding/1.17.0//parquet-encoding-1.17.0.jar
-parquet-format-structures/1.17.0//parquet-format-structures-1.17.0.jar
-parquet-hadoop/1.17.0//parquet-hadoop-1.17.0.jar
-parquet-jackson/1.17.0//parquet-jackson-1.17.0.jar
+parquet-column/1.17.1//parquet-column-1.17.1.jar
+parquet-common/1.17.1//parquet-common-1.17.1.jar
+parquet-encoding/1.17.1//parquet-encoding-1.17.1.jar
+parquet-format-structures/1.17.1//parquet-format-structures-1.17.1.jar
+parquet-hadoop/1.17.1//parquet-hadoop-1.17.1.jar
+parquet-jackson/1.17.1//parquet-jackson-1.17.1.jar
pickle/1.5//pickle-1.5.jar
py4j/0.10.9.9//py4j-0.10.9.9.jar
reactive-streams/1.0.3//reactive-streams-1.0.3.jar
diff --git a/pom.xml b/pom.xml
index 2c5b60106d11..dc75eb04eac0 100644
--- a/pom.xml
+++ b/pom.xml
@@ -143,7 +143,7 @@
<kafka.version>3.9.2</kafka.version>
<!-- After 10.17.1.0, the minimum required version is JDK19 -->
<derby.version>10.16.1.1</derby.version>
- <parquet.version>1.17.0</parquet.version>
+ <parquet.version>1.17.1</parquet.version>
<orc.version>2.3.0</orc.version>
<orc.classifier>shaded-protobuf</orc.classifier>
<jetty.version>12.1.8</jetty.version>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
