This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-4.0 by this push:
new 10f586753d07 [SPARK-51950][BUILD] Upgrade `Parquet` to 1.15.2
10f586753d07 is described below
commit 10f586753d07f4dab77d135c80679859d8db6253
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Fri May 2 18:01:36 2025 -0700
[SPARK-51950][BUILD] Upgrade `Parquet` to 1.15.2
### What changes were proposed in this pull request?
This PR aims to upgrade `Parquet` to 1.15.2.
### Why are the changes needed?
To bring the latest bug fixes.
- https://parquet.apache.org/blog/2025/05/01/1.15.2/
- https://github.com/apache/parquet-java/releases/tag/apache-parquet-1.15.2
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #50755 from dongjoon-hyun/SPARK-51950.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 15732fcffad2f00979ddb82630a18a9bb2e850ef)
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/deps/spark-deps-hadoop-3-hive-2.3 | 12 ++++++------
examples/src/main/python/parquet_inputformat.py | 2 +-
pom.xml | 2 +-
3 files changed, 8 insertions(+), 8 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 9fbc14670438..f15f709ccc0e 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -242,12 +242,12 @@ orc-shims/2.1.1//orc-shims-2.1.1.jar
oro/2.0.8//oro-2.0.8.jar
osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
paranamer/2.8//paranamer-2.8.jar
-parquet-column/1.15.1//parquet-column-1.15.1.jar
-parquet-common/1.15.1//parquet-common-1.15.1.jar
-parquet-encoding/1.15.1//parquet-encoding-1.15.1.jar
-parquet-format-structures/1.15.1//parquet-format-structures-1.15.1.jar
-parquet-hadoop/1.15.1//parquet-hadoop-1.15.1.jar
-parquet-jackson/1.15.1//parquet-jackson-1.15.1.jar
+parquet-column/1.15.2//parquet-column-1.15.2.jar
+parquet-common/1.15.2//parquet-common-1.15.2.jar
+parquet-encoding/1.15.2//parquet-encoding-1.15.2.jar
+parquet-format-structures/1.15.2//parquet-format-structures-1.15.2.jar
+parquet-hadoop/1.15.2//parquet-hadoop-1.15.2.jar
+parquet-jackson/1.15.2//parquet-jackson-1.15.2.jar
pickle/1.5//pickle-1.5.jar
py4j/0.10.9.9//py4j-0.10.9.9.jar
remotetea-oncrpc/1.1.2//remotetea-oncrpc-1.1.2.jar
diff --git a/examples/src/main/python/parquet_inputformat.py
b/examples/src/main/python/parquet_inputformat.py
index d2e22d0d43d9..2b72c7860d48 100644
--- a/examples/src/main/python/parquet_inputformat.py
+++ b/examples/src/main/python/parquet_inputformat.py
@@ -19,7 +19,7 @@
Read data file users.parquet in local Spark distro:
$ cd $SPARK_HOME
-$ export AVRO_PARQUET_JARS=/path/to/parquet-avro-1.15.1.jar
+$ export AVRO_PARQUET_JARS=/path/to/parquet-avro-1.15.2.jar
$ ./bin/spark-submit --driver-class-path /path/to/example/jar \\
--jars $AVRO_PARQUET_JARS \\
./examples/src/main/python/parquet_inputformat.py \\
diff --git a/pom.xml b/pom.xml
index 1875003da965..ec2e1a8a9eb8 100644
--- a/pom.xml
+++ b/pom.xml
@@ -137,7 +137,7 @@
<kafka.version>3.9.0</kafka.version>
<!-- After 10.17.1.0, the minimum required version is JDK19 -->
<derby.version>10.16.1.1</derby.version>
- <parquet.version>1.15.1</parquet.version>
+ <parquet.version>1.15.2</parquet.version>
<orc.version>2.1.1</orc.version>
<orc.classifier>shaded-protobuf</orc.classifier>
<jetty.version>11.0.24</jetty.version>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
