This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 43b81b7afd4 [SPARK-42161][BUILD] Upgrade Apache Arrow to 11.0.0
43b81b7afd4 is described below
commit 43b81b7afd4750bc04299dc14be492700a8157aa
Author: yangjie01 <[email protected]>
AuthorDate: Sat Jan 28 16:48:38 2023 -0800
[SPARK-42161][BUILD] Upgrade Apache Arrow to 11.0.0
### What changes were proposed in this pull request?
This PR aims to upgrade Apache Arrow to 11.0.0.
### Why are the changes needed?
The release note as follows:
- https://arrow.apache.org/release/11.0.0.html
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass GA.
Closes #39707 from LuciferYang/SPARK-42161.
Lead-authored-by: yangjie01 <[email protected]>
Co-authored-by: YangJie <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
dev/deps/spark-deps-hadoop-2-hive-2.3 | 8 ++++----
dev/deps/spark-deps-hadoop-3-hive-2.3 | 8 ++++----
pom.xml | 2 +-
3 files changed, 9 insertions(+), 9 deletions(-)
diff --git a/dev/deps/spark-deps-hadoop-2-hive-2.3
b/dev/deps/spark-deps-hadoop-2-hive-2.3
index 9051387bdf5..a614f07f8f5 100644
--- a/dev/deps/spark-deps-hadoop-2-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-2-hive-2.3
@@ -17,10 +17,10 @@ api-asn1-api/1.0.0-M20//api-asn1-api-1.0.0-M20.jar
api-util/1.0.0-M20//api-util-1.0.0-M20.jar
arpack/3.0.3//arpack-3.0.3.jar
arpack_combined_all/0.1//arpack_combined_all-0.1.jar
-arrow-format/10.0.1//arrow-format-10.0.1.jar
-arrow-memory-core/10.0.1//arrow-memory-core-10.0.1.jar
-arrow-memory-netty/10.0.1//arrow-memory-netty-10.0.1.jar
-arrow-vector/10.0.1//arrow-vector-10.0.1.jar
+arrow-format/11.0.0//arrow-format-11.0.0.jar
+arrow-memory-core/11.0.0//arrow-memory-core-11.0.0.jar
+arrow-memory-netty/11.0.0//arrow-memory-netty-11.0.0.jar
+arrow-vector/11.0.0//arrow-vector-11.0.0.jar
audience-annotations/0.5.0//audience-annotations-0.5.0.jar
avro-ipc/1.11.1//avro-ipc-1.11.1.jar
avro-mapred/1.11.1//avro-mapred-1.11.1.jar
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 70057821bab..e6af508a903 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -16,10 +16,10 @@ antlr4-runtime/4.9.3//antlr4-runtime-4.9.3.jar
aopalliance-repackaged/2.6.1//aopalliance-repackaged-2.6.1.jar
arpack/3.0.3//arpack-3.0.3.jar
arpack_combined_all/0.1//arpack_combined_all-0.1.jar
-arrow-format/10.0.1//arrow-format-10.0.1.jar
-arrow-memory-core/10.0.1//arrow-memory-core-10.0.1.jar
-arrow-memory-netty/10.0.1//arrow-memory-netty-10.0.1.jar
-arrow-vector/10.0.1//arrow-vector-10.0.1.jar
+arrow-format/11.0.0//arrow-format-11.0.0.jar
+arrow-memory-core/11.0.0//arrow-memory-core-11.0.0.jar
+arrow-memory-netty/11.0.0//arrow-memory-netty-11.0.0.jar
+arrow-vector/11.0.0//arrow-vector-11.0.0.jar
audience-annotations/0.5.0//audience-annotations-0.5.0.jar
avro-ipc/1.11.1//avro-ipc-1.11.1.jar
avro-mapred/1.11.1//avro-mapred-1.11.1.jar
diff --git a/pom.xml b/pom.xml
index 5428aed8ad3..1d9eea0e21c 100644
--- a/pom.xml
+++ b/pom.xml
@@ -220,7 +220,7 @@
If you are changing Arrow version specification, please check
./python/pyspark/sql/pandas/utils.py, and ./python/setup.py too.
-->
- <arrow.version>10.0.1</arrow.version>
+ <arrow.version>11.0.0</arrow.version>
<!-- org.fusesource.leveldbjni will be used except on arm64 platform. -->
<leveldbjni.group>org.fusesource.leveldbjni</leveldbjni.group>
<kubernetes-client.version>6.4.0</kubernetes-client.version>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
