(spark) branch master updated: [SPARK-47803][SQL] Support cast to variant

2024-04-14 Thread wenchen 
This is an automated email from the ASF dual-hosted git repository.

wenchen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
 new dd4c7fc6ae91 [SPARK-47803][SQL] Support cast to variant
dd4c7fc6ae91 is described below

commit dd4c7fc6ae91ec1f2a348cf4633bff10717cde22
Author: Chenhao Li 
AuthorDate: Mon Apr 15 13:16:30 2024 +0800

[SPARK-47803][SQL] Support cast to variant

### What changes were proposed in this pull request?

This PR allows casting another type into the variant type. The changes can 
be divided into two major parts:
- The `VariantBuilder` class is greatly refactored. Many of its APIs are 
exposed so that Spark can use them to build a variant value without JSON 
parsing.
- The actual implementation of the cast.

### Why are the changes needed?

It provides a convenient way to build variant values from other Spark 
values. Before this PR, `parse_json` is the only SQL function that can produce 
variant values. If users want to do so, they may have to use 
`parse_json(to_json(input))`, which is inefficient and disallowed if the input 
has a scalar type.

### Does this PR introduce _any_ user-facing change?

Yes. Casting to variant was previously not allowed but now allowd.

### How was this patch tested?

Unit tests.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #45989 from chenhao-db/cast_to_variant.

Authored-by: Chenhao Li 
Signed-off-by: Wenchen Fan 
---
 .../src/main/resources/error/error-classes.json|   6 +
 .../org/apache/spark/types/variant/Variant.java|   6 +-
 .../apache/spark/types/variant/VariantBuilder.java | 423 ++---
 docs/sql-error-conditions.md   |   6 +
 .../spark/sql/catalyst/expressions/Cast.scala  |   7 +
 .../variant/VariantExpressionEvalUtils.scala   |  71 +++-
 .../variant/VariantExpressionSuite.scala   |  26 ++
 7 files changed, 406 insertions(+), 139 deletions(-)

diff --git a/common/utils/src/main/resources/error/error-classes.json 
b/common/utils/src/main/resources/error/error-classes.json
index 2a00edb9a4df..e1c8c881f98f 100644
--- a/common/utils/src/main/resources/error/error-classes.json
+++ b/common/utils/src/main/resources/error/error-classes.json
@@ -4725,6 +4725,12 @@
 ],
 "sqlState" : "22023"
   },
+  "VARIANT_DUPLICATE_KEY" : {
+"message" : [
+  "Failed to build variant because of a duplicate object key ``."
+],
+"sqlState" : "22023"
+  },
   "VARIANT_SIZE_LIMIT" : {
 "message" : [
   "Cannot build variant bigger than  in .",
diff --git 
a/common/variant/src/main/java/org/apache/spark/types/variant/Variant.java 
b/common/variant/src/main/java/org/apache/spark/types/variant/Variant.java
index 4aeb2c6e1435..a705daaf323b 100644
--- a/common/variant/src/main/java/org/apache/spark/types/variant/Variant.java
+++ b/common/variant/src/main/java/org/apache/spark/types/variant/Variant.java
@@ -41,12 +41,12 @@ import static org.apache.spark.types.variant.VariantUtil.*;
  * define a new class to avoid depending on or modifying Spark.
  */
 public final class Variant {
-  private final byte[] value;
-  private final byte[] metadata;
+  final byte[] value;
+  final byte[] metadata;
   // The variant value doesn't use the whole `value` binary, but starts from 
its `pos` index and
   // spans a size of `valueSize(value, pos)`. This design avoids frequent 
copies of the value binary
   // when reading a sub-variant in the array/object element.
-  private final int pos;
+  final int pos;
 
   public Variant(byte[] value, byte[] metadata) {
 this(value, metadata, 0);
diff --git 
a/common/variant/src/main/java/org/apache/spark/types/variant/VariantBuilder.java
 
b/common/variant/src/main/java/org/apache/spark/types/variant/VariantBuilder.java
index 21a12cbe9d71..ea7a7674baf5 100644
--- 
a/common/variant/src/main/java/org/apache/spark/types/variant/VariantBuilder.java
+++ 
b/common/variant/src/main/java/org/apache/spark/types/variant/VariantBuilder.java
@@ -17,6 +17,11 @@
 
 package org.apache.spark.types.variant;
 
+import org.apache.spark.QueryContext;
+import org.apache.spark.SparkRuntimeException;
+import scala.collection.immutable.Map;
+import scala.collection.immutable.Map$;
+
 import java.io.IOException;
 import java.math.BigDecimal;
 import java.math.BigInteger;
@@ -61,7 +66,7 @@ public class VariantBuilder {
   }
 
   // Build the variant metadata from `dictionaryKeys` and return the variant 
result.
-  private Variant result() {
+  public Variant result() {
 int numKeys = dictionaryKeys.size();
 // Use long to avoid overflow in accumulating lengths.
 long dictionaryStringSize = 0;
@@ -100,6 +105,272 @@ public class VariantBuilder {
 return new Variant(Arrays.copyOfRange(writeBuffer, 0,

(spark) branch master updated (a7cff5c7a383 -> 73aa4059cd5c)

2024-04-14 Thread gurwls223 
This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


from a7cff5c7a383 [SPARK-47757][SPARK-47756][CONNECT][PYTHON][TESTS] Make 
testing Spark Connect server having pyspark.core
 add 73aa4059cd5c [SPARK-47849][PYTHON][CONNECT] Change release script to 
release pyspark-connect

No new revisions were added by this update.

Summary of changes:
 dev/create-release/release-build.sh | 14 ++
 dev/make-distribution.sh|  1 +
 2 files changed, 15 insertions(+)


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch branch-3.4 updated: Fix network-commont module version to 3.4.4-SNAPSHOT

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.4 by this push:
 new 9993c39ef7a1 Fix network-commont module version to 3.4.4-SNAPSHOT
9993c39ef7a1 is described below

commit 9993c39ef7a104056b143f8e12c824d6ca68ab60
Author: Dongjoon Hyun 
AuthorDate: Sun Apr 14 21:44:22 2024 -0700

Fix network-commont module version to 3.4.4-SNAPSHOT
---
 common/network-common/pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index 8a1fe5781ba4..da85893ed3b6 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch master updated (1096801ead29 -> a7cff5c7a383)

2024-04-14 Thread gurwls223 
This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


from 1096801ead29 [SPARK-47828][CONNECT][PYTHON] 
DataFrameWriterV2.overwrite` fails with invalid plan
 add a7cff5c7a383 [SPARK-47757][SPARK-47756][CONNECT][PYTHON][TESTS] Make 
testing Spark Connect server having pyspark.core

No new revisions were added by this update.

Summary of changes:
 .github/workflows/build_python_connect.yml   |  4 +++-
 .../pyspark/sql/tests/connect/test_parity_memory_profiler.py |  3 ---
 python/pyspark/sql/tests/connect/test_parity_udf_profiler.py |  3 ---
 python/pyspark/worker_util.py| 12 
 4 files changed, 7 insertions(+), 15 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch master updated: [SPARK-47828][CONNECT][PYTHON] DataFrameWriterV2.overwrite` fails with invalid plan

2024-04-14 Thread ruifengz 
This is an automated email from the ASF dual-hosted git repository.

ruifengz pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
 new 1096801ead29 [SPARK-47828][CONNECT][PYTHON] 
DataFrameWriterV2.overwrite` fails with invalid plan
1096801ead29 is described below

commit 1096801ead29a8b62e915a0348b8adaad060b215
Author: Ruifeng Zheng 
AuthorDate: Mon Apr 15 12:21:01 2024 +0800

[SPARK-47828][CONNECT][PYTHON] DataFrameWriterV2.overwrite` fails with 
invalid plan

### What changes were proposed in this pull request?
 `DataFrameWriterV2.overwrite` fails with invalid plan

### Why are the changes needed?
bug fix

### Does this PR introduce _any_ user-facing change?
yes

### How was this patch tested?
added test

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #46023 from zhengruifeng/connect_fix_overwrite.

Authored-by: Ruifeng Zheng 
Signed-off-by: Ruifeng Zheng 
---
 python/pyspark/sql/connect/plan.py  | 8 
 python/pyspark/sql/tests/test_readwriter.py | 5 +
 2 files changed, 9 insertions(+), 4 deletions(-)

diff --git a/python/pyspark/sql/connect/plan.py 
b/python/pyspark/sql/connect/plan.py
index 72b8372c8039..239ee23c2061 100644
--- a/python/pyspark/sql/connect/plan.py
+++ b/python/pyspark/sql/connect/plan.py
@@ -1751,16 +1751,16 @@ class WriteOperationV2(LogicalPlan):
 plan.write_operation_v2.mode = 
proto.WriteOperationV2.Mode.MODE_CREATE
 elif wm == "overwrite":
 plan.write_operation_v2.mode = 
proto.WriteOperationV2.Mode.MODE_OVERWRITE
+if self.overwrite_condition is not None:
+plan.write_operation_v2.overwrite_condition.CopyFrom(
+self.overwrite_condition.to_plan(session)
+)
 elif wm == "overwrite_partitions":
 plan.write_operation_v2.mode = 
proto.WriteOperationV2.Mode.MODE_OVERWRITE_PARTITIONS
 elif wm == "append":
 plan.write_operation_v2.mode = 
proto.WriteOperationV2.Mode.MODE_APPEND
 elif wm == "replace":
 plan.write_operation_v2.mode = 
proto.WriteOperationV2.Mode.MODE_REPLACE
-if self.overwrite_condition is not None:
-plan.write_operation_v2.overwrite_condition.CopyFrom(
-self.overwrite_condition.to_plan(session)
-)
 elif wm == "create_or_replace":
 plan.write_operation_v2.mode = 
proto.WriteOperationV2.Mode.MODE_CREATE_OR_REPLACE
 else:
diff --git a/python/pyspark/sql/tests/test_readwriter.py 
b/python/pyspark/sql/tests/test_readwriter.py
index 85057f37a181..5784d2c72973 100644
--- a/python/pyspark/sql/tests/test_readwriter.py
+++ b/python/pyspark/sql/tests/test_readwriter.py
@@ -252,6 +252,11 @@ class ReadwriterV2TestsMixin:
 ):
 df.writeTo("test_table").create()
 
+def test_table_overwrite(self):
+df = self.df
+with self.assertRaisesRegex(AnalysisException, 
"TABLE_OR_VIEW_NOT_FOUND"):
+df.writeTo("test_table").overwrite(lit(True))
+
 
 class ReadwriterTests(ReadwriterTestsMixin, ReusedSQLTestCase):
 pass


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r68519 - in /dev/spark/v3.4.3-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.3.1/ _site/api/R/deps/jquery-3.6.0/ _site/api

2024-04-14 Thread dongjoon 
Author: dongjoon
Date: Mon Apr 15 02:33:02 2024
New Revision: 68519

Log:
Apache Spark v3.4.3-rc2 docs


[This commit notification would consist of 2987 parts, 
which exceeds the limit of 50 ones, so it was shortened to the summary.]

-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch master updated (85c4f053f25a -> e7d0ba783f43)

2024-04-14 Thread gurwls223 
This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


from 85c4f053f25a [SPARK-47841][BUILD] Upgrade `postgresql` to 42.7.3
 add e7d0ba783f43 [SPARK-47826][SQL][PYTHON][FOLLOW-UP] Do not use 
list[...] that is invalid type syntax for Python 3.8

No new revisions were added by this update.

Summary of changes:
 python/pyspark/sql/variant_utils.py | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r68518 - /dev/spark/v3.4.3-rc2-bin/

2024-04-14 Thread dongjoon 
Author: dongjoon
Date: Mon Apr 15 01:30:44 2024
New Revision: 68518

Log:
Apache Spark v3.4.3-rc2

Added:
dev/spark/v3.4.3-rc2-bin/
dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz   (with props)
dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.asc
dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.sha512
dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz   (with props)
dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.asc
dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.sha512
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-hadoop3-scala2.13.tgz   (with 
props)
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-hadoop3-scala2.13.tgz.asc
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-hadoop3-scala2.13.tgz.sha512
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-hadoop3.tgz   (with props)
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-hadoop3.tgz.asc
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-hadoop3.tgz.sha512
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-without-hadoop.tgz   (with props)
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-without-hadoop.tgz.asc
dev/spark/v3.4.3-rc2-bin/spark-3.4.3-bin-without-hadoop.tgz.sha512
dev/spark/v3.4.3-rc2-bin/spark-3.4.3.tgz   (with props)
dev/spark/v3.4.3-rc2-bin/spark-3.4.3.tgz.asc
dev/spark/v3.4.3-rc2-bin/spark-3.4.3.tgz.sha512

Added: dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz
==
Binary file - no diff available.

Propchange: dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.asc
==
--- dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.asc (added)
+++ dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.asc Mon Apr 15 01:30:44 2024
@@ -0,0 +1,17 @@
+-BEGIN PGP SIGNATURE-
+
+iQJIBAABCgAyFiEE8oycklwYjDXjRWFN7aAM6DTw/FwFAmYcgt0UHGRvbmdqb29u
+QGFwYWNoZS5vcmcACgkQ7aAM6DTw/FwVpQ//feuIM/HSzfE31Blc43Zc05sWRwZ2
+FZeiQGQ6dRbJpjKjLtKMsvlORov9Vx6225VX7bpBqyZ9gQDB8Hq1uoFPiQwagbBn
+qFCDh3agkEVxDZHEYjIBNRW5IVR89rFCCLR+YafKnN+alfCaScmGfAhS2JQYvsfM
+733xqFyxduPqPUVC7uJfi7qLEqrn8QV13duGzWmIEhAdl03/14UwWektNfQaSfPB
+cwv26dnQdUBGoqIEW9eJIM47+Plj1WYMNZtjB60bid5cilm9NjLB6GaHpzijSTHX
+Kpssu22OQPzG7d2D2D3EMvpHiAJC1oUIXnzzJiApOFg9dpcDhtH6Jp3J53UuMfBs
+pX/Yt/0n8VlZoF6DwREtLi3L5AeJt+wrlQQUSwAUNU7bQrM5mtQmuzc9u/lUfcPQ
+74860MGPWPx9+N+5NgSPop9UgP6fOSm53jFXIBJzedHLHhakSTu7+2mHEnpABwTE
+02LuAzZVwJ0N/iH0rwIKzNiikydtQyO7nTCUruGuMLcRFM5wnn3DNeSqbw/zRNAl
+Fabwq/x1dnA4ryoCV20s7ug0iVBsXN+eQzEegpshrUHZLFma4z7+iieX+xpuSu22
+ZWbbR0sh433tndVREpPg8K2oSsaASxkE0yUlgrp97uHDx7WAixReZCQ40szXJEC4
+MGp+TprPL1Ib4OI=
+=w+kM
+-END PGP SIGNATURE-

Added: dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.sha512
==
--- dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.sha512 (added)
+++ dev/spark/v3.4.3-rc2-bin/SparkR_3.4.3.tar.gz.sha512 Mon Apr 15 01:30:44 2024
@@ -0,0 +1 @@
+2bf5b5b574c916bc74cad122f22c33afec129e56fe6672bb0eaeff7b0218853e1e426e554119b2b0b94c527f05ae041057efbfba53a8916a1c7cc01964366d7b
  SparkR_3.4.3.tar.gz

Added: dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz
==
Binary file - no diff available.

Propchange: dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.asc
==
--- dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.asc (added)
+++ dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.asc Mon Apr 15 01:30:44 2024
@@ -0,0 +1,17 @@
+-BEGIN PGP SIGNATURE-
+
+iQJIBAABCgAyFiEE8oycklwYjDXjRWFN7aAM6DTw/FwFAmYcgt8UHGRvbmdqb29u
+QGFwYWNoZS5vcmcACgkQ7aAM6DTw/Fynzg//TTKfsQ/w2lI1IqYLCJi8FBQJM3vx
+XfzGDq+gkyBSc1ohbNn/nMi/OryOXui5o74d1xmiyWz36M97DRXBaI+ldTFi9lgy
+DCECCDrNU0RcWkHtXCaP0EahN4pBK+82ftD7KrkZAILdvxZpSU2XIesBjs5lrSpn
+NFvwYvWg4COc+tMxvFOybAzqIDhe1geoLeEgizbJcC7PyACH9cQccazco1xoEi6K
+d+pMrBSGeV3ReiML7X6/fFXOwqe1P95NrdRLDdl0irow/p08Tbf8YW5b+Abo0j/E
+37SEh8veYoX0otOFrc5K/Z4sNh5OlLuzXnhOG03bCXpJ71imZGaJUPW286Tbnl8p
+fecG/aZ8Avb0yCWMIzeoffd00ObpFulU8zNQztdGJzQnJR12K1tefNPLA6Al0KE4
+7NljgNDfJL+WGhoip6rYLol7WK1RgGFHPYqcVINz6ZUNChAqdCgrSefCdb//Kavv
+Qkq08Q3QqlcHTGJb2hRmvwMuVYTqyFsRu83/EDYdVNdEZ0lWR5P79z+N+Is6SdYc
+Z/zcnPD83cNNCahyY97VkcyNBcZvx4maa/4AXCzBlGkebc4Yyymt3sft0/QWIM39
+FQz8mqciCQKfqIU4HI5yogxadmmFd5tELyBhbQz5mbgvFhHHDzzJpuDPIA6jZUQc
+C5OZ9KHhC/pF1dg=
+=xtzn
+-END PGP SIGNATURE-

Added: dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.sha512
==
--- dev/spark/v3.4.3-rc2-bin/pyspark-3.4.3.tar.gz.sha512 (added)
+++

(spark) 01/01: Preparing development version 3.4.4-SNAPSHOT

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git

commit d8c01554e5b88d0739343f13fe1fddd17892b8bc
Author: Dongjoon Hyun 
AuthorDate: Mon Apr 15 00:21:16 2024 +

Preparing development version 3.4.4-SNAPSHOT
---
 R/pkg/DESCRIPTION  | 2 +-
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 6 +++---
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 42 files changed, 44 insertions(+), 44 deletions(-)

diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION
index 8f6d8f1b3b6e..6d2bd4eb9759 100644
--- a/R/pkg/DESCRIPTION
+++ b/R/pkg/DESCRIPTION
@@ -1,6 +1,6 @@
 Package: SparkR
 Type: Package
-Version: 3.4.3
+Version: 3.4.4
 Title: R Front End for 'Apache Spark'
 Description: Provides an R Front end for 'Apache Spark' 
.
 Authors@R:
diff --git a/assembly/pom.xml b/assembly/pom.xml
index 7df44b0eb82c..4f5d6213bca5 100644
--- a/assembly/pom.xml
+++ b/assembly/pom.xml
@@ -21,7 +21,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../pom.xml
   
 
diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 2b6f51089248..161d12d8cd05 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml
index 4ab02df6003c..f772d3d080ed 100644
--- a/common/network-shuffle/pom.xml
+++ b/common/network-shuffle/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml
index 5b256c629847..eda2c13558ae 100644
--- a/common/network-yarn/pom.xml
+++ b/common/network-yarn/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/sketch/pom.xml b/common/sketch/pom.xml
index e74655b629df..4f9d962818d2 100644
--- a/common/sketch/pom.xml
+++ b/common/sketch/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/tags/pom.xml b/common/tags/pom.xml
index d5213c22fd4c..a7a2f2d27adb 100644
--- a/common/tags/pom.xml
+++ b/common/tags/pom.xml
@@ -22,7 +22,7

(spark) branch branch-3.4 updated (df3e8e4d2a3a -> d8c01554e5b8)

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git


from df3e8e4d2a3a Preparing development version 3.4.4-SNAPSHOT
 add 1eb558c3a6fb Preparing Spark release v3.4.3-rc2
 new d8c01554e5b8 Preparing development version 3.4.4-SNAPSHOT

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 common/network-common/pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) 01/01: Preparing Spark release v3.4.3-rc2

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to tag v3.4.3-rc2
in repository https://gitbox.apache.org/repos/asf/spark.git

commit 1eb558c3a6fbdd59e5a305bc3ab12ce748f6511f
Author: Dongjoon Hyun 
AuthorDate: Mon Apr 15 00:21:11 2024 +

Preparing Spark release v3.4.3-rc2
---
 R/pkg/DESCRIPTION  | 2 +-
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 6 +++---
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 43 files changed, 45 insertions(+), 45 deletions(-)

diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION
index 6d2bd4eb9759..8f6d8f1b3b6e 100644
--- a/R/pkg/DESCRIPTION
+++ b/R/pkg/DESCRIPTION
@@ -1,6 +1,6 @@
 Package: SparkR
 Type: Package
-Version: 3.4.4
+Version: 3.4.3
 Title: R Front End for 'Apache Spark'
 Description: Provides an R Front end for 'Apache Spark' 
.
 Authors@R:
diff --git a/assembly/pom.xml b/assembly/pom.xml
index 4f5d6213bca5..7df44b0eb82c 100644
--- a/assembly/pom.xml
+++ b/assembly/pom.xml
@@ -21,7 +21,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.4-SNAPSHOT
+3.4.3
 ../pom.xml
   
 
diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 161d12d8cd05..2b6f51089248 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.4-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index da85893ed3b6..8a1fe5781ba4 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.4-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml
index f772d3d080ed..4ab02df6003c 100644
--- a/common/network-shuffle/pom.xml
+++ b/common/network-shuffle/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.4-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml
index eda2c13558ae..5b256c629847 100644
--- a/common/network-yarn/pom.xml
+++ b/common/network-yarn/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.4-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/sketch/pom.xml b/common/sketch/pom.xml
index

(spark) tag v3.4.3-rc2 created (now 1eb558c3a6fb)

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to tag v3.4.3-rc2
in repository https://gitbox.apache.org/repos/asf/spark.git


  at 1eb558c3a6fb (commit)
This tag includes the following new commits:

 new 1eb558c3a6fb Preparing Spark release v3.4.3-rc2

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.



-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) 01/01: Preparing development version 3.4.4-SNAPSHOT

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git

commit df3e8e4d2a3ae0284a13701625867e0c1fa4dc3b
Author: Dongjoon Hyun 
AuthorDate: Sun Apr 14 23:37:08 2024 +

Preparing development version 3.4.4-SNAPSHOT
---
 R/pkg/DESCRIPTION  | 2 +-
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 6 +++---
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 43 files changed, 45 insertions(+), 45 deletions(-)

diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION
index 8f6d8f1b3b6e..6d2bd4eb9759 100644
--- a/R/pkg/DESCRIPTION
+++ b/R/pkg/DESCRIPTION
@@ -1,6 +1,6 @@
 Package: SparkR
 Type: Package
-Version: 3.4.3
+Version: 3.4.4
 Title: R Front End for 'Apache Spark'
 Description: Provides an R Front end for 'Apache Spark' 
.
 Authors@R:
diff --git a/assembly/pom.xml b/assembly/pom.xml
index 7df44b0eb82c..4f5d6213bca5 100644
--- a/assembly/pom.xml
+++ b/assembly/pom.xml
@@ -21,7 +21,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../pom.xml
   
 
diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 2b6f51089248..161d12d8cd05 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index 8a1fe5781ba4..da85893ed3b6 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml
index 4ab02df6003c..f772d3d080ed 100644
--- a/common/network-shuffle/pom.xml
+++ b/common/network-shuffle/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml
index 5b256c629847..eda2c13558ae 100644
--- a/common/network-yarn/pom.xml
+++ b/common/network-yarn/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3
+3.4.4-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/sketch/pom.xml b/common/sketch/pom.xml
index

(spark) 01/01: Preparing Spark release v3.4.3-rc1

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to tag v3.4.3-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git

commit 025af02862cd045a112feb0da9c7519b846593f6
Author: Dongjoon Hyun 
AuthorDate: Sun Apr 14 23:37:04 2024 +

Preparing Spark release v3.4.3-rc1
---
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 2 +-
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 41 files changed, 41 insertions(+), 41 deletions(-)

diff --git a/assembly/pom.xml b/assembly/pom.xml
index 75035521058f..7df44b0eb82c 100644
--- a/assembly/pom.xml
+++ b/assembly/pom.xml
@@ -21,7 +21,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../pom.xml
   
 
diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index c72e08056937..2b6f51089248 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index e8e6006a1de9..8a1fe5781ba4 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml
index b9973e86c865..4ab02df6003c 100644
--- a/common/network-shuffle/pom.xml
+++ b/common/network-shuffle/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml
index aa8d55dae726..5b256c629847 100644
--- a/common/network-yarn/pom.xml
+++ b/common/network-yarn/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/sketch/pom.xml b/common/sketch/pom.xml
index babb8b1763f5..e74655b629df 100644
--- a/common/sketch/pom.xml
+++ b/common/sketch/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git a/common/tags/pom.xml b/common/tags/pom.xml
index 3e4a313c183f..d5213c22fd4c 100644
--- a/common/tags/pom.xml
+++ b/common/tags/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.4.3-SNAPSHOT
+3.4.3
 ../../pom.xml
   
 
diff --git

(spark) tag v3.4.3-rc1 created (now 025af02862cd)

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to tag v3.4.3-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git


  at 025af02862cd (commit)
This tag includes the following new commits:

 new 025af02862cd Preparing Spark release v3.4.3-rc1

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.



-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch branch-3.4 updated (572e97a1def3 -> df3e8e4d2a3a)

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a change to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git


from 572e97a1def3 [SPARK-47844][BUILD][3.4] Upgrade ORC to 1.8.7
 add 025af02862cd Preparing Spark release v3.4.3-rc1
 new df3e8e4d2a3a Preparing development version 3.4.4-SNAPSHOT

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 R/pkg/DESCRIPTION  | 2 +-
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 6 +++---
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 43 files changed, 45 insertions(+), 45 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch branch-3.4 updated: [SPARK-47844][BUILD][3.4] Upgrade ORC to 1.8.7

2024-04-14 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.4 by this push:
 new 572e97a1def3 [SPARK-47844][BUILD][3.4] Upgrade ORC to 1.8.7
572e97a1def3 is described below

commit 572e97a1def3f9834a1dd5d7bd4f5b858aa0ac0d
Author: Dongjoon Hyun 
AuthorDate: Sun Apr 14 13:48:23 2024 -0700

[SPARK-47844][BUILD][3.4] Upgrade ORC to 1.8.7

### What changes were proposed in this pull request?

This PR aims to upgrade ORC to 1.8.7.

### Why are the changes needed?

To bring the latest bug fixes.
- https://orc.apache.org/news/2024/04/14/ORC-1.8.7/
- https://github.com/apache/orc/releases/tag/v1.8.7

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #46042 from dongjoon-hyun/orc187.

Authored-by: Dongjoon Hyun 
Signed-off-by: Dongjoon Hyun 
---
 dev/deps/spark-deps-hadoop-2-hive-2.3 | 6 +++---
 dev/deps/spark-deps-hadoop-3-hive-2.3 | 6 +++---
 pom.xml   | 2 +-
 3 files changed, 7 insertions(+), 7 deletions(-)

diff --git a/dev/deps/spark-deps-hadoop-2-hive-2.3 
b/dev/deps/spark-deps-hadoop-2-hive-2.3
index 1db890613dc4..2875ee9d1191 100644
--- a/dev/deps/spark-deps-hadoop-2-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-2-hive-2.3
@@ -222,9 +222,9 @@ objenesis/3.2//objenesis-3.2.jar
 okhttp/3.12.12//okhttp-3.12.12.jar
 okio/1.15.0//okio-1.15.0.jar
 opencsv/2.3//opencsv-2.3.jar
-orc-core/1.8.6/shaded-protobuf/orc-core-1.8.6-shaded-protobuf.jar
-orc-mapreduce/1.8.6/shaded-protobuf/orc-mapreduce-1.8.6-shaded-protobuf.jar
-orc-shims/1.8.6//orc-shims-1.8.6.jar
+orc-core/1.8.7/shaded-protobuf/orc-core-1.8.7-shaded-protobuf.jar
+orc-mapreduce/1.8.7/shaded-protobuf/orc-mapreduce-1.8.7-shaded-protobuf.jar
+orc-shims/1.8.7//orc-shims-1.8.7.jar
 oro/2.0.8//oro-2.0.8.jar
 osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
 paranamer/2.8//paranamer-2.8.jar
diff --git a/dev/deps/spark-deps-hadoop-3-hive-2.3 
b/dev/deps/spark-deps-hadoop-3-hive-2.3
index 1dd10ccfc218..ddabb0720c37 100644
--- a/dev/deps/spark-deps-hadoop-3-hive-2.3
+++ b/dev/deps/spark-deps-hadoop-3-hive-2.3
@@ -209,9 +209,9 @@ opencsv/2.3//opencsv-2.3.jar
 opentracing-api/0.33.0//opentracing-api-0.33.0.jar
 opentracing-noop/0.33.0//opentracing-noop-0.33.0.jar
 opentracing-util/0.33.0//opentracing-util-0.33.0.jar
-orc-core/1.8.6/shaded-protobuf/orc-core-1.8.6-shaded-protobuf.jar
-orc-mapreduce/1.8.6/shaded-protobuf/orc-mapreduce-1.8.6-shaded-protobuf.jar
-orc-shims/1.8.6//orc-shims-1.8.6.jar
+orc-core/1.8.7/shaded-protobuf/orc-core-1.8.7-shaded-protobuf.jar
+orc-mapreduce/1.8.7/shaded-protobuf/orc-mapreduce-1.8.7-shaded-protobuf.jar
+orc-shims/1.8.7//orc-shims-1.8.7.jar
 oro/2.0.8//oro-2.0.8.jar
 osgi-resource-locator/1.0.3//osgi-resource-locator-1.0.3.jar
 paranamer/2.8//paranamer-2.8.jar
diff --git a/pom.xml b/pom.xml
index 2f080dbc24b6..6a21980c016f 100644
--- a/pom.xml
+++ b/pom.xml
@@ -141,7 +141,7 @@
 
 10.14.2.0
 1.12.3
-1.8.6
+1.8.7
 shaded-protobuf
 9.4.54.v20240208
 4.0.3


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org