svn commit: r67285 - /dev/spark/v3.5.1-rc1-bin/

2024-02-11 Thread kabhwan 
Author: kabhwan
Date: Mon Feb 12 04:25:21 2024
New Revision: 67285

Log:
Apache Spark v3.5.1-rc1

Added:
dev/spark/v3.5.1-rc1-bin/
dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz   (with props)
dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.asc
dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.sha512
dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz   (with props)
dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.asc
dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.sha512
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-hadoop3-scala2.13.tgz   (with 
props)
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-hadoop3-scala2.13.tgz.asc
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-hadoop3-scala2.13.tgz.sha512
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-hadoop3.tgz   (with props)
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-hadoop3.tgz.asc
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-hadoop3.tgz.sha512
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-without-hadoop.tgz   (with props)
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-without-hadoop.tgz.asc
dev/spark/v3.5.1-rc1-bin/spark-3.5.1-bin-without-hadoop.tgz.sha512
dev/spark/v3.5.1-rc1-bin/spark-3.5.1.tgz   (with props)
dev/spark/v3.5.1-rc1-bin/spark-3.5.1.tgz.asc
dev/spark/v3.5.1-rc1-bin/spark-3.5.1.tgz.sha512

Added: dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz
==
Binary file - no diff available.

Propchange: dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.asc
==
--- dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.asc (added)
+++ dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.asc Mon Feb 12 04:25:21 2024
@@ -0,0 +1,17 @@
+-BEGIN PGP SIGNATURE-
+
+iQJHBAABCgAxFiEE/T6ElC5eYQYjWh0lvTVqn4dA5P8FAmXJnQQTHGthYmh3YW5A
+YXBhY2hlLm9yZwAKCRC9NWqfh0Dk/7+kD/9Unoqxcj5xez1j68n4tsYohuqNCGmy
+q9rs3yJB5fRPHu0Ky7A7GYpp95Zxl14ZiT7aKfWY3DMalldIXH6webUjAyiCUtRt
+8EnJDUNA82D6FOeGU7xv4cWebnk0byeQFwHSWABy8sZNSOmgr5PSxqSf3bo9YL/S
+mVIN2iNN7vHQ9Glv9HH/nPw5e6K+B9zbgtbazPRfGS+ft4y82xTu3SLVzF6OZIHU
+SzBzUgN1DJ9djHzP2v+1eQIqGPkJHC7q2HN1rTSFziQJSgqdd8s7f4sdBvKYacnb
+d+yV+S8yM/ZBPfKrCiKNJVgULMB761tsgsDjLoNag3TKz4Z3y9LRJ95TGoLoPtYg
+in0rIgJUjxlTcQhB9M8LXfA+6CxNv1sYi6sO1RORPeoRd9JYmrjPk7Aju6434/oM
+dvcPHHU3j/zuWPJ37F4X9WrXzf3Zhh++sQJRUvTSp/0YV9VRWTb0vkTiSRV66pqt
+nNqrTIeA0waGw5u8Bgb7oDvWx9A5oSSg2nA3DCURokraw8UbHeY5P9b9kSWyeFHr
+9Qfz9wBREKXKJKd8TQqEm+ORSsoqIfifyJ+hZztMJWRFOE7zjJrO6yHJTUOsHe8v
+rArnbAeOIS++R+ZKVlHwBmIABbn1zVxg9lRTrcVXPAIwOYHH+1KwXgxneN6ITLFA
+giyeBFaMKkLA8A==
+=3BBV
+-END PGP SIGNATURE-

Added: dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.sha512
==
--- dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.sha512 (added)
+++ dev/spark/v3.5.1-rc1-bin/SparkR_3.5.1.tar.gz.sha512 Mon Feb 12 04:25:21 2024
@@ -0,0 +1 @@
+c67ac72c59ae7e66ad05f324f5bedcac6e93851106890a9afc88b7f8b418ae9b1569c4a7e509ab7e1893e36fb947aa4b63a0c8dd8203a705a7a0970cfc6857b2
  SparkR_3.5.1.tar.gz

Added: dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz
==
Binary file - no diff available.

Propchange: dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.asc
==
--- dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.asc (added)
+++ dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.asc Mon Feb 12 04:25:21 2024
@@ -0,0 +1,17 @@
+-BEGIN PGP SIGNATURE-
+
+iQJHBAABCgAxFiEE/T6ElC5eYQYjWh0lvTVqn4dA5P8FAmXJnQYTHGthYmh3YW5A
+YXBhY2hlLm9yZwAKCRC9NWqfh0Dk/8nMD/9w3YRs5ZAREOjaOAisAdfqC4U2wBDl
+fZexBdMTvmRQcGjVAjQBOCKpRaU+WXVdsBrJO3Nif4S/nbjYFsZupWUVFarPSjTK
+6Y12sZ/BP5e5ivZDwKhAxtOFVjygj9snlmrg5qKMs1Q8/9bxErE24U1S/G2T62WQ
+6D3gplvSl7+dk4z/WbkHuitwew5NlZnx14/xSNYkTFxamsbFqUss6z/gd/OwQ7P3
+CLmHd9kMkGv7oZb+5muWJvmyxzwEpu29fiY3bLVOK2OFuNCigAxL9bs7FADjvCed
+cqG88k+X3rDonxA25T50h8xIyTwtqFd0gH5y741mCwD5pMD0Mq51Hr6NsTcfssWY
+SL9iGzu80rOkzJuQwsx6j2O/bzzwsCITiIFoi5ykaAgXiIyeOSUHHIQ5RnLmEag5
+f4KNPOasmc6jUwtFbSGYRvBLLWjmGwpELSh/6ALjVaAGVpH74C54f5RRpAoHsEGN
+ybVL4VSU7Car+tw32rvDLut6BjjMxWJJ8Q/HqzOIzSm+TOFtb5OqjWAvOuKXaDN+
+QYfHdWHIRZKDWZOF3eQXYmkqVCLvgvVVzy01Im9eRJm+8HmpFF/tXKlHo93pVqPB
+bQpIN89y9BmGKqi6JAE9ygxwKLVpiZjGhcye2YK8IdJtsatDjUVhnt7ktsZiswXp
+af0JeyGo0aL1xA==
+=NfQZ
+-END PGP SIGNATURE-

Added: dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.sha512
==
--- dev/spark/v3.5.1-rc1-bin/pyspark-3.5.1.tar.gz.sha512 (added)
+++

(spark) 01/01: Preparing Spark release v3.5.1-rc1

2024-02-11 Thread kabhwan 
This is an automated email from the ASF dual-hosted git repository.

kabhwan pushed a commit to tag v3.5.1-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git

commit 08fe67b9ebf656b6ae7c44163bffba247061aa42
Author: Jungtaek Lim 
AuthorDate: Mon Feb 12 03:39:11 2024 +

Preparing Spark release v3.5.1-rc1
---
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 common/utils/pom.xml   | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 2 +-
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/api/pom.xml| 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 44 files changed, 44 insertions(+), 44 deletions(-)

diff --git a/assembly/pom.xml b/assembly/pom.xml
index 45b68dd81cb9..47b54729bbd2 100644
--- a/assembly/pom.xml
+++ b/assembly/pom.xml
@@ -21,7 +21,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1-SNAPSHOT
+3.5.1
 ../pom.xml
   
 
diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 7dece9de699c..66e6bb473bf2 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1-SNAPSHOT
+3.5.1
 ../../pom.xml
   
 
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index 54c10a05eed2..98897b4424ae 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1-SNAPSHOT
+3.5.1
 ../../pom.xml
   
 
diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml
index 92bf5bc07854..44531ea54cd5 100644
--- a/common/network-shuffle/pom.xml
+++ b/common/network-shuffle/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1-SNAPSHOT
+3.5.1
 ../../pom.xml
   
 
diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml
index 3003927e713c..8fcf20328e8e 100644
--- a/common/network-yarn/pom.xml
+++ b/common/network-yarn/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1-SNAPSHOT
+3.5.1
 ../../pom.xml
   
 
diff --git a/common/sketch/pom.xml b/common/sketch/pom.xml
index 43982032a621..901214de77c9 100644
--- a/common/sketch/pom.xml
+++ b/common/sketch/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1-SNAPSHOT
+3.5.1
 ../../pom.xml
   
 
diff --git a/common/tags/pom.xml b/common/tags/pom.xml
index a54382c0f4d0..6395454245ef 100644
---

(spark) 01/01: Preparing development version 3.5.2-SNAPSHOT

2024-02-11 Thread kabhwan 
This is an automated email from the ASF dual-hosted git repository.

kabhwan pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git

commit d27bdbeae9c5b634702ad20a58b9d3c68ac9d39d
Author: Jungtaek Lim 
AuthorDate: Mon Feb 12 03:39:15 2024 +

Preparing development version 3.5.2-SNAPSHOT
---
 R/pkg/DESCRIPTION  | 2 +-
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 common/utils/pom.xml   | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 6 +++---
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/api/pom.xml| 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 45 files changed, 47 insertions(+), 47 deletions(-)

diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION
index 66faa8031c45..89bee06852be 100644
--- a/R/pkg/DESCRIPTION
+++ b/R/pkg/DESCRIPTION
@@ -1,6 +1,6 @@
 Package: SparkR
 Type: Package
-Version: 3.5.1
+Version: 3.5.2
 Title: R Front End for 'Apache Spark'
 Description: Provides an R Front end for 'Apache Spark' 
.
 Authors@R:
diff --git a/assembly/pom.xml b/assembly/pom.xml
index 47b54729bbd2..d1ef9b24afda 100644
--- a/assembly/pom.xml
+++ b/assembly/pom.xml
@@ -21,7 +21,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1
+3.5.2-SNAPSHOT
 ../pom.xml
   
 
diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 66e6bb473bf2..9df20f8facf5 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1
+3.5.2-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index 98897b4424ae..27a53b0f9f3b 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1
+3.5.2-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml
index 44531ea54cd5..93410815e6c0 100644
--- a/common/network-shuffle/pom.xml
+++ b/common/network-shuffle/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12
-3.5.1
+3.5.2-SNAPSHOT
 ../../pom.xml
   
 
diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml
index 8fcf20328e8e..a99b8b96402a 100644
--- a/common/network-yarn/pom.xml
+++ b/common/network-yarn/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.spark
 spark-parent_2.12

(spark) branch branch-3.5 updated (4e4d9f07d095 -> d27bdbeae9c5)

2024-02-11 Thread kabhwan 
This is an automated email from the ASF dual-hosted git repository.

kabhwan pushed a change to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git


from 4e4d9f07d095 [SPARK-47022][CONNECT][TESTS][3.5] Fix 
`connect/client/jvm` to have explicit `commons-(io|lang3)` test dependency
 add 08fe67b9ebf6 Preparing Spark release v3.5.1-rc1
 new d27bdbeae9c5 Preparing development version 3.5.2-SNAPSHOT

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 R/pkg/DESCRIPTION  | 2 +-
 assembly/pom.xml   | 2 +-
 common/kvstore/pom.xml | 2 +-
 common/network-common/pom.xml  | 2 +-
 common/network-shuffle/pom.xml | 2 +-
 common/network-yarn/pom.xml| 2 +-
 common/sketch/pom.xml  | 2 +-
 common/tags/pom.xml| 2 +-
 common/unsafe/pom.xml  | 2 +-
 common/utils/pom.xml   | 2 +-
 connector/avro/pom.xml | 2 +-
 connector/connect/client/jvm/pom.xml   | 2 +-
 connector/connect/common/pom.xml   | 2 +-
 connector/connect/server/pom.xml   | 2 +-
 connector/docker-integration-tests/pom.xml | 2 +-
 connector/kafka-0-10-assembly/pom.xml  | 2 +-
 connector/kafka-0-10-sql/pom.xml   | 2 +-
 connector/kafka-0-10-token-provider/pom.xml| 2 +-
 connector/kafka-0-10/pom.xml   | 2 +-
 connector/kinesis-asl-assembly/pom.xml | 2 +-
 connector/kinesis-asl/pom.xml  | 2 +-
 connector/protobuf/pom.xml | 2 +-
 connector/spark-ganglia-lgpl/pom.xml   | 2 +-
 core/pom.xml   | 2 +-
 docs/_config.yml   | 6 +++---
 examples/pom.xml   | 2 +-
 graphx/pom.xml | 2 +-
 hadoop-cloud/pom.xml   | 2 +-
 launcher/pom.xml   | 2 +-
 mllib-local/pom.xml| 2 +-
 mllib/pom.xml  | 2 +-
 pom.xml| 2 +-
 python/pyspark/version.py  | 2 +-
 repl/pom.xml   | 2 +-
 resource-managers/kubernetes/core/pom.xml  | 2 +-
 resource-managers/kubernetes/integration-tests/pom.xml | 2 +-
 resource-managers/mesos/pom.xml| 2 +-
 resource-managers/yarn/pom.xml | 2 +-
 sql/api/pom.xml| 2 +-
 sql/catalyst/pom.xml   | 2 +-
 sql/core/pom.xml   | 2 +-
 sql/hive-thriftserver/pom.xml  | 2 +-
 sql/hive/pom.xml   | 2 +-
 streaming/pom.xml  | 2 +-
 tools/pom.xml  | 2 +-
 45 files changed, 47 insertions(+), 47 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) tag v3.5.1-rc1 created (now 08fe67b9ebf6)

2024-02-11 Thread kabhwan 
This is an automated email from the ASF dual-hosted git repository.

kabhwan pushed a change to tag v3.5.1-rc1
in repository https://gitbox.apache.org/repos/asf/spark.git


  at 08fe67b9ebf6 (commit)
This tag includes the following new commits:

 new 08fe67b9ebf6 Preparing Spark release v3.5.1-rc1

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.



-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch master updated: [SPARK-46991][SQL] Replace `IllegalArgumentException` by `SparkIllegalArgumentException` in `catalyst`

2024-02-11 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
 new f5b0de07eff4 [SPARK-46991][SQL] Replace `IllegalArgumentException` by 
`SparkIllegalArgumentException` in `catalyst`
f5b0de07eff4 is described below

commit f5b0de07eff49bc1d076c4a1dc59c8672beff99e
Author: Max Gekk 
AuthorDate: Sun Feb 11 15:25:28 2024 -0800

[SPARK-46991][SQL] Replace `IllegalArgumentException` by 
`SparkIllegalArgumentException` in `catalyst`

### What changes were proposed in this pull request?
In the PR, I propose to replace all `IllegalArgumentException` by 
`SparkIllegalArgumentException` in `Catalyst` code base, and introduce new 
legacy error classes with the `_LEGACY_ERROR_TEMP_` prefix.

### Why are the changes needed?
To unify Spark SQL exception, and port Java exceptions on Spark exceptions 
with error classes.

### Does this PR introduce _any_ user-facing change?
Yes, it can if user's code assumes some particular format of 
`IllegalArgumentException` messages.

### How was this patch tested?
By running existing test suites like:
```
$ build/sbt "core/testOnly *SparkThrowableSuite"
$ build/sbt "test:testOnly *BufferHolderSparkSubmitSuite"
```

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes #45033 from MaxGekk/migrate-IllegalArgumentException-catalyst.

Authored-by: Max Gekk 
Signed-off-by: Dongjoon Hyun 
---
 .../src/main/resources/error/error-classes.json| 255 +
 .../scala/org/apache/spark/SparkException.scala|  25 +-
 .../connect/client/GrpcExceptionConverter.scala|   1 +
 .../sql/catalyst/expressions/ExpressionInfo.java   |  38 +--
 .../catalyst/expressions/codegen/BufferHolder.java |  12 +-
 .../sql/catalyst/expressions/xml/UDFXPathUtil.java |   4 +-
 .../catalog/SupportsPartitionManagement.java   |   5 +-
 .../sql/connector/util/V2ExpressionSQLBuilder.java |   4 +-
 .../spark/sql/util/CaseInsensitiveStringMap.java   |   3 +-
 .../sql/catalyst/CatalystTypeConverters.scala  |  75 --
 .../spark/sql/catalyst/csv/CSVExprUtils.scala  |  18 +-
 .../spark/sql/catalyst/csv/CSVHeaderChecker.scala  |   5 +-
 .../spark/sql/catalyst/expressions/Cast.scala  |   6 +-
 .../sql/catalyst/expressions/TimeWindow.scala  |   6 +-
 .../expressions/codegen/CodeGenerator.scala|   6 +-
 .../expressions/collectionOperations.scala |  25 +-
 .../sql/catalyst/expressions/csvExpressions.scala  |   7 +-
 .../catalyst/expressions/datetimeExpressions.scala |  14 +-
 .../sql/catalyst/expressions/xmlExpressions.scala  |   7 +-
 .../ReplaceNullWithFalseInPredicate.scala  |  11 +-
 .../spark/sql/catalyst/parser/AstBuilder.scala |   8 +-
 .../spark/sql/catalyst/plans/joinTypes.scala   |  16 +-
 .../sql/catalyst/plans/logical/v2Commands.scala|   6 +-
 .../spark/sql/catalyst/util/DateTimeUtils.scala|   8 +-
 .../spark/sql/catalyst/util/IntervalUtils.scala|  39 ++--
 .../spark/sql/catalyst/xml/StaxXmlGenerator.scala  |   9 +-
 .../spark/sql/catalyst/xml/StaxXmlParser.scala |  22 +-
 .../spark/sql/catalyst/xml/XmlInferSchema.scala|   5 +-
 .../sql/connector/catalog/CatalogV2Util.scala  |  32 ++-
 .../spark/sql/errors/QueryExecutionErrors.scala|  28 +--
 .../sql/catalyst/CatalystTypeConvertersSuite.scala |  74 +++---
 .../spark/sql/catalyst/csv/CSVExprUtilsSuite.scala |  42 ++--
 .../sql/catalyst/expressions/TimeWindowSuite.scala |  18 +-
 .../codegen/BufferHolderSparkSubmitSuite.scala |  12 +-
 .../expressions/codegen/BufferHolderSuite.scala|  22 +-
 .../sql/catalyst/util/DateTimeUtilsSuite.scala |  24 +-
 .../sql/util/CaseInsensitiveStringMapSuite.scala   |  11 +-
 .../execution/datasources/v2/AlterTableExec.scala  |   3 +-
 .../resources/sql-tests/results/ansi/date.sql.out  |   5 +-
 .../sql/expressions/ExpressionInfoSuite.scala  |  84 ---
 40 files changed, 729 insertions(+), 266 deletions(-)

diff --git a/common/utils/src/main/resources/error/error-classes.json 
b/common/utils/src/main/resources/error/error-classes.json
index 4fcf9248d3e2..5884c9267119 100644
--- a/common/utils/src/main/resources/error/error-classes.json
+++ b/common/utils/src/main/resources/error/error-classes.json
@@ -7512,6 +7512,261 @@
   "Failed to create column family with reserved name="
 ]
   },
+  "_LEGACY_ERROR_TEMP_3198" : {
+"message" : [
+  "Cannot grow BufferHolder by size  because the size is 
negative"
+]
+  },
+  "_LEGACY_ERROR_TEMP_3199" : {
+"message" : [
+  "Cannot grow BufferHolder by size  because the size after 
growing exceeds size limitation "
+]
+  },
+  "_LEGACY_ERROR_TEMP_3200" : {
+"message" : [
+  "Read-ahead limit < 0"
+]
+  },
+

(spark) branch branch-3.5 updated: [SPARK-47022][CONNECT][TESTS][3.5] Fix `connect/client/jvm` to have explicit `commons-(io|lang3)` test dependency

2024-02-11 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.5 by this push:
 new 4e4d9f07d095 [SPARK-47022][CONNECT][TESTS][3.5] Fix 
`connect/client/jvm` to have explicit `commons-(io|lang3)` test dependency
4e4d9f07d095 is described below

commit 4e4d9f07d0954357e85a6e2b0da47746a4b08501
Author: Dongjoon Hyun 
AuthorDate: Sun Feb 11 14:38:48 2024 -0800

[SPARK-47022][CONNECT][TESTS][3.5] Fix `connect/client/jvm` to have 
explicit `commons-(io|lang3)` test dependency

### What changes were proposed in this pull request?

This PR aims to add `commons-io` and `commons-lang3` test dependency to 
`connector/client/jvm` module.

### Why are the changes needed?

`connector/client/jvm` module uses `commons-io` and `commons-lang3` during 
testing like the following.


https://github.com/apache/spark/blob/9700da7bfc1abb607f3cb916b96724d0fb8f2eba/connector/connect/client/jvm/src/test/scala/org/apache/spark/sql/ClientE2ETestSuite.scala#L26-L28

Currently, it's broken due to that.

- https://github.com/apache/spark/actions?query=branch%3Abranch-3.5

### Does this PR introduce _any_ user-facing change?

No, this is a test-dependency only change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #45081 from dongjoon-hyun/SPARK-47022.

Authored-by: Dongjoon Hyun 
Signed-off-by: Dongjoon Hyun 
---
 connector/connect/client/jvm/pom.xml | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/connector/connect/client/jvm/pom.xml 
b/connector/connect/client/jvm/pom.xml
index 236e5850b762..0c0d4cdad3a9 100644
--- a/connector/connect/client/jvm/pom.xml
+++ b/connector/connect/client/jvm/pom.xml
@@ -71,6 +71,16 @@
   ${ammonite.version}
   provided
 
+
+  commons-io
+  commons-io
+  test
+
+
+  org.apache.commons
+  commons-lang3
+  test
+
 
   org.scalacheck
   scalacheck_${scala.binary.version}


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch branch-3.4 updated: [SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have explicit `commons-lang3` test dependency

2024-02-11 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.4 by this push:
 new 29adf32acdac [SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have 
explicit `commons-lang3` test dependency
29adf32acdac is described below

commit 29adf32acdacb56fd399b8945d7e049db5810ca1
Author: Dongjoon Hyun 
AuthorDate: Sun Feb 11 10:38:00 2024 -0800

[SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have explicit 
`commons-lang3` test dependency

### What changes were proposed in this pull request?

This PR aims to fix `kvstore` module by adding explicit `commons-lang3` 
test dependency and excluding `htmlunit-driver` from `org.scalatestplus` to use 
Apache Spark's explicit declaration.

https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/pom.xml#L711-L716

### Why are the changes needed?

Since Spark 3.3.0 (SPARK-37282), `kvstore` uses `commons-lang3` test 
dependency like the following, but we didn't declare it explicitly so far.


https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBSuite.java#L33


https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBIteratorSuite.java#L23

Previously, it was provided by some unused `htmlunit-driver`'s transitive 
dependency accidentally. This causes a weird situation which `kvstore` module 
starts to fail to compile when we upgrade `htmlunit-driver`. We need to fix 
this first.

```
$ mvn dependency:tree -pl common/kvstore
...
[INFO] |  \- org.seleniumhq.selenium:htmlunit-driver:jar:4.12.0:test
...
[INFO] |+- org.apache.commons:commons-lang3:jar:3.14.0:test
```

### Does this PR introduce _any_ user-facing change?

No. This is only a test dependency fix.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #45080 from dongjoon-hyun/SPARK-47021.

Authored-by: Dongjoon Hyun 
Signed-off-by: Dongjoon Hyun 
(cherry picked from commit a926c7912a78f1a2fb71c5ffd21b5c2f723a0128)
Signed-off-by: Dongjoon Hyun 
---
 common/kvstore/pom.xml | 5 +
 pom.xml| 6 ++
 2 files changed, 11 insertions(+)

diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 4184e499221a..c72e08056937 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -66,6 +66,11 @@
   commons-io
   test
 
+
+  org.apache.commons
+  commons-lang3
+  test
+
 
 
   org.apache.logging.log4j
diff --git a/pom.xml b/pom.xml
index acc23ab2d8ed..26f0b71a5114 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1152,6 +1152,12 @@
 selenium-4-7_${scala.binary.version}
 3.2.15.0
 test
+
+  
+org.seleniumhq.selenium
+htmlunit-driver
+  
+
   
   
 org.mockito


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch branch-3.5 updated: [SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have explicit `commons-lang3` test dependency

2024-02-11 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.5 by this push:
 new 9700da7bfc1a [SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have 
explicit `commons-lang3` test dependency
9700da7bfc1a is described below

commit 9700da7bfc1abb607f3cb916b96724d0fb8f2eba
Author: Dongjoon Hyun 
AuthorDate: Sun Feb 11 10:38:00 2024 -0800

[SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have explicit 
`commons-lang3` test dependency

### What changes were proposed in this pull request?

This PR aims to fix `kvstore` module by adding explicit `commons-lang3` 
test dependency and excluding `htmlunit-driver` from `org.scalatestplus` to use 
Apache Spark's explicit declaration.

https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/pom.xml#L711-L716

### Why are the changes needed?

Since Spark 3.3.0 (SPARK-37282), `kvstore` uses `commons-lang3` test 
dependency like the following, but we didn't declare it explicitly so far.


https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBSuite.java#L33


https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBIteratorSuite.java#L23

Previously, it was provided by some unused `htmlunit-driver`'s transitive 
dependency accidentally. This causes a weird situation which `kvstore` module 
starts to fail to compile when we upgrade `htmlunit-driver`. We need to fix 
this first.

```
$ mvn dependency:tree -pl common/kvstore
...
[INFO] |  \- org.seleniumhq.selenium:htmlunit-driver:jar:4.12.0:test
...
[INFO] |+- org.apache.commons:commons-lang3:jar:3.14.0:test
```

### Does this PR introduce _any_ user-facing change?

No. This is only a test dependency fix.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #45080 from dongjoon-hyun/SPARK-47021.

Authored-by: Dongjoon Hyun 
Signed-off-by: Dongjoon Hyun 
(cherry picked from commit a926c7912a78f1a2fb71c5ffd21b5c2f723a0128)
Signed-off-by: Dongjoon Hyun 
---
 common/kvstore/pom.xml | 5 +
 pom.xml| 6 ++
 2 files changed, 11 insertions(+)

diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index 1b1a8d0066f8..7dece9de699c 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -66,6 +66,11 @@
   commons-io
   test
 
+
+  org.apache.commons
+  commons-lang3
+  test
+
 
 
   org.apache.logging.log4j
diff --git a/pom.xml b/pom.xml
index 9e945f8d959a..d0cfdaa1496b 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1146,6 +1146,12 @@
 selenium-4-9_${scala.binary.version}
 3.2.16.0
 test
+
+  
+org.seleniumhq.selenium
+htmlunit-driver
+  
+
   
   
 org.mockito


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org

(spark) branch master updated: [SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have explicit `commons-lang3` test dependency

2024-02-11 Thread dongjoon 
This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
 new a926c7912a78 [SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have 
explicit `commons-lang3` test dependency
a926c7912a78 is described below

commit a926c7912a78f1a2fb71c5ffd21b5c2f723a0128
Author: Dongjoon Hyun 
AuthorDate: Sun Feb 11 10:38:00 2024 -0800

[SPARK-47021][BUILD][TESTS] Fix `kvstore` module to have explicit 
`commons-lang3` test dependency

### What changes were proposed in this pull request?

This PR aims to fix `kvstore` module by adding explicit `commons-lang3` 
test dependency and excluding `htmlunit-driver` from `org.scalatestplus` to use 
Apache Spark's explicit declaration.

https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/pom.xml#L711-L716

### Why are the changes needed?

Since Spark 3.3.0 (SPARK-37282), `kvstore` uses `commons-lang3` test 
dependency like the following, but we didn't declare it explicitly so far.


https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBSuite.java#L33


https://github.com/apache/spark/blob/fa23d276e7e4ed94bf11d71f2e1daa22fe2238e5/common/kvstore/src/test/java/org/apache/spark/util/kvstore/LevelDBIteratorSuite.java#L23

Previously, it was provided by some unused `htmlunit-driver`'s transitive 
dependency accidentally. This causes a weird situation which `kvstore` module 
starts to fail to compile when we upgrade `htmlunit-driver`. We need to fix 
this first.

```
$ mvn dependency:tree -pl common/kvstore
...
[INFO] |  \- org.seleniumhq.selenium:htmlunit-driver:jar:4.12.0:test
...
[INFO] |+- org.apache.commons:commons-lang3:jar:3.14.0:test
```

### Does this PR introduce _any_ user-facing change?

No. This is only a test dependency fix.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #45080 from dongjoon-hyun/SPARK-47021.

Authored-by: Dongjoon Hyun 
Signed-off-by: Dongjoon Hyun 
---
 common/kvstore/pom.xml | 5 +
 pom.xml| 6 ++
 2 files changed, 11 insertions(+)

diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml
index a9b5a4634717..3820d1b8e395 100644
--- a/common/kvstore/pom.xml
+++ b/common/kvstore/pom.xml
@@ -70,6 +70,11 @@
   commons-io
   test
 
+
+  org.apache.commons
+  commons-lang3
+  test
+
 
 
   org.apache.logging.log4j
diff --git a/pom.xml b/pom.xml
index f0eb164d0c45..79d572f1b8bf 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1182,6 +1182,12 @@
 selenium-4-12_${scala.binary.version}
 3.2.17.0
 test
+
+  
+org.seleniumhq.selenium
+htmlunit-driver
+  
+
   
   
 org.mockito


-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org