svn commit: r69064 - /dev/hive/r2.3.10/ /release/hive/hive-2.3.10/

[sunchao]

Author: sunchao
Date: Thu May  9 15:41:00 2024
New Revision: 69064

Log:
Move hive-2.3.10 release from dev to release

Added:
release/hive/hive-2.3.10/
  - copied from r69063, dev/hive/r2.3.10/
Removed:
dev/hive/r2.3.10/

(hive) annotated tag rel/release-2.3.10 updated (5160d3af392 -> 5715ecdac8b)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag rel/release-2.3.10
in repository https://gitbox.apache.org/repos/asf/hive.git


*** WARNING: tag rel/release-2.3.10 was modified! ***

from 5160d3af392 (commit)
  to 5715ecdac8b (tag)
 tagging 1ea529c533191cbf42ca19770605fc6b9c0e10e6 (tag)
  length 163 bytes
  by Chao Sun
  on Thu May 9 08:38:55 2024 -0700

- Log -
Hive 2.3.10 release.
-BEGIN PGP SIGNATURE-

iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmY87g8ACgkQhLjnd5qi
6HxAIBAAxN4iTNo5nvFVRgH18sK606Ue54247yjS9FWZqKGDZVKaxXkkZJOtQ85Q
ZUR2lEBKRMQGsOR1j5Hd9UJLJxI36YZgwhMC95Wz97f8SH/TefdfaNwL/rAMhgVr
Y8iaPZyEb5Z/T2noCbO6z+CG/TuuMTpV6GlEhMPdlStPN6hqp9q+aXGT8rDeXIOi
6B1AVMBVPv7vuh+k8AgIWwFNunnqtx9V5XrZWJHMpv3eIq/M8v7sQGpUFivEc+ZV
SpHyoLt8BD+lPsj8KrmcBzaH21OBYeGeWOB33miS4xQVUCG2vhbfXZpPJsD5EG82
y7vF9teNw+fB5vnNBggtAqZCCymFg98/lTYFW1vwOzLtmW55XjFy1AC8l0l9c6nS
TWmJUh7GMnX78GtejD+FmDTqcgQRgk3SpB+ssykkK/ku8Tyq7YHP+/wPDupjSwLx
jDZnmB6jx3nk1ykVN2+95IaSv4xl1+ScwDcEDRpbrKfMDt6flYKymxGK+Mj+P+vQ
ej1dStXwVEWJWgIc9QRUnrCx/L18dN1Nf7Rl9xj7EoqwHjmDSM0Hec8TL0tfBoOS
1i4ZSGSA5cgymj0WKIkVSZw3u5WaBT+1Gk0rbMDZEoAKwmiU3TpacWs+Vlrd9jIq
HeIBivt2vnK5XF+eEDJcyLy5MtbuuCjEFhtzPpxfNkaIbHEHwKY=
=kT2D
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:

svn commit: r68954 - in /dev/hive/r2.3.10: apache-hive-2.3.10-bin.tar.gz apache-hive-2.3.10-bin.tar.gz.asc apache-hive-2.3.10-bin.tar.gz.sha256 apache-hive-2.3.10-src.tar.gz apache-hive-2.3.10-src.tar

[sunchao]

Author: sunchao
Date: Sun May  5 05:27:05 2024
New Revision: 68954

Log:
Hive 2.3.10 release RC1

Modified:
dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz
dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc
dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256
dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz
dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc
dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.sha256

Modified: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz
==
Binary files - no diff available.

Modified: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc (original)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc Sun May  5 05:27:05 2024
@@ -1,16 +1,16 @@
 -BEGIN PGP SIGNATURE-
 
-iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmYj9z0ACgkQhLjnd5qi
-6HyNRw/8CLstUxsz4GddLFbC5CN0gaROSLCEKNrfAIz9bQskJgYmwJi/FEesGZDG
-Rs+D4Ri4bD0jo+UYnbctLvs4ijLyaK533WTPaVoIl+HS/lB4BdZCNdARMGptQLNy
-uNdqkng7ImGiYNESa3RweZHp6pr2/ROlz0Qo8NnTsnLkO6erZRqE/d5v+TMoFKga
-W43rtBdbz5Bko4Rms0rEOP2dauYDdiZ6qCP4bB1RmFrAYmiIaKiAVrbAqKKQgkNJ
-j7nJSadcTN5lBS3vxK5lTG7mOXwO5vcoKtIlMi1DLZGPZ9EPrcvzv/QzcvqNK387
-xIP9V4DKQsKY9Leg8I5Hq2qh5qbUJ++m2st/X3Eo6XK9wEz16P97vJ/tca1Zv8FO
-vKPNyIDVkCPQ/QRmx3LmaUWuEMbxVMJ80TN74az+8K2YqmyU6bOnSqjm1i3Bsdar
-oz0D5gJEpl6iVbes1Vr+hTWPbReTsHR8sk+Og6HvL08z1AM3tCCH7dkhs5hoAt3m
-HPwE6b+LUX+yFzcrp3p7pR/o2jxYyqdnTvmQ3b2nuUbuHqQAMaIzwiDDgvOGLv11
-1Yn7BgeHyVsUqcKEGX+YjvxzaHwvxHHWKovhT05CMXSYH3AeVgkQy+yqpqI8CaoH
-Rm2iErT/90Cr1DZ4kUUjRoq3jUQGRHv8ITdFYK+VYH6ogfbGL6s=
-=evGm
+iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmY3FigACgkQhLjnd5qi
+6HzamhAAjIzTVwA+58Vk7xg3PCAg6d8LlM2MGMN6A4bw07Ianxu6nexDqf8wIKcV
+1bddxqetG0j+MTCAerVrHinyrSd54ebCl8fb5ex60UBhYU3zgiMsdvjCJxbd9Oi3
+mQCFWOqXgFAi3gO9yUuoKXL8wpY9IjZO5oboX/yyyLXjzpFAayoHtMvlKxJChPRs
+sjq8oHnDwbL7VlkzchgesTp2vCIhzZB7W8mUtUOJ51WvPYTauQTm+hIW4V6AhBxo
+dUTQs76Q9EvmwS9Z/oVE8aBN0O2zUWEfVzGm9y35QXXn78LchULOGs2X8hprSw49
+x953JJsQAxAJDwbU1/iKdQer7SVzAyKe8fOPLgg8XbPTXZpMh+suaRwx0L1cJXbI
+9UGykAjBFrkCchvO+8txOQfkvljtDiZjgyP0Arj5mtXqK8fM8Dx8Y0TM+j1tt5TR
+6XoG/GatJpz8EQYdfTJkrBv23MCqSujgsJU4Q4OQ9gXgkgJeLNlK8hQiIZoMCRdr
+l1dibbaafA3WQlpBMqwPE1STKSvGHdy6XhGQD6DKhfKk4lck62FjkBiFNF9tRvTH
+k9QbMrnRvRBTHdaEr+8h6DCgN4ohfWa5+tq0jF54aIMGgNECjFDwQJheOIr7V0QO
+JTvAV5qJVSQePYIZ8ivkoG4eIHQE51jQpwp6iII3Y4tcv083+wc=
+=4qY6
 -END PGP SIGNATURE-

Modified: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256 (original)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256 Sun May  5 05:27:05 
2024
@@ -1 +1 @@
-00655e9a257769c1ab42061cb20ccf555c2ac545d639fe3174b9fcbb05c29561  
apache-hive-2.3.10-bin.tar.gz
+f61349296582415090738ac812de026f3b54253a256c3ed2b2bb3ffe7377fd98  
apache-hive-2.3.10-bin.tar.gz

Modified: dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz
==
Binary files - no diff available.

Modified: dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc (original)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc Sun May  5 05:27:05 2024
@@ -1,16 +1,16 @@
 -BEGIN PGP SIGNATURE-
 
-iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmYj90YACgkQhLjnd5qi
-6HzUPQ/+N7Zx3XV5eoJcfoakrgLIt1RMshmn0GauW+P3DP3qeBPQ/LdPoH2fKpde
-d8LoqKC9LDXvbcNMlBo3JmjWUin4GfEKRyXJ6+sahI0Gl26NhK79HE1aqMGnADRV
-dezHiQVUBIFklJIGIBuQXGsvPaU08RzlwtOzlLGm/GyWVCrWjf7fN1151gQSNQ37
-Vc1HA4Q4jWrGaxMFXizvMa3Q94V08JagHkr19yU9dJVhxvIprUQFVXrCJF9i+inX
-JxpQ2guo9D6NeV+sise/FTtmNri0ui87/zXjQraxn0T7MB5f+5fMJBhMI74K63ci
-bcAaJhS68BjzHAFfgZxT46a22/vczY0dFYZ6cxrMxJS5N2llrY55ChAPQEUm0stj
-Vw3im1qGzM9POTDPI36phk3fECQjq/vVJ/Fu0uIAJP1jNNBH5cP8pkMbx4f7B17s
-3k9jD/omU4etIhhfXN6fCjQakOViz32bbhTh5HqvVkt564C49QljX8S807EuWbs+
-sb207M+pvUxBgBVrhvVDpGMdW0FpBwfMAjlmY/e/0s5cc0UneNIoQSp60lPp36pd
-oLOjCs8GlibLTeRve8x//ujeyot46zgMpNkggbzi3uxiOnCiHktK8W0v6mk6CHju
-B7sKjaLDSnui1Gi8gUEe8Z9ndQ4J7NsLuP8LiR/Zl5PUzXZtGGQ=
-=h5HQ
+iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmY3FhoACgkQhLjnd5qi
+6Hzs3A/7BTUKF8Uuw0cODeSc9YKUenABDZTQA58hZDObjDzqMHCxa+4HjKGL7F2q
+1yGErtKDpyYL5CZJEhm7rdpomH2D8LLMO0gQngRShpOAjwn9iPufxBYndrRrwQ1C
+a8utDPO9bA9anYQi8UJv1prScqOvt8swoU61wuOHP2CeuCr+oFwcxN7ZIWTvrKmR
+3ke2dOeyVRvMfmdT9erNuN8XgQ3rRSNmcBsD4hORejCSmEZ2BavN+WnPCS8SL51F
+dxlhL2dHVZgh0qG8V+uaG5xGg35thAOPLeK3QaHSOFNNS9aVVpYseObjqxZOCteA
+SDuI9062jyrsu6xHQ2uM2awTsFCn/NeZRPCTwBkJ7f9rJlX8gWW6D4xTz6z1x+sv
+IEqlhRl7HPdD740eFZzAklm2DiETpJL7IpgrndCEMIrSURm2R9Wc+FW9UleHjaxl
+gn8xU8Ny8IQJp5XAL51tJByfFSQ0wXshoMcRl2QCkZ7qWsNISIcXDgnjbX3ZoSxw
+XQ3AfrNCHmPlWA2NhoK2cNuNxyoEaLtdoEVvrClE2kQp

(hive) annotated tag release-2.3.10-rc1 updated (5160d3af392 -> 1ea529c5331)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.10-rc1
in repository https://gitbox.apache.org/repos/asf/hive.git


*** WARNING: tag release-2.3.10-rc1 was modified! ***

from 5160d3af392 (commit)
  to 1ea529c5331 (tag)
 tagging 5160d3af392248255f68e41e1e0557eae4d95273 (commit)
 replaces release-2.3.10-rc0
  by Chao Sun
  on Sat May 4 22:08:59 2024 -0700

- Log -
Hive 2.3.10-rc1 release.
---


No new revisions were added by this update.

Summary of changes:

(hive) branch branch-2.3 updated: Updated release notes for 2.3.10 release RC1

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 5160d3af392 Updated release notes for 2.3.10 release RC1
5160d3af392 is described below

commit 5160d3af392248255f68e41e1e0557eae4d95273
Author: Chao Sun 
AuthorDate: Sat May 4 22:08:34 2024 -0700

Updated release notes for 2.3.10 release RC1
---
 RELEASE_NOTES.txt | 39 +++
 1 file changed, 31 insertions(+), 8 deletions(-)

diff --git a/RELEASE_NOTES.txt b/RELEASE_NOTES.txt
index 84b79e3dd33..62d24dc2526 100644
--- a/RELEASE_NOTES.txt
+++ b/RELEASE_NOTES.txt
@@ -1,16 +1,39 @@
-Release Notes - Hive - Version 2.3.9
+Release Notes - Hive - Version 2.3.10
 
 
 
 ** Bug
-* [HIVE-17155] - findConfFile() in HiveConf.java has some issues with the 
conf path
-* [HIVE-24797] - Disable validate default values when parsing Avro schemas
-* [HIVE-24608] - Switch back to get_table in HMS client for Hive 2.3.x
-* [HIVE-21200] - Vectorization: date column throwing 
java.lang.UnsupportedOperationException for parquet
+* [HIVE-20016] - Investigate TestJdbcWithMiniHS2.testParallelCompilation3 
random failure
+* [HIVE-28121] - Use direct SQL for transactional altering table parameter
+* [HIVE-7145]  - Remove dependence on apache commons-lang
+* [HIVE-25054] - Upgrade jodd-core due to CVE-2018-21234
+* [HIVE-27468] - Restore original license in PriorityBlockingDeque
+* [HIVE-27467] - NOTICE files use incorrect wording "developed by" instead 
of "developed at"
+* [HIVE-26522] - Test for HIVE-22033 and backport to 3.1 and 2.3
+* [HIVE-26434] - HMS thrift method recv_get_table_objects_by_name 
exception list is broken
 
 ** Improvement
-* [HIVE-21563] - Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce
-* [HIVE-19228] - Remove commons-httpclient 3.x usage
+* [HIVE-25665] - Checkstyle LGPL files must not be in the release 
sources/binaries
+* [HIVE-27478] - Remove re2j, SQLLine, ClassNameCompleter entries from 
LICENSE file
+* [HIVE-28104] - Move HTTP related methods from Utils to HttpUtils in shims
+* [HIVE-27172] - Add the HMS client connection timeout config
+* [HIVE-18586] - Upgrade Derby to 10.14.1.0
+* [HIVE-27817] - Disable ssl hostname verification for 127.0.0.1
+* [HIVE-26173] - Upgrade derby to 10.14.2.0
+* [HIVE-27868] - Backport a subset of HIVE-18755 to branch-2.3 to support 
reading from catalog in HMS 3+
+* [HIVE-27815] - Support collect numModifiedRows
+* [HIVE-27580] - Backport HIVE-20071: Migrate to jackson 2.x and prevent 
usage
+* [HIVE-27560] - Enhancing compatibility with Guava
+* [HIVE-27581] - Backport jackson upgrade related patch to branch-2.3
+* [HIVE-27579] - Backport HIVE-18433: Upgrade version of 
com.fasterxml.jackson
+* [HIVE-25996] - Backport HIVE-25098
+* [HIVE-27518] - 2.3 - Upgrade log4j2 from 2.17.0 to 2.17.2
+* [HIVE-25173] - Fix build failure of hive-pre-upgrade due to missing 
dependency on pentaho-aggdesigner-algorithm
+* [HIVE-26880] - Upgrade Apache Directory Server to 1.5.7 for release 3.2
+* [HIVE-26882] - Allow transactional check of Table parameter before 
altering the Table
+* [HIVE-25824] - Upgrade branch-2.3 to log4j 2.17.0
+* [HIVE-25616] - Backport HIVE-24741 to Hive 2.3
+* [HIVE-25500] - Switch back to alter_partition(s) in HMS client for Hive 
2.3.x
 
 ** Test
-* [HIVE-18147] - Tests can fail with java.net.BindException: Address 
already in use
+* [HIVE-26890] - Disable TestSSL#testConnectionWrongCertCN (Done as part 
of HIVE-22621 in master)

(hive) branch branch-2.3 updated: HIVE-20016: Investigate TestJdbcWithMiniHS2.testParallelCompilation3 random failure (Yongzhi Chen, reviewed by Aihua Xu) (#5227)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 0b8dc8b040e HIVE-20016: Investigate 
TestJdbcWithMiniHS2.testParallelCompilation3 random failure (Yongzhi Chen, 
reviewed by Aihua Xu) (#5227)
0b8dc8b040e is described below

commit 0b8dc8b040e8a58d8fd85f5364ef5f9608f99ecb
Author: Cheng Pan 
AuthorDate: Wed May 1 00:05:35 2024 +0800

HIVE-20016: Investigate TestJdbcWithMiniHS2.testParallelCompilation3 random 
failure (Yongzhi Chen, reviewed by Aihua Xu) (#5227)

Co-authored-by: Yongzhi Chen 
---
 ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 
b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
index 6add74c2cd8..a0a0ed76141 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
@@ -849,7 +849,7 @@ public class SessionState {
   /**
* Setup authentication and authorization plugins for this session.
*/
-  private void setupAuth() {
+  private synchronized void setupAuth() {
 
 if (authenticator != null) {
   // auth has been initialized

(hive) branch branch-2.3 updated: HIVE-28121: (2.3) Use direct SQL for transactional altering table parameter (#5204)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 10b3b0310d4 HIVE-28121: (2.3) Use direct SQL for transactional 
altering table parameter (#5204)
10b3b0310d4 is described below

commit 10b3b0310d486fdb665de9b0d70dfa6c5163be79
Author: Cheng Pan 
AuthorDate: Tue Apr 30 13:55:31 2024 +0800

HIVE-28121: (2.3) Use direct SQL for transactional altering table parameter 
(#5204)
---
 .../java/org/apache/hadoop/hive/conf/HiveConf.java |  4 
 .../hcatalog/listener/DummyRawStoreFailEvent.java  |  6 +
 .../hadoop/hive/metastore/HiveAlterHandler.java| 26 -
 .../hadoop/hive/metastore/MetaStoreDirectSql.java  |  9 
 .../apache/hadoop/hive/metastore/ObjectStore.java  | 27 ++
 .../org/apache/hadoop/hive/metastore/RawStore.java |  8 +++
 .../hadoop/hive/metastore/hbase/HBaseStore.java|  6 +
 .../metastore/DummyRawStoreControlledCommit.java   |  6 +
 .../metastore/DummyRawStoreForJdoConnection.java   |  6 +
 .../client/TestTablesCreateDropAlterTruncate.java  |  8 +++
 .../minihms/AbstractMetaStoreService.java  |  5 
 11 files changed, 100 insertions(+), 11 deletions(-)

diff --git a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
index a5c1461010c..708a3763232 100644
--- a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
+++ b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
@@ -786,6 +786,10 @@ public class HiveConf extends Configuration {
 "Name of the identifier factory to use when generating table/column 
names etc. \n" +
 "'datanucleus1' is used for backward compatibility with DataNucleus 
v1"),
 
METASTORE_USE_LEGACY_VALUE_STRATEGY("datanucleus.rdbms.useLegacyNativeValueStrategy",
 true, ""),
+METASTORE_QUERY_SQL_ALLOWALL("datanucleus.query.sql.allowAll", true,
+"In strict JDO all SQL queries must begin with \"SELECT ...\", and 
consequently it " +
+"is not possible to execute queries that change data. This DataNucleus 
property when set to true allows " +
+"insert, update and delete operations from JDO SQL. Default value is 
true."),
 
METASTORE_PLUGIN_REGISTRY_BUNDLE_CHECK("datanucleus.plugin.pluginRegistryBundleCheck",
 "LOG",
 "Defines what happens when plugin bundles are found and are duplicated 
[EXCEPTION|LOG|NONE]"),
 METASTORE_BATCH_RETRIEVE_MAX("hive.metastore.batch.retrieve.max", 300,
diff --git 
a/itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/DummyRawStoreFailEvent.java
 
b/itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/DummyRawStoreFailEvent.java
index a5cc94e846c..99e6e79633d 100644
--- 
a/itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/DummyRawStoreFailEvent.java
+++ 
b/itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/DummyRawStoreFailEvent.java
@@ -928,4 +928,10 @@ public class DummyRawStoreFailEvent implements RawStore, 
Configurable {
   public void addForeignKeys(List fks)
   throws InvalidObjectException, MetaException {
   }
+
+  @Override
+  public long updateParameterWithExpectedValue(Table table, String key, String 
expectedValue, String newValue)
+  throws MetaException, NoSuchObjectException {
+throw new UnsupportedOperationException("This Store doesn't support 
updating table parameter with expected value");
+  }
 }
\ No newline at end of file
diff --git 
a/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java 
b/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java
index f5f6be5849f..64ce269157c 100644
--- a/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java
+++ b/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java
@@ -51,7 +51,6 @@ import 
org.apache.hadoop.hive.metastore.api.hive_metastoreConstants;
 import org.apache.hadoop.ipc.RemoteException;
 import org.apache.hive.common.util.HiveStringUtils;
 
-import javax.jdo.Constants;
 import java.io.IOException;
 import java.net.URI;
 import java.util.ArrayList;
@@ -132,12 +131,7 @@ public class HiveAlterHandler implements AlterHandler {
   String expectedValue = environmentContext != null && 
environmentContext.getProperties() != null ?
   
environmentContext.getProperties().get(hive_metastoreConstants.EXPECTED_PARAMETER_VALUE)
 : null;
 
-  if (expectedKey != null) {
-// If we have to check the expected state of the table we have to 
prevent nonrepeatable reads.
-msdb.openTransaction(Constants.TX_REPEATABLE_REA

svn commit: r68681 - in /dev/hive/r2.3.10: ./ apache-hive-2.3.10-bin.tar.gz apache-hive-2.3.10-bin.tar.gz.asc apache-hive-2.3.10-bin.tar.gz.sha256 apache-hive-2.3.10-src.tar.gz apache-hive-2.3.10-src.

[sunchao]

Author: sunchao
Date: Sat Apr 20 19:15:47 2024
New Revision: 68681

Log:
Hive 2.3.10 release

Added:
dev/hive/r2.3.10/
dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz   (with props)
dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc
dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256
dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz   (with props)
dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc
dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.sha256

Added: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz
==
Binary file - no diff available.

Propchange: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc (added)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.asc Sat Apr 20 19:15:47 2024
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmYj9z0ACgkQhLjnd5qi
+6HyNRw/8CLstUxsz4GddLFbC5CN0gaROSLCEKNrfAIz9bQskJgYmwJi/FEesGZDG
+Rs+D4Ri4bD0jo+UYnbctLvs4ijLyaK533WTPaVoIl+HS/lB4BdZCNdARMGptQLNy
+uNdqkng7ImGiYNESa3RweZHp6pr2/ROlz0Qo8NnTsnLkO6erZRqE/d5v+TMoFKga
+W43rtBdbz5Bko4Rms0rEOP2dauYDdiZ6qCP4bB1RmFrAYmiIaKiAVrbAqKKQgkNJ
+j7nJSadcTN5lBS3vxK5lTG7mOXwO5vcoKtIlMi1DLZGPZ9EPrcvzv/QzcvqNK387
+xIP9V4DKQsKY9Leg8I5Hq2qh5qbUJ++m2st/X3Eo6XK9wEz16P97vJ/tca1Zv8FO
+vKPNyIDVkCPQ/QRmx3LmaUWuEMbxVMJ80TN74az+8K2YqmyU6bOnSqjm1i3Bsdar
+oz0D5gJEpl6iVbes1Vr+hTWPbReTsHR8sk+Og6HvL08z1AM3tCCH7dkhs5hoAt3m
+HPwE6b+LUX+yFzcrp3p7pR/o2jxYyqdnTvmQ3b2nuUbuHqQAMaIzwiDDgvOGLv11
+1Yn7BgeHyVsUqcKEGX+YjvxzaHwvxHHWKovhT05CMXSYH3AeVgkQy+yqpqI8CaoH
+Rm2iErT/90Cr1DZ4kUUjRoq3jUQGRHv8ITdFYK+VYH6ogfbGL6s=
+=evGm
+-END PGP SIGNATURE-

Added: dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256 (added)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-bin.tar.gz.sha256 Sat Apr 20 19:15:47 
2024
@@ -0,0 +1 @@
+00655e9a257769c1ab42061cb20ccf555c2ac545d639fe3174b9fcbb05c29561  
apache-hive-2.3.10-bin.tar.gz

Added: dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz
==
Binary file - no diff available.

Propchange: dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc (added)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.asc Sat Apr 20 19:15:47 2024
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCAAdFiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmYj90YACgkQhLjnd5qi
+6HzUPQ/+N7Zx3XV5eoJcfoakrgLIt1RMshmn0GauW+P3DP3qeBPQ/LdPoH2fKpde
+d8LoqKC9LDXvbcNMlBo3JmjWUin4GfEKRyXJ6+sahI0Gl26NhK79HE1aqMGnADRV
+dezHiQVUBIFklJIGIBuQXGsvPaU08RzlwtOzlLGm/GyWVCrWjf7fN1151gQSNQ37
+Vc1HA4Q4jWrGaxMFXizvMa3Q94V08JagHkr19yU9dJVhxvIprUQFVXrCJF9i+inX
+JxpQ2guo9D6NeV+sise/FTtmNri0ui87/zXjQraxn0T7MB5f+5fMJBhMI74K63ci
+bcAaJhS68BjzHAFfgZxT46a22/vczY0dFYZ6cxrMxJS5N2llrY55ChAPQEUm0stj
+Vw3im1qGzM9POTDPI36phk3fECQjq/vVJ/Fu0uIAJP1jNNBH5cP8pkMbx4f7B17s
+3k9jD/omU4etIhhfXN6fCjQakOViz32bbhTh5HqvVkt564C49QljX8S807EuWbs+
+sb207M+pvUxBgBVrhvVDpGMdW0FpBwfMAjlmY/e/0s5cc0UneNIoQSp60lPp36pd
+oLOjCs8GlibLTeRve8x//ujeyot46zgMpNkggbzi3uxiOnCiHktK8W0v6mk6CHju
+B7sKjaLDSnui1Gi8gUEe8Z9ndQ4J7NsLuP8LiR/Zl5PUzXZtGGQ=
+=h5HQ
+-END PGP SIGNATURE-

Added: dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.sha256
==
--- dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.sha256 (added)
+++ dev/hive/r2.3.10/apache-hive-2.3.10-src.tar.gz.sha256 Sat Apr 20 19:15:47 
2024
@@ -0,0 +1 @@
+f2ae36c4f7df4f4f2dd4dfbe55fd7533d888b0b5566c0e94d5f0165ffaa72038  
apache-hive-2.3.10-src.tar.gz

svn commit: r68677 - /release/hive/KEYS

[sunchao]

Author: sunchao
Date: Sat Apr 20 16:41:06 2024
New Revision: 68677

Log:
Adding Chao Sun's new signing key

Modified:
release/hive/KEYS

Modified: release/hive/KEYS
==
--- release/hive/KEYS (original)
+++ release/hive/KEYS Sat Apr 20 16:41:06 2024
@@ -1872,3 +1872,37 @@ uX579VX/QGweWcRvbsW4Ek0MgQwg1nBtMln92ax8
 pWAvon9F2+GZV2g9w6UmKRAJYC6FbbaN6qSWZygwGU3f9iYumg==
 =0Tff
 -END PGP PUBLIC KEY BLOCK-
+pub   rsa4096 2024-04-20 [SC]
+  CFE523DC4F315769CB55FB9D84B8E7779AA2E87C
+uid   [ultimate] Chao Sun (NEW CODE SIGNING KEY) 
+sig 384B8E7779AA2E87C 2024-04-20  [self-signature]
+
+-BEGIN PGP PUBLIC KEY BLOCK-
+
+mQINBGYj65EBEADZtWKC30xzbUg1o1xE0QhT+DQcCu5M6tu8097YmNBOcqAYomhl
+V1kGuJ6FYlZbC4iHWyFpENyV2ag0FMKs3pMSgIn8bwhQH7MWruTI2wv6EXP0uPGD
+OuprYXIOVt4JAh4NVO81GB1HHSwpwdXeJHyYp2XTfgjx1PcmPKW4Il+4UsHcOO1J
+GtKRE4HN0+wLhCHqynFeD7lK7a8CVQsOW07FC0yiDxst0dVaKEkA0LnRH1q1/2xl
+fNUXjLfTzXaFibAaRmVHSNTjlxNxILPK0SLQl8NDI4RlIyCt7nppQefJ6sv4lcpR
+mKc+D99+gmP4j1JYnPwjJ5fgykzj4puiLxXMTmpwCi6/5D8FXfLXYkAz76H94Z8W
+AeSyXlPeP081nOcypliOF2r5ZRV9IuSvwZoskxDZB3HJZ4i9pQKeNJpbU+miaTWu
+1ldULeo3/dDHs5ILRJsD5I5hDDrJ1V4QCuYrmRWDSKXEstXqgP0mpGF3fMNChzGf
+zjGJyJjn3Y+kdfUtcOcXCTfb2e8uXKROCoGBzZhRx7cXC6pEw51igZiYO+0fVLAX
+sL8gFhezCueDbmI4JE7yzP1Ho1VA2RGEo+r1E6mriji91p5Nu1r+dt8clOp3RW7l
+VPFkNo3iX5EpWIdKEnLKhJ+5oWB3GYuv4UGCigtdennzkZXnk4iDPSOxcwARAQAB
+tDRDaGFvIFN1biAoTkVXIENPREUgU0lHTklORyBLRVkpIDxzdW5jaGFvQGFwYWNo
+ZS5vcmc+iQJRBBMBCAA7FiEEz+Uj3E8xV2nLVfudhLjnd5qi6HwFAmYj65ECGwMF
+CwkIBwICIgIGFQoJCAsCBBYCAwECHgcCF4AACgkQhLjnd5qi6HzvoA/+Mdttez7a
+KhNminrDIpr9e+20HiDRhCgAY0ZpiY7CeDWrcsWRZcJK+2JcZ9nwEvXxVHJDq6XV
++0vGbR5P5nAge+oNaJWc0SEnp1NyijHs6B4QclcUjrnr/IJZlLV38o2YHevnFrjB
+d0krLFaZrUc2y2FV3vZw77mZZBmPyPNoxEGDjUZDYL4Wj4px7omD4r7iHReimX7q
+l6D88I02kvX/4E9QtyZ3fdO/WWKXYJuH4Lvp1o7c0fJ+jAJElNP0GLFMCMI/fWfF
+d9G6zSuVjouOfd9aRfRRZnIly6nLGfc7iQ8UrJAJQi7LciPyjq6l0bNtS5b1X2Cm
+zG3jrxqZhD0C3AB9edcBEnGQPm/45qUQ7KrszQQeCG0Fc3YtTTAm+Y6P77CQXpUO
+xFCTb1JD+8nedP1So/n+ESAL6CJGJKHARaZ13TQ+2yhi3iobTf2WLSTwoQYsPavq
+ryTX/Og/32Cc5rdidFN4l6gzWPlLSWVbBn0kXpabArnF7BeJpdB866K6CI9ljCwc
+53uAWoseEzZH1gXxX0+CKh73H/fn8misAI9bkgag6UuJzxVUTM2aTts6o2lVBRg3
+VzbuZe35Pac8G467Sz9sR89WR2LQUF/G74LqLNp7FXMkZek9tM5gHAj915CwHQlg
+fetEtZQvQ+rCmqljHpy61VZsnVhgyro6FtY=
+=dZJe
+-END PGP PUBLIC KEY BLOCK-

(hive) annotated tag release-2.3.10-rc0 updated (35ef022fab5 -> 461b1aea98a)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.10-rc0
in repository https://gitbox.apache.org/repos/asf/hive.git


*** WARNING: tag release-2.3.10-rc0 was modified! ***

from 35ef022fab5 (commit)
  to 461b1aea98a (tag)
 tagging 35ef022fab5f0317793aa024bfe669a5c50269b1 (commit)
 replaces rel/release-2.3.9
  by Chao Sun
  on Sat Apr 20 09:03:22 2024 -0700

- Log -
Hive 2.3.10-rc0 release.
---


No new revisions were added by this update.

Summary of changes:

(hive) branch branch-2.3 updated: Prepare for 2.3.10 release

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 35ef022fab5 Prepare for 2.3.10 release
35ef022fab5 is described below

commit 35ef022fab5f0317793aa024bfe669a5c50269b1
Author: Chao Sun 
AuthorDate: Sat Apr 20 09:00:19 2024 -0700

Prepare for 2.3.10 release
---
 accumulo-handler/pom.xml | 2 +-
 beeline/pom.xml  | 2 +-
 cli/pom.xml  | 2 +-
 common/pom.xml   | 2 +-
 contrib/pom.xml  | 2 +-
 druid-handler/pom.xml| 2 +-
 hbase-handler/pom.xml| 2 +-
 hcatalog/core/pom.xml| 2 +-
 hcatalog/hcatalog-pig-adapter/pom.xml| 2 +-
 hcatalog/pom.xml | 2 +-
 hcatalog/server-extensions/pom.xml   | 2 +-
 hcatalog/streaming/pom.xml   | 2 +-
 hcatalog/webhcat/java-client/pom.xml | 2 +-
 hcatalog/webhcat/svr/pom.xml | 2 +-
 hplsql/pom.xml   | 2 +-
 itests/custom-serde/pom.xml  | 2 +-
 itests/custom-udfs/pom.xml   | 2 +-
 itests/custom-udfs/udf-classloader-udf1/pom.xml  | 2 +-
 itests/custom-udfs/udf-classloader-udf2/pom.xml  | 2 +-
 itests/custom-udfs/udf-classloader-util/pom.xml  | 2 +-
 itests/custom-udfs/udf-vectorized-badexample/pom.xml | 2 +-
 itests/hcatalog-unit/pom.xml | 2 +-
 itests/hive-blobstore/pom.xml| 2 +-
 itests/hive-jmh/pom.xml  | 2 +-
 itests/hive-minikdc/pom.xml  | 2 +-
 itests/hive-unit-hadoop2/pom.xml | 2 +-
 itests/hive-unit/pom.xml | 2 +-
 itests/pom.xml   | 2 +-
 itests/qtest-accumulo/pom.xml| 2 +-
 itests/qtest-spark/pom.xml   | 2 +-
 itests/qtest/pom.xml | 2 +-
 itests/test-serde/pom.xml| 2 +-
 itests/util/pom.xml  | 2 +-
 jdbc-handler/pom.xml | 2 +-
 jdbc/pom.xml | 2 +-
 llap-client/pom.xml  | 2 +-
 llap-common/pom.xml  | 2 +-
 llap-ext-client/pom.xml  | 2 +-
 llap-server/pom.xml  | 2 +-
 llap-tez/pom.xml | 2 +-
 metastore/pom.xml| 2 +-
 packaging/pom.xml| 2 +-
 pom.xml  | 2 +-
 ql/pom.xml   | 2 +-
 serde/pom.xml| 2 +-
 service-rpc/pom.xml  | 2 +-
 service/pom.xml  | 2 +-
 shims/0.23/pom.xml   | 2 +-
 shims/aggregator/pom.xml | 2 +-
 shims/common/pom.xml | 2 +-
 shims/pom.xml| 2 +-
 shims/scheduler/pom.xml  | 2 +-
 spark-client/pom.xml | 4 ++--
 testutils/pom.xml| 2 +-
 vector-code-gen/pom.xml  | 2 +-
 55 files changed, 56 insertions(+), 56 deletions(-)

diff --git a/accumulo-handler/pom.xml b/accumulo-handler/pom.xml
index 48c6b5cfe70..9915a46d93b 100644
--- a/accumulo-handler/pom.xml
+++ b/accumulo-handler/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.10-SNAPSHOT
+2.3.10
 ../pom.xml
   
 
diff --git a/beeline/pom.xml b/beeline/pom.xml
index 39bf9fba1c7..e12d1b9446a 100644
--- a/beeline/pom.xml
+++ b/beeline/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.10-SNAPSHOT
+2.3.10
 ../pom.xml
   
 
diff --git a/cli/pom.xml b/cli/pom.xml
index 74df368fae9..867994c81c6 100644
--- a/cli/pom.xml
+++ b/cli/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.10-SNAPSHOT
+2.3.10
 ../pom.xml
   
 
diff --git a/common/pom.xml b/common/pom.xml
index 4658111210b..683d6cb33f0 100644
--- a/common/pom.xml
+++ b/common/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.10-SNAPSHOT
+2.3.10
 ../pom.xml
   
 
diff --git a/contrib/pom.xml b/contrib/pom.xml
index 85d35f98cd9..7ec9e02c4d6 100644
--- a/contrib/pom.xml
+++ b/contrib/pom.xml
@@ -19,7 +19,7

(hive) branch branch-2.3 updated: HIVE-25054: (2.3) Drop vulnerable jodd-core dependency (#5151)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new ac0e85715af HIVE-25054: (2.3) Drop vulnerable jodd-core dependency 
(#5151)
ac0e85715af is described below

commit ac0e85715af20cd023895ba85e86b018282c8c10
Author: Cheng Pan 
AuthorDate: Thu Mar 28 12:24:47 2024 +0800

HIVE-25054: (2.3) Drop vulnerable jodd-core dependency (#5151)
---
 pom.xml|   2 +-
 ql/pom.xml |   6 -
 .../ql/io/parquet/timestamp/NanoTimeUtils.java |   2 +-
 .../parquet/timestamp/datetime/DateTimeStamp.java  |  53 +++
 .../io/parquet/timestamp/datetime/JDateTime.java   | 458 +
 .../timestamp/datetime/JDateTimeDefault.java   |  24 ++
 .../timestamp/datetime/JulianDateStamp.java| 140 +++
 .../ql/io/parquet/timestamp/datetime/TimeUtil.java | 258 
 .../hive-webapps/hiveserver2/hiveserver2.jsp   |   6 +-
 9 files changed, 938 insertions(+), 11 deletions(-)

diff --git a/pom.xml b/pom.xml
index 52f9edccc3e..4636582c507 100644
--- a/pom.xml
+++ b/pom.xml
@@ -165,7 +165,6 @@
 2.12
 2.0.2
 2.8.1
-3.5.2
 1.8
 4.11
 3.0.3
@@ -1120,6 +1119,7 @@
**/sit
 **/test/queries/**/*.sql
 **/PriorityBlockingDeque.java
+**/ql/io/parquet/timestamp/datetime/**
  

   
diff --git a/ql/pom.xml b/ql/pom.xml
index 36574a4bc16..b4c8ded04a5 100644
--- a/ql/pom.xml
+++ b/ql/pom.xml
@@ -325,11 +325,6 @@
   groovy-all
   ${groovy.version}
 
-
-  org.jodd
-  jodd-core
-  ${jodd.version}
-
 
   com.fasterxml.jackson.core
   jackson-annotations
@@ -879,7 +874,6 @@
   javax.jdo:jdo-api
   commons-lang:commons-lang
   org.apache.commons:commons-lang3
-  org.jodd:jodd-core
   com.tdunning:json
   org.apache.avro:avro
   org.apache.avro:avro-mapred
diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/NanoTimeUtils.java 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/NanoTimeUtils.java
index 3fd75d24f3f..e8a2adc9e4d 100644
--- 
a/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/NanoTimeUtils.java
+++ 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/NanoTimeUtils.java
@@ -19,7 +19,7 @@ import java.util.GregorianCalendar;
 import java.util.TimeZone;
 import java.util.concurrent.TimeUnit;
 
-import jodd.datetime.JDateTime;
+import org.apache.hadoop.hive.ql.io.parquet.timestamp.datetime.JDateTime;
 
 /**
  * Utilities for converting from java.sql.Timestamp to parquet timestamp.
diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/datetime/DateTimeStamp.java
 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/datetime/DateTimeStamp.java
new file mode 100644
index 000..8ef45b8e37a
--- /dev/null
+++ 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/datetime/DateTimeStamp.java
@@ -0,0 +1,53 @@
+// Copyright (c) 2003-2014, Jodd Team (jodd.org). All Rights Reserved.
+
+package org.apache.hadoop.hive.ql.io.parquet.timestamp.datetime;
+
+
+import java.io.Serializable;
+
+
+/**
+ * Generic date time stamp just stores and holds date and time information.
+ * This class does not contain any date/time logic, neither guarantees
+ * that date is valid.
+ *
+ * @see JDateTime
+ * @see JulianDateStamp
+ */
+public class DateTimeStamp implements Serializable {
+
+   /**
+* Year.
+*/
+   public int year;
+
+   /**
+* Month, range: [1 - 12]
+*/
+   public int month = 1;
+
+   /**
+* Day, range: [1 - 31]
+*/
+   public int day = 1;
+
+   /**
+* Hour, range: [0 - 23]
+*/
+   public int hour;
+
+   /**
+* Minute, range [0 - 59]
+*/
+   public int minute;
+
+   /**
+* Second, range: [0 - 59]
+*/
+   public int second;
+
+   /**
+* Millisecond, range: [0 - 1000]
+*/
+   public int millisecond;
+}
diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/datetime/JDateTime.java
 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/datetime/JDateTime.java
new file mode 100644
index 000..5b50dd6cd62
--- /dev/null
+++ 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/timestamp/datetime/JDateTime.java
@@ -0,0 +1,458 @@
+// Copyright (c) 2003-2014, Jodd Team (jodd.org). All Rights Reserved.
+
+package org.apache.hadoop.hive.ql.io.parquet.timestamp.datetime;
+
+import java.util.TimeZone;
+
+/**
+ * Universal all-in-one date and time class that uses Astronomical Julian
+ * Dates for time calculations. Guaranteed precision for all

(hive) branch branch-2.3 updated: HIVE-25665: (2.3) Checkstyle LGPL files must not be in the release sources/binaries (#5146)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 6be126a3831 HIVE-25665: (2.3) Checkstyle LGPL files must not be in the 
release sources/binaries (#5146)
6be126a3831 is described below

commit 6be126a38316e6e0216c6ec7d7067c44048cbe9d
Author: Cheng Pan 
AuthorDate: Fri Mar 22 15:13:28 2024 +0800

HIVE-25665: (2.3) Checkstyle LGPL files must not be in the release 
sources/binaries (#5146)
---
 checkstyle/checkstyle-noframes-sorted.xsl | 195 --
 1 file changed, 195 deletions(-)

diff --git a/checkstyle/checkstyle-noframes-sorted.xsl 
b/checkstyle/checkstyle-noframes-sorted.xsl
deleted file mode 100644
index 9c0ac305416..000
--- a/checkstyle/checkstyle-noframes-sorted.xsl
+++ /dev/null
@@ -1,195 +0,0 @@
-http://www.w3.org/1999/XSL/Transform"; 
version="1.0">
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-   
-   
-   
-.bannercell {
-  border: 0px;
-  padding: 0px;
-}
-body {
-  margin-left: 10;
-  margin-right: 10;
-  font:normal 80% arial,helvetica,sanserif;
-  background-color:#FF;
-  color:#00;
-}
-.a td {
-  background: #efefef;
-}
-.b td {
-  background: #fff;
-}
-th, td {
-  text-align: left;
-  vertical-align: top;
-}
-th {
-  font-weight:bold;
-  background: #ccc;
-  color: black;
-}
-table, th, td {
-  font-size:100%;
-  border: none
-}
-table.log tr td, tr th {
-
-}
-h2 {
-  font-weight:bold;
-  font-size:140%;
-  margin-bottom: 5;
-}
-h3 {
-  font-size:100%;
-  font-weight:bold;
-  background: #525D76;
-  color: white;
-  text-decoration: none;
-  padding: 5px;
-  margin-right: 2px;
-  margin-left: 2px;
-  margin-bottom: 0;
-}
-   
-   
-   
-   
-  
-  
-  
-
-  
-
-   CheckStyle Audit
-   
-   
-   Designed for use with CheckStyle and Ant.
-   
-  
-   
-
-   
-   
-   
-
-   
-   
-   
-
-   
-
-
-   
-
-
-   
-   
-
-
-
-
-   
-   Files
-   
-  
-Name
-Errors
-  
-  
-
-   
-   
-  
-   
-   
-   
-   
-   
-   
-
-
-   
-
-File 
-
-
-   
- Error Description
- Line
-  
-
-  
-   
-
- 
- 
-   
-   
-
-Back to top
-   
-
-
-   
-   Summary
-
-   
-   
-   
-   Files
-   Errors
-   
-   
- 
-   
-   
-   
-   
-   
-
-  
-
-  a
-  b
-
-  
-
-
-

(hive) branch branch-2.3 updated: HIVE-27478: 2.3 Remove re2j, SQLLine, ClassNameCompleter entries from LICENSE file (#5150)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new c96445c10de HIVE-27478: 2.3 Remove re2j, SQLLine, ClassNameCompleter 
entries from LICENSE file (#5150)
c96445c10de is described below

commit c96445c10deb1e12f320ed90e72a93e14c22daf2
Author: Cheng Pan 
AuthorDate: Fri Mar 22 15:12:53 2024 +0800

HIVE-27478: 2.3 Remove re2j, SQLLine, ClassNameCompleter entries from 
LICENSE file (#5150)

Co-authored-by: Stamatis Zampetakis 
---
 LICENSE | 54 
 binary-package-licenses/com.google.re2j-LICENSE | 32 ++
 binary-package-licenses/sqlline-LICENSE | 55 +++--
 3 files changed, 56 insertions(+), 85 deletions(-)

diff --git a/LICENSE b/LICENSE
index aa88fe5eedc..a6e3fb35ca9 100644
--- a/LICENSE
+++ b/LICENSE
@@ -209,58 +209,6 @@ notices and license terms. Your use of the source code for 
the these
 subcomponents is subject to the terms and conditions of the following
 licenses.
 
-
-For the SQLLine package:
-
-Copyright (c) 2002, 2003, 2004, 2005 Marc Prud'hommeaux
-
-From: http://sqlline.sourceforge.net/#license
-
-"SQLLine is distributed under the BSD License, meaning that you are free to 
redistribute, modify, or sell the software with almost no restrictions."
-
-Statement from Marc Prud'hommeaux regarding inconsistent licenses in some 
SQLLine source files:
-
-> SQLLine was once GPL, but it was changed to be BSD a few years back.
-> Any references to the GPL are vestigial. Hopefully the license
-> declaration at http://sqlline.sourceforge.net/#license is sufficiently
-> authoritative in this regard.
-
-
-For the org.apache.hive.beeline.ClassNameCompleter class:
-
-Copyright (c) 2002-2006, Marc Prud'hommeaux 
-All rights reserved.
-
-Redistribution and use in source and binary forms, with or
-without modification, are permitted provided that the following
-conditions are met:
-
-Redistributions of source code must retain the above copyright
-notice, this list of conditions and the following disclaimer.
-
-Redistributions in binary form must reproduce the above copyright
-notice, this list of conditions and the following disclaimer
-in the documentation and/or other materials provided with
-the distribution.
-
-Neither the name of JLine nor the names of its contributors
-may be used to endorse or promote products derived from this
-software without specific prior written permission.
-
-THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
-"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING,
-BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY
-AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO
-EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE
-FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY,
-OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
-PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
-DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED
-AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
-LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING
-IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
-OF THE POSSIBILITY OF SUCH DAMAGE.
-
 For org.apache.hadoop.hive.llap.daemon.impl.PriorityBlockingDeque class:
 
 The BSD 3-Clause License
@@ -403,5 +351,3 @@ products or services of Licensee, or any third party.
 8. By copying, installing or otherwise using Python, Licensee
 agrees to be bound by the terms and conditions of this License
 Agreement.
-
-
diff --git a/binary-package-licenses/com.google.re2j-LICENSE 
b/binary-package-licenses/com.google.re2j-LICENSE
new file mode 100644
index 000..b620ae68fe3
--- /dev/null
+++ b/binary-package-licenses/com.google.re2j-LICENSE
@@ -0,0 +1,32 @@
+This is a work derived from Russ Cox's RE2 in Go, whose license
+http://golang.org/LICENSE is as follows:
+
+Copyright (c) 2009 The Go Authors. All rights reserved.
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are
+met:
+
+   * Redistributions of source code must retain the above copyright
+ notice, this list of conditions and the following disclaimer.
+
+   * Redistributions in binary form must reproduce the above copyright
+ notice, this list of conditions and the following disclaimer in
+ the documentation and/or other materials provided with the
+ distribution.
+
+   * Neither the name of Google Inc. nor the names of its contributors
+ may be used to endorse or promote products derived from this
+ software without specific prior written permission.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+"AS IS&q

(hive) branch branch-2.3 updated: HIVE-27468: (2.3) Restore original license in PriorityBlockingDeque (#5149)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 0d6a43ac1f2 HIVE-27468: (2.3) Restore original license in 
PriorityBlockingDeque (#5149)
0d6a43ac1f2 is described below

commit 0d6a43ac1f23995f7edfc9d01bc9c3f475cf2c86
Author: Cheng Pan 
AuthorDate: Fri Mar 22 15:12:18 2024 +0800

HIVE-27468: (2.3) Restore original license in PriorityBlockingDeque (#5149)
---
 .../llap/daemon/impl/PriorityBlockingDeque.java| 53 +++---
 pom.xml|  7 +--
 2 files changed, 40 insertions(+), 20 deletions(-)

diff --git 
a/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/PriorityBlockingDeque.java
 
b/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/PriorityBlockingDeque.java
index 3bf51cd7601..1e5f153bd2f 100644
--- 
a/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/PriorityBlockingDeque.java
+++ 
b/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/PriorityBlockingDeque.java
@@ -1,20 +1,3 @@
-/**
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License.  You may obtain a copy of the License at
- * 
- * http://www.apache.org/licenses/LICENSE-2.0
- * 
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
 package org.apache.hadoop.hive.llap.daemon.impl;
 
 import java.util.*;
@@ -23,6 +6,38 @@ import java.util.concurrent.TimeUnit;
 import java.util.concurrent.locks.Condition;
 import java.util.concurrent.locks.ReentrantLock;
 
+/*
+ * Copyright (c) 2007, Aviad Ben Dov
+ *
+ * All rights reserved.
+ *
+ * Redistribution and use in source and binary forms, with or without 
modification,
+ * are permitted provided that the following conditions are met:
+ *
+ * 1. Redistributions of source code must retain the above copyright notice, 
this list
+ * of conditions and the following disclaimer.
+ * 2. Redistributions in binary form must reproduce the above copyright 
notice, this
+ * list of conditions and the following disclaimer in the documentation and/or 
other
+ * materials provided with the distribution.
+ * 3. Neither the name of Infomancers, Ltd. nor the names of its contributors 
may be
+ * used to endorse or promote products derived from this software without 
specific
+ * prior written permission.
+ *
+ * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+ * "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+ * LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+ * A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER 
OR
+ * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
+ * EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
+ * PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
+ * PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
+ * LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+ * NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
+ * SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+ *
+ */
+
+
 /**
  * An optionally-bounded {@linkplain BlockingDeque blocking deque} based on
  * a navigable set.
@@ -36,6 +51,10 @@ import java.util.concurrent.locks.ReentrantLock;
  * Iterator} interfaces.
  * 
  * This code is loosely based on the {@linkplain 
java.util.concurrent.LinkedBlockingDeque linked blocking deque} code.
+ *
+ * @author Aviad Ben Dov
+ * @param  the type of elements held in this collection
+ * @since 0.3
  */
 public class PriorityBlockingDeque
 extends AbstractQueue
diff --git a/pom.xml b/pom.xml
index 8589825182a..52f9edccc3e 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1091,8 +1091,8 @@
bin/**
itests/**
docs/**
-**/README.md
-**/*.iml
+**/README.md
+**/*.iml
**/*.txt
**/*.log
**/*.arcconfig
@@ -1118,7 +1118,8 @@
**/xmlReport.pl
**/*.html
**/sit
-  **/test/queries/**/*.sql
+**/test/queries/**/*.sql
+**/PriorityBlockingDeque.java
  

   

(hive) branch branch-2.3 updated: HIVE-27467: (2.3) NOTICE files use incorrect wording "developed by" instead of "developed at" (#5148)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 85deb814d33 HIVE-27467: (2.3) NOTICE files use incorrect wording 
"developed by" instead of "developed at" (#5148)
85deb814d33 is described below

commit 85deb814d33f6adf30edb3c6560d3325c19b9f1c
Author: Cheng Pan 
AuthorDate: Fri Mar 22 15:11:17 2024 +0800

HIVE-27467: (2.3) NOTICE files use incorrect wording "developed by" instead 
of "developed at" (#5148)
---
 NOTICE | 8 +++-
 storage-api/NOTICE | 7 +++
 2 files changed, 6 insertions(+), 9 deletions(-)

diff --git a/NOTICE b/NOTICE
index d11eb98c6fe..ad316b92d83 100644
--- a/NOTICE
+++ b/NOTICE
@@ -1,7 +1,5 @@
 Apache Hive
-Copyright 2008-2020 The Apache Software Foundation
+Copyright 2008-2024 The Apache Software Foundation
 
-This product includes software developed by The Apache Software
-Foundation (http://www.apache.org/).
-
-This project includes software licensed under the JSON license.
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).
diff --git a/storage-api/NOTICE b/storage-api/NOTICE
index 0452bfeb116..2b848ac3876 100644
--- a/storage-api/NOTICE
+++ b/storage-api/NOTICE
@@ -1,6 +1,5 @@
 Apache Hive Storage API
+Copyright 2008-2024 The Apache Software Foundation
 
-Copyright 2008-2017 The Apache Software Foundation
-
-This product includes software developed by The Apache Software
-Foundation (http://www.apache.org/).
+This product includes software developed at
+The Apache Software Foundation (http://www.apache.org/).

(hive) branch branch-2.3 updated: HIVE-28104: (2.3) Move HTTP related methods from Utils to HttpUtils in shims (#5114)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 5ba87ba8bff HIVE-28104: (2.3) Move HTTP related methods from Utils to 
HttpUtils in shims (#5114)
5ba87ba8bff is described below

commit 5ba87ba8bffdd85e471a00dd7e56e52be51830cf
Author: Cheng Pan 
AuthorDate: Tue Mar 19 01:42:51 2024 +0800

HIVE-28104: (2.3) Move HTTP related methods from Utils to HttpUtils in 
shims (#5114)
---
 .../org/apache/hive/hcatalog/templeton/Main.java   |   8 +-
 .../hive/service/cli/thrift/ThriftHttpServlet.java |   4 +-
 .../org/apache/hadoop/hive/shims/HttpUtils.java| 139 +
 .../java/org/apache/hadoop/hive/shims/Utils.java   | 111 
 4 files changed, 145 insertions(+), 117 deletions(-)

diff --git 
a/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Main.java
 
b/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Main.java
index 5208bf4a4ca..3f0b0241f02 100644
--- 
a/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Main.java
+++ 
b/hcatalog/webhcat/svr/src/main/java/org/apache/hive/hcatalog/templeton/Main.java
@@ -34,7 +34,7 @@ import org.apache.commons.lang3.ArrayUtils;
 import org.apache.hadoop.hive.common.classification.InterfaceAudience;
 import org.apache.hadoop.hive.common.classification.InterfaceStability;
 import org.apache.hadoop.hdfs.web.AuthFilter;
-import org.apache.hadoop.hive.shims.Utils;
+import org.apache.hadoop.hive.shims.HttpUtils;
 import org.apache.hadoop.security.UserGroupInformation;
 import org.apache.hadoop.security.authentication.client.PseudoAuthenticator;
 import 
org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler;
@@ -235,12 +235,12 @@ public class Main {
   public FilterHolder makeXSRFFilter() {
 String customHeader = null; // The header to look for. We use 
"X-XSRF-HEADER" if this is null.
 String methodsToIgnore = null; // Methods to not filter. By default: 
"GET,OPTIONS,HEAD,TRACE" if null.
-FilterHolder fHolder = new FilterHolder(Utils.getXSRFFilter());
+FilterHolder fHolder = new FilterHolder(HttpUtils.getXSRFFilter());
 if (customHeader != null){
-  fHolder.setInitParameter(Utils.XSRF_CUSTOM_HEADER_PARAM, customHeader);
+  fHolder.setInitParameter(HttpUtils.XSRF_CUSTOM_HEADER_PARAM, 
customHeader);
 }
 if (methodsToIgnore != null){
-  fHolder.setInitParameter(Utils.XSRF_CUSTOM_METHODS_TO_IGNORE_PARAM, 
methodsToIgnore);
+  fHolder.setInitParameter(HttpUtils.XSRF_CUSTOM_METHODS_TO_IGNORE_PARAM, 
methodsToIgnore);
 }
 FilterHolder xsrfFilter = fHolder;
 
diff --git 
a/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java 
b/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java
index fbe6da40201..cca0e81caae 100644
--- a/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java
+++ b/service/src/java/org/apache/hive/service/cli/thrift/ThriftHttpServlet.java
@@ -41,8 +41,8 @@ import org.apache.commons.codec.binary.StringUtils;
 import org.apache.hadoop.hive.conf.HiveConf;
 import org.apache.hadoop.hive.conf.HiveConf.ConfVars;
 import org.apache.hadoop.hive.shims.HadoopShims.KerberosNameShim;
+import org.apache.hadoop.hive.shims.HttpUtils;
 import org.apache.hadoop.hive.shims.ShimLoader;
-import org.apache.hadoop.hive.shims.Utils;
 import org.apache.hadoop.security.UserGroupInformation;
 import 
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator;
 import org.apache.hive.service.CookieSigner;
@@ -130,7 +130,7 @@ public class ThriftHttpServlet extends TServlet {
 
 try {
   if 
(hiveConf.getBoolean(ConfVars.HIVE_SERVER2_XSRF_FILTER_ENABLED.varname,false)){
-boolean continueProcessing = 
Utils.doXsrfFilter(request,response,null,null);
+boolean continueProcessing = 
HttpUtils.doXsrfFilter(request,response,null,null);
 if (!continueProcessing){
   LOG.warn("Request did not have valid XSRF header, rejecting.");
   return;
diff --git 
a/shims/common/src/main/java/org/apache/hadoop/hive/shims/HttpUtils.java 
b/shims/common/src/main/java/org/apache/hadoop/hive/shims/HttpUtils.java
new file mode 100644
index 000..7bf6fba7dfe
--- /dev/null
+++ b/shims/common/src/main/java/org/apache/hadoop/hive/shims/HttpUtils.java
@@ -0,0 +1,139 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a

(hive) branch branch-2.3 updated: HIVE-18586: (2.3) Upgrade Derby to 10.14.1.0 (#5113)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 63e2194281b HIVE-18586: (2.3) Upgrade Derby to 10.14.1.0 (#5113)
63e2194281b is described below

commit 63e2194281bd7d769e9b039431563d68436455a7
Author: Cheng Pan 
AuthorDate: Tue Mar 5 01:39:26 2024 +0800

HIVE-18586: (2.3) Upgrade Derby to 10.14.1.0 (#5113)
---
 .../java/org/apache/hive/hcatalog/DerbyPolicy.java | 90 ++
 .../java/org/apache/hive/hcatalog/DerbyPolicy.java | 90 ++
 .../org/apache/hive/hcatalog/cli/TestPermsGrp.java |  3 +
 .../mapreduce/TestHCatPartitionPublish.java|  3 +
 .../org/apache/hive/hcatalog/package-info.java | 22 ++
 .../apache/hive/hcatalog/api/TestHCatClient.java   |  4 +
 .../metastore/TestHiveMetaStoreGetMetaConf.java| 25 --
 .../metastore/TestHiveMetaStorePartitionSpecs.java | 26 ---
 8 files changed, 212 insertions(+), 51 deletions(-)

diff --git a/core/src/test/java/org/apache/hive/hcatalog/DerbyPolicy.java 
b/core/src/test/java/org/apache/hive/hcatalog/DerbyPolicy.java
new file mode 100644
index 000..cecf6dc676f
--- /dev/null
+++ b/core/src/test/java/org/apache/hive/hcatalog/DerbyPolicy.java
@@ -0,0 +1,90 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hive.hcatalog;
+
+import org.apache.derby.security.SystemPermission;
+
+import java.security.CodeSource;
+import java.security.Permission;
+import java.security.PermissionCollection;
+import java.security.Policy;
+import java.util.ArrayList;
+import java.util.Collections;
+import java.util.Enumeration;
+import java.util.Iterator;
+
+/**
+ * A security policy that grants usederbyinternals
+ *
+ * 
+ *   HCatalog tests use Security Manager to handle exits.  With Derby version 
10.14.1, if a
+ *   security manager is configured, embedded Derby requires usederbyinternals 
permission, and
+ *   that is checked directly using AccessController.checkPermission.  This 
class will be used to
+ *   setup a security policy to grant usederbyinternals, in tests that use 
NoExitSecurityManager.
+ * 
+ */
+public class DerbyPolicy extends Policy {
+
+  private static PermissionCollection perms;
+
+  public DerbyPolicy() {
+super();
+if (perms == null) {
+  perms = new DerbyPermissionCollection();
+  addPermissions();
+}
+  }
+
+  @Override
+  public PermissionCollection getPermissions(CodeSource codesource) {
+return perms;
+  }
+
+  private void addPermissions() {
+SystemPermission systemPermission = new SystemPermission("engine", 
"usederbyinternals");
+perms.add(systemPermission);
+  }
+
+  class DerbyPermissionCollection extends PermissionCollection {
+
+ArrayList perms = new ArrayList();
+
+public void add(Permission p) {
+  perms.add(p);
+}
+
+public boolean implies(Permission p) {
+  for (Iterator i = perms.iterator(); i.hasNext();) {
+if (((Permission) i.next()).implies(p)) {
+  return true;
+}
+  }
+  return false;
+}
+
+public Enumeration elements() {
+  return Collections.enumeration(perms);
+}
+
+public boolean isReadOnly() {
+  return false;
+}
+  }
+}
+
diff --git 
a/hcatalog/core/src/test/java/org/apache/hive/hcatalog/DerbyPolicy.java 
b/hcatalog/core/src/test/java/org/apache/hive/hcatalog/DerbyPolicy.java
new file mode 100644
index 000..cecf6dc676f
--- /dev/null
+++ b/hcatalog/core/src/test/java/org/apache/hive/hcatalog/DerbyPolicy.java
@@ -0,0 +1,90 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+

(hive) branch master updated: HIVE-27951: hcatalog dynamic partitioning fails with partition already exist error when exist parent partitions path (#4937)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 96d46dc36cf HIVE-27951: hcatalog dynamic partitioning fails with 
partition already exist error when exist parent partitions path (#4937)
96d46dc36cf is described below

commit 96d46dc36cfd3a68c73f8c77e1f97c1c78507b24
Author: yigress <104102129+yigr...@users.noreply.github.com>
AuthorDate: Wed Jan 3 17:03:59 2024 -0800

HIVE-27951: hcatalog dynamic partitioning fails with partition already 
exist error when exist parent partitions path (#4937)
---
 .../mapreduce/FileOutputCommitterContainer.java| 37 ++
 .../mapreduce/TestHCatDynamicPartitioned.java  | 17 ++
 .../TestHCatExternalDynamicPartitioned.java|  4 +--
 3 files changed, 37 insertions(+), 21 deletions(-)

diff --git 
a/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
 
b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
index de9ad252ff2..2ad306165d1 100644
--- 
a/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
+++ 
b/hcatalog/core/src/main/java/org/apache/hive/hcatalog/mapreduce/FileOutputCommitterContainer.java
@@ -488,7 +488,7 @@ class FileOutputCommitterContainer extends 
OutputCommitterContainer {
   }
 
   /**
-   * Move all of the files from the temp directory to the final location
+   * Move task output from the temp directory to the final location
* @param srcf the file to move
* @param srcDir the source directory
* @param destDir the target directory
@@ -538,17 +538,17 @@ class FileOutputCommitterContainer extends 
OutputCommitterContainer {
 final Path finalOutputPath = getFinalPath(destFs, srcF, srcDir, 
destDir, immutable);
 if (immutable && destFs.exists(finalOutputPath) &&
 
!org.apache.hadoop.hive.metastore.utils.FileUtils.isDirEmpty(destFs, 
finalOutputPath)) {
-  throw new HCatException(ErrorType.ERROR_DUPLICATE_PARTITION,
-  "Data already exists in " + finalOutputPath
-  + ", duplicate publish not possible.");
-}
-if (srcStatus.isDirectory()) {
+  if (partitionsDiscoveredByPath.containsKey(srcF.toString())) {
+throw new HCatException(ErrorType.ERROR_DUPLICATE_PARTITION,
+"Data already exists in " + finalOutputPath
++ ", duplicate publish not possible.");
+  }
+  // parent directory may exist for multi-partitions, check lower 
level partitions
+  Collections.addAll(srcQ, 
srcFs.listStatus(srcF,HIDDEN_FILES_PATH_FILTER));
+} else if (srcStatus.isDirectory()) {
   if (canRename && dynamicPartitioningUsed) {
 // If it is partition, move the partition directory instead of 
each file.
-// If custom dynamic location provided, need to rename to final 
output path
-final Path parentDir = finalOutputPath.getParent();
-Path dstPath = !customDynamicLocationUsed ? parentDir : 
finalOutputPath;
-moves.add(Pair.of(srcF, dstPath));
+moves.add(Pair.of(srcF, finalOutputPath));
   } else {
 Collections.addAll(srcQ, srcFs.listStatus(srcF, 
HIDDEN_FILES_PATH_FILTER));
   }
@@ -558,16 +558,27 @@ class FileOutputCommitterContainer extends 
OutputCommitterContainer {
   }
 }
 
-if (moves.isEmpty()) {
+bulkMoveFiles(conf, srcFs, destFs, moves);
+  }
+
+  /**
+   * Bulk move files from source to destination.
+   * @param srcFs the source filesystem where the source files are
+   * @param destFs the destionation filesystem where the destionation files are
+   * @param pairs list of pairs of , move 
source_path to destination_path
+   * @throws java.io.IOException
+   */
+  private void bulkMoveFiles(final Configuration conf, final FileSystem srcFs, 
final FileSystem destFs, List> pairs) throws IOException{
+if (pairs.isEmpty()) {
   return;
 }
-
+final boolean canRename = srcFs.getUri().equals(destFs.getUri());
 final List>> futures = new LinkedList<>();
 final ExecutorService pool = 
conf.getInt(ConfVars.HIVE_MOVE_FILES_THREAD_COUNT.varname, 25) > 0 ?
 
Executors.newFixedThreadPool(conf.getInt(ConfVars.HIVE_MOVE_FILES_THREAD_COUNT.varname,
 25),
 new 
ThreadFactoryBuilder().setDaemon(true).setNameFormat("Move-Thread-%d").build()) 
: null;
 
-for (final Pair pair: moves){
+for (final Pair pair: pairs){
   Path srcP = pair.getLeft();
   Path dstP = pair.getRight();
   final String msg = "Unable to move source " + srcP + " to destination " 
+ 

(hive) branch branch-2.3 updated: HIVE-27817: Disable ssl hostname verification for 127.0.0.1 (#4823) (#4865)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new c1bfbd0f2cf HIVE-27817: Disable ssl hostname verification for 
127.0.0.1 (#4823) (#4865)
c1bfbd0f2cf is described below

commit c1bfbd0f2cf3a52796601e376fa37e09a6fe6556
Author: Yuming Wang 
AuthorDate: Fri Nov 24 00:08:26 2023 +0800

HIVE-27817: Disable ssl hostname verification for 127.0.0.1 (#4823) (#4865)

(cherry picked from commit 2eef89b5b6f350c2c9a72499c3253760df20a328)
---
 .../src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java  | 6 +-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git 
a/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java 
b/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java
index e12f2458712..632980e7cd8 100644
--- a/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java
+++ b/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java
@@ -71,7 +71,11 @@ public class HiveAuthUtils {
   private static TSocket getSSLSocketWithHttps(TSocket tSSLSocket) throws 
TTransportException {
 SSLSocket sslSocket = (SSLSocket) tSSLSocket.getSocket();
 SSLParameters sslParams = sslSocket.getSSLParameters();
-sslParams.setEndpointIdentificationAlgorithm("HTTPS");
+if (sslSocket.getLocalAddress().getHostAddress().equals("127.0.0.1")) {
+  sslParams.setEndpointIdentificationAlgorithm(null);
+} else {
+  sslParams.setEndpointIdentificationAlgorithm("HTTPS");
+}
 sslSocket.setSSLParameters(sslParams);
 return new TSocket(sslSocket);
   }

(hive) branch branch-2.3 updated: HIVE-26173: (2.3) Upgrade derby to 10.14.2.0 (#4895)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new db4d210e39b HIVE-26173: (2.3) Upgrade derby to 10.14.2.0 (#4895)
db4d210e39b is described below

commit db4d210e39b3f1073484e85304f0c52bcbc65d26
Author: Cheng Pan 
AuthorDate: Thu Nov 23 23:17:34 2023 +0800

HIVE-26173: (2.3) Upgrade derby to 10.14.2.0 (#4895)
---
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/pom.xml b/pom.xml
index 40b1dad77e5..8589825182a 100644
--- a/pom.xml
+++ b/pom.xml
@@ -129,7 +129,7 @@
 3.1
 1.5.4
 1.4
-10.10.2.0
+10.14.2.0
 3.1.0
 
0.1.2
 0.9.2

(hive) branch master updated: HIVE-27817: Disable ssl hostname verification for 127.0.0.1 (#4823)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 2eef89b5b6f HIVE-27817: Disable ssl hostname verification for 
127.0.0.1 (#4823)
2eef89b5b6f is described below

commit 2eef89b5b6f350c2c9a72499c3253760df20a328
Author: Yuming Wang 
AuthorDate: Thu Nov 9 00:10:04 2023 +0800

HIVE-27817: Disable ssl hostname verification for 127.0.0.1 (#4823)
---
 .../src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java  | 6 +-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git 
a/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java 
b/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java
index a37d527c1ea..68163afa42b 100644
--- a/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java
+++ b/common/src/java/org/apache/hadoop/hive/common/auth/HiveAuthUtils.java
@@ -142,7 +142,11 @@ public class HiveAuthUtils {
   throws TTransportException {
 SSLSocket sslSocket = (SSLSocket) tSSLSocket.getSocket();
 SSLParameters sslParams = sslSocket.getSSLParameters();
-sslParams.setEndpointIdentificationAlgorithm("HTTPS");
+if (sslSocket.getLocalAddress().getHostAddress().equals("127.0.0.1")) {
+  sslParams.setEndpointIdentificationAlgorithm(null);
+} else {
+  sslParams.setEndpointIdentificationAlgorithm("HTTPS");
+}
 sslSocket.setSSLParameters(sslParams);
 TSocket tSocket = new TSocket(sslSocket);
 return configureThriftMaxMessageSize(tSocket, maxMessageSize);

[hive] branch branch-2.3 updated: HIVE-27815: Support update numModifiedRows (#4819)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new dc41acdd7cb HIVE-27815: Support update numModifiedRows (#4819)
dc41acdd7cb is described below

commit dc41acdd7cb5c76fbd6d208d4375407670579314
Author: Yuming Wang 
AuthorDate: Thu Oct 26 11:01:16 2023 +0800

HIVE-27815: Support update numModifiedRows (#4819)
---
 .../java/org/apache/hive/jdbc/HiveStatement.java   | 22 +-
 1 file changed, 17 insertions(+), 5 deletions(-)

diff --git a/jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java 
b/jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java
index 4c985173f55..1a75f7c0199 100644
--- a/jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java
+++ b/jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java
@@ -358,7 +358,7 @@ public class HiveStatement implements java.sql.Statement {
 TGetOperationStatusResp statusResp = null;
 
 // Poll on the operation status, till the operation is complete
-while (!isOperationComplete) {
+do {
   try {
 /**
  * For an async SQLOperation, GetOperationStatus will use the long 
polling approach It will
@@ -398,7 +398,7 @@ public class HiveStatement implements java.sql.Statement {
 isLogBeingGenerated = false;
 throw new SQLException(e.toString(), "08S01", e);
   }
-}
+} while (!isOperationComplete);
 
 /*
   we set progress bar to be completed when hive query execution has 
completed
@@ -488,7 +488,7 @@ public class HiveStatement implements java.sql.Statement {
   @Override
   public int executeUpdate(String sql) throws SQLException {
 execute(sql);
-return 0;
+return getUpdateCount();
   }
 
   /*
@@ -687,8 +687,20 @@ public class HiveStatement implements java.sql.Statement {
  * client might end up using executeAsync and then call this to check if 
the query run is
  * finished.
  */
-waitForOperationToComplete();
-return -1;
+long numModifiedRows = -1L;
+TGetOperationStatusResp resp = waitForOperationToComplete();
+if (resp != null) {
+  try {
+numModifiedRows =
+(long) 
resp.getClass().getDeclaredMethod("getNumModifiedRows").invoke(resp);
+  } catch (Exception ignored) {
+  }
+}
+if (numModifiedRows == -1L || numModifiedRows > Integer.MAX_VALUE) {
+  LOG.warn("Invalid number of updated rows: {}", numModifiedRows);
+  return -1;
+}
+return (int) numModifiedRows;
   }
 
   /*

[hive] branch master updated: HIVE-27659: Make partition order configurable if the metastore does not return all partitions (#4646)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 920f9e535db HIVE-27659: Make partition order configurable if the 
metastore does not return all partitions (#4646)
920f9e535db is described below

commit 920f9e535db6270a401db274eef3267d70c1fd2f
Author: Yuming Wang 
AuthorDate: Wed Sep 6 00:56:59 2023 +0800

HIVE-27659: Make partition order configurable if the metastore does not 
return all partitions (#4646)
---
 .../apache/hadoop/hive/ql/metadata/TestHive.java   | 56 ++
 .../hadoop/hive/metastore/conf/MetastoreConf.java  |  5 ++
 .../hadoop/hive/metastore/MetaStoreDirectSql.java  |  2 +-
 3 files changed, 62 insertions(+), 1 deletion(-)

diff --git a/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java 
b/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java
index df3ecf6f662..33171ebb0cb 100755
--- a/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java
+++ b/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java
@@ -849,6 +849,62 @@ public class TestHive {
 }
   }
 
+  @Test
+  public void testGetPartitionsWithMaxLimit() throws Exception {
+String dbName = Warehouse.DEFAULT_DATABASE_NAME;
+String tableName = "table_for_get_partitions_with_max_limit";
+
+try {
+  Map part_spec = new HashMap();
+
+  Table table = createPartitionedTable(dbName, tableName);
+  part_spec.clear();
+  part_spec.put("ds", "2025-06-30");
+  part_spec.put("hr", "11");
+  hm.createPartition(table, part_spec);
+
+  Thread.sleep(1);
+  part_spec.clear();
+  part_spec.put("ds", "2023-04-15");
+  part_spec.put("hr", "12");
+  hm.createPartition(table, part_spec);
+
+  Thread.sleep(1);
+  part_spec.clear();
+  part_spec.put("ds", "2023-09-01");
+  part_spec.put("hr", "10");
+  hm.createPartition(table, part_spec);
+
+  // Default
+  Assert.assertEquals(
+  ((List) hm.getPartitions(table, new HashMap(), (short) 
1)).get(0).getTPartition().getValues(),
+  Arrays.asList("2023-04-15", "12"));
+
+  // Sort by "PARTITIONS"."CREATE_TIME" desc
+  hm.setMetaConf(MetastoreConf.ConfVars.PARTITION_ORDER_EXPR.getVarname(), 
"\"PARTITIONS\".\"CREATE_TIME\" desc");
+  Assert.assertEquals(
+  ((List) hm.getPartitions(table, new HashMap(), (short) 
1)).get(0).getTPartition().getValues(),
+  Arrays.asList("2023-09-01", "10"));
+
+  // Sort by "PART_NAME" desc
+  hm.setMetaConf(MetastoreConf.ConfVars.PARTITION_ORDER_EXPR.getVarname(), 
"\"PART_NAME\" desc");
+  Assert.assertEquals(
+  ((List) hm.getPartitions(table, new HashMap(), (short) 
1)).get(0).getTPartition().getValues(),
+  Arrays.asList("2025-06-30", "11"));
+
+  // Test MetaStoreClient
+  Assert.assertEquals(
+  hm.getMSC().listPartitions(table.getDbName(), table.getTableName(), 
(short) 1).get(0).getValues(),
+  Arrays.asList("2025-06-30", "11"));
+} catch (Exception e) {
+  fail("Unexpected exception: " + StringUtils.stringifyException(e));
+} finally {
+  hm.setMetaConf(MetastoreConf.ConfVars.PARTITION_ORDER_EXPR.getVarname(),
+ 
MetastoreConf.ConfVars.PARTITION_ORDER_EXPR.getDefaultVal().toString());
+  cleanUpTableQuietly(dbName, tableName);
+}
+  }
+
   private void checkPartitionsConsistency(Table tbl) throws Exception {
 Set allParts = hm.getAllPartitionsOf(tbl);
 List allParts2 = hm.getPartitions(tbl);
diff --git 
a/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java
 
b/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java
index 323d953be12..6f597a1739d 100644
--- 
a/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java
+++ 
b/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java
@@ -251,6 +251,7 @@ public class MetastoreConf {
   ConfVars.TRY_DIRECT_SQL_DDL,
   ConfVars.CLIENT_SOCKET_TIMEOUT,
   ConfVars.PARTITION_NAME_WHITELIST_PATTERN,
+  ConfVars.PARTITION_ORDER_EXPR,
   ConfVars.CAPABILITY_CHECK,
   ConfVars.DISALLOW_INCOMPATIBLE_COL_TYPE_CHANGES,
   ConfVars.EXPRESSION_PROXY_CLASS
@@ -1266,6 +1267,10 @@ public class MetastoreConf {
 
PARTITION_NAME_WHITELIST_PATTERN("metastore.partition.name.whitelist.pattern",
 "hive.metastore.partition.name

[hive] branch branch-2.3 updated: HIVE-27580: Backport HIVE-20071: Migrate to jackson 2.x and prevent usage (#4564)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new d9e96c96a09 HIVE-27580: Backport HIVE-20071: Migrate to jackson 2.x 
and prevent usage (#4564)
d9e96c96a09 is described below

commit d9e96c96a09398d79d9f866b914d994403f4928a
Author: Yuming Wang 
AuthorDate: Wed Aug 30 23:38:28 2023 +0800

HIVE-27580: Backport HIVE-20071: Migrate to jackson 2.x and prevent usage 
(#4564)

* HIVE-20071: Migrate to jackson 2.x and prevent usage (#2464) (Zoltan 
Haindrich reviewed by Krisztian Kasa)

* HIVE-22059: hive-exec jar doesn't contain (fasterxml) jackson library

-

Co-authored-by: Zoltan Haindrich 
---
 .../hadoop/hive/common/jsonexplain/tez/Vertex.java | 23 +++--
 .../java/org/apache/hive/http/JMXJsonServlet.java  | 29 +++---
 .../org/apache/hive/hcatalog/data/JsonSerDe.java   | 10 +---
 .../messaging/json/JSONAddPartitionMessage.java|  2 +-
 .../messaging/json/JSONAlterIndexMessage.java  |  2 +-
 .../messaging/json/JSONAlterPartitionMessage.java  |  2 +-
 .../messaging/json/JSONAlterTableMessage.java  |  2 +-
 .../messaging/json/JSONCreateDatabaseMessage.java  |  2 +-
 .../messaging/json/JSONCreateFunctionMessage.java  |  2 +-
 .../messaging/json/JSONCreateIndexMessage.java |  2 +-
 .../messaging/json/JSONCreateTableMessage.java |  2 +-
 .../messaging/json/JSONDropDatabaseMessage.java|  2 +-
 .../messaging/json/JSONDropFunctionMessage.java|  2 +-
 .../messaging/json/JSONDropIndexMessage.java   |  2 +-
 .../messaging/json/JSONDropPartitionMessage.java   |  2 +-
 .../messaging/json/JSONDropTableMessage.java   |  2 +-
 .../hcatalog/messaging/json/JSONInsertMessage.java |  2 +-
 .../messaging/json/JSONMessageDeserializer.java|  7 +++---
 .../hive/hcatalog/templeton/JsonBuilder.java   | 12 ++---
 .../hcatalog/templeton/SimpleWebException.java |  5 ++--
 .../apache/hive/hcatalog/templeton/TestDesc.java   |  2 +-
 .../hive/hcatalog/templeton/TestWebHCatE2e.java|  7 +++---
 .../hive/llap/cli/LlapStatusServiceDriver.java | 14 +--
 .../llap/daemon/services/impl/LlapWebServices.java |  7 +++---
 .../hive/metastore/messaging/PartitionFiles.java   |  2 +-
 .../messaging/json/JSONAddPartitionMessage.java|  2 +-
 .../messaging/json/JSONAlterIndexMessage.java  |  2 +-
 .../messaging/json/JSONAlterPartitionMessage.java  |  2 +-
 .../messaging/json/JSONAlterTableMessage.java  |  2 +-
 .../messaging/json/JSONCreateDatabaseMessage.java  |  2 +-
 .../messaging/json/JSONCreateFunctionMessage.java  |  2 +-
 .../messaging/json/JSONCreateIndexMessage.java |  2 +-
 .../messaging/json/JSONCreateTableMessage.java |  2 +-
 .../messaging/json/JSONDropDatabaseMessage.java|  2 +-
 .../messaging/json/JSONDropFunctionMessage.java|  2 +-
 .../messaging/json/JSONDropIndexMessage.java   |  2 +-
 .../messaging/json/JSONDropPartitionMessage.java   |  2 +-
 .../messaging/json/JSONDropTableMessage.java   |  2 +-
 .../messaging/json/JSONInsertMessage.java  |  2 +-
 .../messaging/json/JSONMessageDeserializer.java| 15 +--
 .../messaging/json/JSONMessageFactory.java | 10 
 .../json/JSONMessageDeserializerTest.java  |  2 +-
 ql/pom.xml | 19 ++
 .../org/apache/hadoop/hive/ql/QueryDisplay.java| 11 +---
 .../metadata/formatting/JsonMetaDataFormatter.java |  2 +-
 .../org/apache/hadoop/hive/ql/parse/EximUtil.java  |  4 +--
 .../org/apache/hadoop/hive/ql/udf/UDFJson.java | 26 +--
 .../hive/ql/udf/generic/GenericUDTFJSONTuple.java  | 20 +++
 .../hadoop/hive/serde2/avro/TypeInfoToSchema.java  |  2 --
 .../hive/service/cli/operation/SQLOperation.java   |  6 ++---
 .../apache/hive/service/cli/CLIServiceTest.java|  4 +--
 51 files changed, 155 insertions(+), 140 deletions(-)

diff --git 
a/common/src/java/org/apache/hadoop/hive/common/jsonexplain/tez/Vertex.java 
b/common/src/java/org/apache/hadoop/hive/common/jsonexplain/tez/Vertex.java
index 3d559bdcf0e..bd9b18a66e7 100644
--- a/common/src/java/org/apache/hadoop/hive/common/jsonexplain/tez/Vertex.java
+++ b/common/src/java/org/apache/hadoop/hive/common/jsonexplain/tez/Vertex.java
@@ -18,19 +18,13 @@
 
 package org.apache.hadoop.hive.common.jsonexplain.tez;
 
-import java.io.IOException;
 import java.util.ArrayList;
-import java.util.HashSet;
 import java.util.LinkedHashMap;
 import java.util.List;
 import java.util.Map;
-import java.util.Set;
 import java.util.TreeMap;
 
 import org.apache.hadoop.hive.common.jsonexplain.tez.Op.OpType;
-import org.apache.hadoop.util.hash.Hash;
-import org.codehaus.jackson.JsonParseException;
-import org.codehaus.jackson.map.JsonMappingException;
 i

[hive] branch branch-2.3 updated: HIVE-27560: [2.3] Enhancing compatibility with Guava (#4542)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 9c2aee41717 HIVE-27560: [2.3] Enhancing compatibility with Guava 
(#4542)
9c2aee41717 is described below

commit 9c2aee41717968a7a54f7de4b3670922771175e9
Author: YangJie 
AuthorDate: Thu Aug 17 14:00:22 2023 +0800

HIVE-27560: [2.3] Enhancing compatibility with Guava (#4542)
---
 .../apache/hadoop/hive/common/JvmMetricsInfo.java  |   4 +-
 .../apache/hadoop/hive/common/JvmPauseMonitor.java |   2 +-
 .../java/org/apache/hive/common/guava/Objects.java | 431 +
 .../hive/common/guava/SameThreadExecutorUtil.java  | 207 ++
 .../org/apache/hive/common/guava/Stopwatch.java| 254 
 .../hadoop/hive/io/TestHadoopFileStatus.java   |   4 +
 .../org/apache/hive/jdbc/TestServiceDiscovery.java |   4 +
 .../hadoop/hive/cli/control/CoreCliDriver.java |   2 +-
 .../SQLStdHiveAuthorizationValidatorForTest.java   |   4 +
 .../hive/util/ElapsedTimeLoggingWrapper.java   |   3 +-
 .../hive/llap/tez/LlapProtocolClientProxy.java |   9 +-
 .../hadoop/hive/llap/daemon/impl/AMReporter.java   |   9 +-
 .../hive/llap/daemon/impl/LlapTaskReporter.java|   4 +-
 .../hive/llap/daemon/impl/TaskExecutorService.java |   4 +-
 .../hive/llap/daemon/impl/TaskRunnerCallable.java  |   2 +-
 .../hive/llap/metrics/LlapDaemonCacheInfo.java |   2 +-
 .../hive/llap/metrics/LlapDaemonExecutorInfo.java  |   2 +-
 .../hadoop/hive/llap/metrics/LlapDaemonIOInfo.java |   2 +-
 .../hive/llap/metrics/LlapDaemonJvmInfo.java   |   2 +-
 .../llap/tezplugins/LlapTaskSchedulerService.java  |  13 +-
 .../tezplugins/metrics/LlapTaskSchedulerInfo.java  |   2 +-
 .../metastore/hbase/TephraHBaseConnection.java |  23 +-
 ql/pom.xml |   8 -
 .../apache/hadoop/hive/ql/exec/FetchOperator.java  |   7 +-
 .../apache/hadoop/hive/ql/hooks/LineageLogger.java |   5 +-
 .../hive/ql/metadata/HiveMetaStoreChecker.java |   5 +-
 .../calcite/rules/views/SubstitutionVisitor.java   |   4 +
 .../calcite/stats/HiveRelMdPredicates.java |   5 +-
 .../hadoop/hive/ql/parse/ReplicationSpec.java  |   4 +
 .../hive/service/cli/session/SessionManager.java   |   4 +
 .../java/org/apache/hadoop/hive/io/HdfsUtils.java  |   4 +
 .../hive/spark/client/MetricsCollection.java   |  12 +
 32 files changed, 1010 insertions(+), 37 deletions(-)

diff --git a/common/src/java/org/apache/hadoop/hive/common/JvmMetricsInfo.java 
b/common/src/java/org/apache/hadoop/hive/common/JvmMetricsInfo.java
index 3ab73c5bdec..9d076f75008 100644
--- a/common/src/java/org/apache/hadoop/hive/common/JvmMetricsInfo.java
+++ b/common/src/java/org/apache/hadoop/hive/common/JvmMetricsInfo.java
@@ -18,10 +18,10 @@
 
 package org.apache.hadoop.hive.common;
 
-import com.google.common.base.Objects;
-
 import org.apache.hadoop.metrics2.MetricsInfo;
 
+import org.apache.hive.common.guava.Objects;
+
 /**
  * JVM and logging related metrics info instances. Ported from Hadoop 
JvmMetricsInfo.
  */
diff --git a/common/src/java/org/apache/hadoop/hive/common/JvmPauseMonitor.java 
b/common/src/java/org/apache/hadoop/hive/common/JvmPauseMonitor.java
index cf080e3fbe7..63b245781b0 100644
--- a/common/src/java/org/apache/hadoop/hive/common/JvmPauseMonitor.java
+++ b/common/src/java/org/apache/hadoop/hive/common/JvmPauseMonitor.java
@@ -19,7 +19,6 @@ package org.apache.hadoop.hive.common;
 
 import com.google.common.base.Joiner;
 import com.google.common.base.Preconditions;
-import com.google.common.base.Stopwatch;
 import com.google.common.collect.Lists;
 import com.google.common.collect.Maps;
 import com.google.common.collect.Sets;
@@ -29,6 +28,7 @@ import org.apache.hadoop.hive.common.metrics.common.Metrics;
 import org.apache.hadoop.hive.common.metrics.common.MetricsConstant;
 import org.apache.hadoop.hive.common.metrics.common.MetricsFactory;
 import org.apache.hadoop.util.Daemon;
+import org.apache.hive.common.guava.Stopwatch;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
diff --git a/common/src/java/org/apache/hive/common/guava/Objects.java 
b/common/src/java/org/apache/hive/common/guava/Objects.java
new file mode 100644
index 000..73c07cbf405
--- /dev/null
+++ b/common/src/java/org/apache/hive/common/guava/Objects.java
@@ -0,0 +1,431 @@
+/*
+ * Copyright (C) 2007 The Guava Authors
+ *
+ * Licensed under the Apache License, Version 2.0 (the "License");
+ * you may not use this file except in compliance with the License.
+ * You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIN

[hive] branch branch-2.3 updated: HIVE-27581: Upgrade jackson from 2.9.4 to 2.12.0 (#4563)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 2469d9e7d9f HIVE-27581: Upgrade jackson  from 2.9.4 to 2.12.0 (#4563)
2469d9e7d9f is described below

commit 2469d9e7d9ffa66f1d213539bd42243125ba930c
Author: Yuming Wang 
AuthorDate: Fri Aug 11 01:13:17 2023 +0800

HIVE-27581: Upgrade jackson  from 2.9.4 to 2.12.0 (#4563)
---
 pom.xml  | 38 +-
 testutils/ptest2/pom.xml | 12 
 2 files changed, 13 insertions(+), 37 deletions(-)

diff --git a/pom.xml b/pom.xml
index db8d367fffe..40b1dad77e5 100644
--- a/pom.xml
+++ b/pom.xml
@@ -148,7 +148,7 @@
 4.4
 4.4
 2.4.0
-2.9.4
+2.12.0
 5.5.23
 2.3.4
 2.3.1
@@ -553,39 +553,11 @@
 ${groovy.version}
   
   
-com.fasterxml.jackson.core
-jackson-annotations
-${jackson.version}
-  
-  
-com.fasterxml.jackson.core
-jackson-core
-${jackson.version}
-  
-  
-com.fasterxml.jackson.core
-jackson-databind
-${jackson.version}
-  
-  
-com.fasterxml.jackson.module
-jackson-module-scala_${scala.binary.version}
-${jackson.version}
-  
-  
-com.fasterxml.jackson.dataformat
-jackson-dataformat-smile
-${jackson.version}
-  
-  
-com.fasterxml.jackson.jaxrs
-jackson-jaxrs-json-provider
-${jackson.version}
-  
-  
-com.fasterxml.jackson.module
-jackson-module-jaxb-annotations
+com.fasterxml.jackson
+jackson-bom
 ${jackson.version}
+pom
+import
   
   
 org.codehaus.janino
diff --git a/testutils/ptest2/pom.xml b/testutils/ptest2/pom.xml
index c2b460bce4d..e91d5e2b41f 100644
--- a/testutils/ptest2/pom.xml
+++ b/testutils/ptest2/pom.xml
@@ -29,7 +29,7 @@ limitations under the License.
 2.17.0
 3.2.16.RELEASE
 2.0.0
-2.9.4
+2.12.0
   
 
   
@@ -113,20 +113,24 @@ limitations under the License.
   velocity
   1.7
 
+
+  com.fasterxml.jackson
+  jackson-bom
+  ${jackson.version}
+  pom
+  import
+
 
   com.fasterxml.jackson.core
   jackson-annotations
-  ${jackson.version}
 
 
   com.fasterxml.jackson.core
   jackson-core
-  ${jackson.version}
 
 
   com.fasterxml.jackson.core
   jackson-databind
-  ${jackson.version}
 
 
   org.slf4j

[hive] branch branch-2.3 updated: HIVE-27579: Backport HIVE-18433: Upgrade version of com.fasterxml.jackson (#4562)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new e45d5ffa867 HIVE-27579: Backport HIVE-18433: Upgrade version of 
com.fasterxml.jackson (#4562)
e45d5ffa867 is described below

commit e45d5ffa8674418ffd031db5b9d66c28c6883805
Author: Yuming Wang 
AuthorDate: Thu Aug 10 01:44:34 2023 +0800

HIVE-27579: Backport HIVE-18433: Upgrade version of com.fasterxml.jackson 
(#4562)
---
 common/pom.xml |  2 +-
 druid-handler/pom.xml  |  8 +
 .../hive/druid/DruidStorageHandlerUtils.java   |  2 +-
 hcatalog/core/pom.xml  | 14 +++--
 hcatalog/server-extensions/pom.xml | 14 +++--
 hcatalog/webhcat/svr/pom.xml   | 15 ++
 itests/hive-blobstore/pom.xml  |  6 ++--
 pom.xml| 35 +++---
 ql/pom.xml | 19 +++-
 spark-client/pom.xml   |  8 +
 testutils/ptest2/pom.xml   | 17 +--
 .../apache/hive/ptest/api/client/PTestClient.java  |  2 +-
 .../apache/hive/ptest/execution/JIRAService.java   |  8 ++---
 13 files changed, 110 insertions(+), 40 deletions(-)

diff --git a/common/pom.xml b/common/pom.xml
index 1a92e645e09..fc9741d6599 100644
--- a/common/pom.xml
+++ b/common/pom.xml
@@ -199,7 +199,7 @@
 
   com.fasterxml.jackson.core
   jackson-databind
-  ${jackson.new.version}
+  ${jackson.version}
 
 
   com.github.joshelser
diff --git a/druid-handler/pom.xml b/druid-handler/pom.xml
index 637e1c4fa59..14b9205cd13 100644
--- a/druid-handler/pom.xml
+++ b/druid-handler/pom.xml
@@ -36,6 +36,14 @@
   
 
 
+
+  com.fasterxml.jackson.dataformat
+  jackson-dataformat-smile
+
+
+  com.fasterxml.jackson.core
+  jackson-databind
+
 
   org.apache.hive
   hive-exec
diff --git 
a/druid-handler/src/java/org/apache/hadoop/hive/druid/DruidStorageHandlerUtils.java
 
b/druid-handler/src/java/org/apache/hadoop/hive/druid/DruidStorageHandlerUtils.java
index 8d48e149bfc..e4e540fa02b 100644
--- 
a/druid-handler/src/java/org/apache/hadoop/hive/druid/DruidStorageHandlerUtils.java
+++ 
b/druid-handler/src/java/org/apache/hadoop/hive/druid/DruidStorageHandlerUtils.java
@@ -222,7 +222,7 @@ public final class DruidStorageHandlerUtils {
 FileSystem fs = taskDir.getFileSystem(conf);
 for (FileStatus fileStatus : fs.listStatus(taskDir)) {
   final DataSegment segment = JSON_MAPPER
-  .readValue(fs.open(fileStatus.getPath()), DataSegment.class);
+  .readValue((InputStream) fs.open(fileStatus.getPath()), 
DataSegment.class);
   publishedSegmentsBuilder.add(segment);
 }
 List publishedSegments = publishedSegmentsBuilder.build();
diff --git a/hcatalog/core/pom.xml b/hcatalog/core/pom.xml
index 2169c7a81ec..9648dbc6aa2 100644
--- a/hcatalog/core/pom.xml
+++ b/hcatalog/core/pom.xml
@@ -88,8 +88,18 @@
   ${guava.version}
 
 
-  org.codehaus.jackson
-  jackson-mapper-asl
+  com.fasterxml.jackson.core
+  jackson-annotations
+  ${jackson.version}
+
+
+  com.fasterxml.jackson.core
+  jackson-core
+  ${jackson.version}
+
+
+  com.fasterxml.jackson.core
+  jackson-databind
   ${jackson.version}
 
 
diff --git a/hcatalog/server-extensions/pom.xml 
b/hcatalog/server-extensions/pom.xml
index fc978c2b934..a12f66ad2c8 100644
--- a/hcatalog/server-extensions/pom.xml
+++ b/hcatalog/server-extensions/pom.xml
@@ -52,8 +52,18 @@
   ${jms.version}
 
 
-  org.codehaus.jackson
-  jackson-mapper-asl
+  com.fasterxml.jackson.core
+  jackson-annotations
+  ${jackson.version}
+
+
+  com.fasterxml.jackson.core
+  jackson-core
+  ${jackson.version}
+
+
+  com.fasterxml.jackson.core
+  jackson-databind
   ${jackson.version}
 
 
diff --git a/hcatalog/webhcat/svr/pom.xml b/hcatalog/webhcat/svr/pom.xml
index 534e66397d1..27f6b3adffa 100644
--- a/hcatalog/webhcat/svr/pom.xml
+++ b/hcatalog/webhcat/svr/pom.xml
@@ -83,13 +83,18 @@
   ${zookeeper.version}
 
 
-  org.codehaus.jackson
-  jackson-core-asl
+  com.fasterxml.jackson.core
+  jackson-annotations
   ${jackson.version}
 
- 
-  org.codehaus.jackson
-  jackson-mapper-asl
+
+  com.fasterxml.jackson.core
+  jackson-core
+  ${jackson.version}
+
+
+  com.fasterxml.jackson.core
+  jackson-databind
   ${jackson.version}
 
 
diff --git a/itests/hive-blobstore/pom.xml b/itests/hive-blobstore/pom.xml
index f67af9b05e3..9b7cd797286 100644

[hive] branch branch-2.3 updated: HIVE-26890: [2.3] Disable TestSSL#testConnectionWrongCertCN (Done as part of HIVE-22621 in master) (#4506)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 0a970dc37c0 HIVE-26890: [2.3] Disable 
TestSSL#testConnectionWrongCertCN (Done as part of HIVE-22621 in master) (#4506)
0a970dc37c0 is described below

commit 0a970dc37c044538aadda0467ade4a095502a437
Author: Cheng Pan 
AuthorDate: Thu Jul 27 12:31:13 2023 +0800

HIVE-26890: [2.3] Disable TestSSL#testConnectionWrongCertCN (Done as part 
of HIVE-22621 in master) (#4506)
---
 itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestSSL.java | 1 +
 1 file changed, 1 insertion(+)

diff --git a/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestSSL.java 
b/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestSSL.java
index 0a532599f76..01a62a1a109 100644
--- a/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestSSL.java
+++ b/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestSSL.java
@@ -390,6 +390,7 @@ public class TestSSL {
* Opening a new connection with this wrong certificate should fail
* @throws Exception
*/
+  @Ignore
   @Test
   public void testConnectionWrongCertCN() throws Exception {
 // This call sets the default ssl params including the correct keystore in 
the server config

[hive] branch branch-2.3 updated: HIVE-27518: [2.3] Upgrade log4j2 from 2.17.0 to 2.17.2 (#4505)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 419f51f052d HIVE-27518: [2.3] Upgrade log4j2 from 2.17.0 to 2.17.2 
(#4505)
419f51f052d is described below

commit 419f51f052d5decf6b76eedbb4b88c9870e8a3eb
Author: Cheng Pan 
AuthorDate: Thu Jul 27 12:30:08 2023 +0800

HIVE-27518: [2.3] Upgrade log4j2 from 2.17.0 to 2.17.2 (#4505)
---
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/pom.xml b/pom.xml
index 86253ecf9a1..d99275c09fa 100644
--- a/pom.xml
+++ b/pom.xml
@@ -173,7 +173,7 @@
 3.0.3
 0.9.3
 0.9.3
-2.17.0
+2.17.2
 2.3
 1.3.4
 1.9.5

[hive] branch branch-2.3 updated: HIVE-25173: [2.3] Migrate pentaho-aggdesigner-algorithm to aggdesigner-algorithm (#4486)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 9f9f9c2f6af HIVE-25173: [2.3] Migrate pentaho-aggdesigner-algorithm to 
aggdesigner-algorithm (#4486)
9f9f9c2f6af is described below

commit 9f9f9c2f6af44bf7969627e059e6700643f95c39
Author: Cheng Pan 
AuthorDate: Tue Jul 18 01:27:51 2023 +0800

HIVE-25173: [2.3] Migrate pentaho-aggdesigner-algorithm to 
aggdesigner-algorithm (#4486)
---
 binary-package-licenses/README |  2 +-
 druid-handler/pom.xml  |  6 ++
 pom.xml| 19 ---
 ql/pom.xml | 14 --
 4 files changed, 23 insertions(+), 18 deletions(-)

diff --git a/binary-package-licenses/README b/binary-package-licenses/README
index ef127e33b07..908b585dbe8 100644
--- a/binary-package-licenses/README
+++ b/binary-package-licenses/README
@@ -69,7 +69,7 @@ metrics*
 netty*
 opencsv*
 parquet-hadoop-bundle
-pentaho-aggdesigner-algorithm
+aggdesigner-algorithm
 plexus-utils
 regexp
 server-metrics
diff --git a/druid-handler/pom.xml b/druid-handler/pom.xml
index 86fd1dacbfc..637e1c4fa59 100644
--- a/druid-handler/pom.xml
+++ b/druid-handler/pom.xml
@@ -222,6 +222,12 @@
   org.apache.calcite
   calcite-druid
   ${calcite.version}
+  
+
+  org.pentaho
+  pentaho-aggdesigner-algorithm
+
+  
 
 
   com.lmax
diff --git a/pom.xml b/pom.xml
index ca3d6319309..86253ecf9a1 100644
--- a/pom.xml
+++ b/pom.xml
@@ -180,7 +180,7 @@
 2.0.0-M5
 4.0.52.Final
 1.8.1
-5.1.5-jhyde
+6.0
 0.16.0
 2.5.0
 1.0.1
@@ -218,17 +218,6 @@
 warn
   
 
-
-  conjars
-  Conjars
-  http://conjars.org/repo
-  default
-  
-true
-always
-warn
-  
-
   
 
   
@@ -751,9 +740,9 @@
 ${hadoop.version}
   
   
-org.pentaho
-pentaho-aggdesigner-algorithm
-${pentaho-aggdesigner.version}
+net.hydromatic
+aggdesigner-algorithm
+${aggdesigner.version}
   
   
 org.scala-lang
diff --git a/ql/pom.xml b/ql/pom.xml
index b83b9cd76fe..152a4cf8a9e 100644
--- a/ql/pom.xml
+++ b/ql/pom.xml
@@ -369,12 +369,22 @@
   com.fasterxml.jackson.core
   jackson-core
 
+
+  org.pentaho
+  pentaho-aggdesigner-algorithm
+
   
 
 
   org.apache.calcite
   calcite-druid
   ${calcite.version}
+  
+
+  org.pentaho
+  pentaho-aggdesigner-algorithm
+
+  
 
 
   org.apache.calcite.avatica
@@ -714,8 +724,8 @@
   janino
 
 
-  org.pentaho
-  pentaho-aggdesigner-algorithm
+  net.hydromatic
+  aggdesigner-algorithm
 
   
 

[hive] branch branch-2.3 updated: HIVE-26880: [2.3] Upgrade Apache Directory Server to 1.5.7 (#4487)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new c331f0cc3de HIVE-26880: [2.3] Upgrade Apache Directory Server to 1.5.7 
(#4487)
c331f0cc3de is described below

commit c331f0cc3de5bc263aaf7d50122fff229afbc4c2
Author: Cheng Pan 
AuthorDate: Tue Jul 18 01:25:15 2023 +0800

HIVE-26880: [2.3] Upgrade Apache Directory Server to 1.5.7 (#4487)
---
 pom.xml | 3 +--
 service/pom.xml | 7 ---
 2 files changed, 1 insertion(+), 9 deletions(-)

diff --git a/pom.xml b/pom.xml
index 0be98f8924a..ca3d6319309 100644
--- a/pom.xml
+++ b/pom.xml
@@ -110,8 +110,7 @@
 5.5.0
 1.9.1
 3.5.2
-1.5.6
-
0.1
+1.5.7
 1.8.0
 1.8.2
 0.8.0.RELEASE
diff --git a/service/pom.xml b/service/pom.xml
index de3504e354c..2aecadd49a8 100644
--- a/service/pom.xml
+++ b/service/pom.xml
@@ -189,13 +189,6 @@
   test
 
 
-
-  org.apache.directory.client.ldap
-  ldap-client-api
-  ${apache-directory-clientapi.version}
-  test
-
-
 
   org.apache.directory.server
   apacheds-server-integ

[hive] branch branch-2.3 updated: HIVE-25616: [FOLLOWUP] Set auth privileges should respect getauth (#3602)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 778fd075085 HIVE-25616: [FOLLOWUP] Set auth privileges should respect 
getauth (#3602)
778fd075085 is described below

commit 778fd075085afe1a7794b119f0e9242b22d0063f
Author: Cheng Pan 
AuthorDate: Tue Jul 18 01:22:08 2023 +0800

HIVE-25616: [FOLLOWUP] Set auth privileges should respect getauth (#3602)
---
 .../java/org/apache/hadoop/hive/metastore/ObjectStore.java | 14 --
 1 file changed, 8 insertions(+), 6 deletions(-)

diff --git 
a/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
b/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
index eab348f76f3..d454b955b41 100644
--- a/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
+++ b/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java
@@ -2634,12 +2634,14 @@ public class ObjectStore implements RawStore, 
Configurable {
   max_parts, null, queryWrapper);
   for (Object o : parts) {
 Partition part = convertToPart((MPartition) o);
-// set auth privileges
-String partName = 
Warehouse.makePartName(this.convertToFieldSchemas(mtbl
-.getPartitionKeys()), part.getValues());
-PrincipalPrivilegeSet partAuth = getPartitionPrivilegeSet(db_name,
-tbl_name, partName, userName, groupNames);
-part.setPrivileges(partAuth);
+if (getauth) {
+  // set auth privileges
+  String partName = 
Warehouse.makePartName(this.convertToFieldSchemas(mtbl
+  .getPartitionKeys()), part.getValues());
+  PrincipalPrivilegeSet partAuth = getPartitionPrivilegeSet(db_name,
+  tbl_name, partName, userName, groupNames);
+  part.setPrivileges(partAuth);
+}
 partitions.add(part);
   }
   success = commitTransaction();

[hive] branch branch-3 updated (36d37a6bfbc -> b089ba2f0cf)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


from 36d37a6bfbc HIVE-20179: Some Tez jar-s are not on classpath so HS2 
keeps too long to start (Peter Vary, reviewed by Zoltan Haindrich)
 add b089ba2f0cf HIVE-27200: Backport HIVE-24928 to branch-3 (#4175)

No new revisions were added by this update.

Summary of changes:
 .../hive/ql/metadata/HiveStorageHandler.java   |  19 +++
 .../hadoop/hive/ql/optimizer/GenMRTableScan1.java  |   4 +-
 .../hadoop/hive/ql/parse/ProcessAnalyzeTable.java  |   4 +-
 .../apache/hadoop/hive/ql/parse/TaskCompiler.java  |   1 +
 .../ql/parse/spark/SparkProcessAnalyzeTable.java   |   4 +-
 .../hadoop/hive/ql/stats/BasicStatsNoJobTask.java  | 183 ++---
 .../hadoop/hive/ql/stats/BasicStatsTask.java   |  35 ++--
 7 files changed, 169 insertions(+), 81 deletions(-)

[hive] branch branch-3 updated (a4669f2b8e0 -> 422fd4e48bd)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


from a4669f2b8e0 HIVE-27016 (addendum): Invoke optional output committer in 
TezProcessor for FileSink (#4046)
 add 422fd4e48bd HIVE-27017: backport HIVE-26771 option to use createTable 
DDLTask in CTAS for StorgeHandler (#4014)

No new revisions were added by this update.

Summary of changes:
 .../hive/ql/metadata/HiveStorageHandler.java   |  9 +++
 .../apache/hadoop/hive/ql/parse/TaskCompiler.java  | 28 --
 2 files changed, 35 insertions(+), 2 deletions(-)

[hive] branch branch-3 updated (9eff787550d -> a4669f2b8e0)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


from 9eff787550d HIVE-27025: Update sharedwork.q.out file (Aman Raj 
reviewed by Stamatis Zampetakis)
 add a4669f2b8e0 HIVE-27016 (addendum): Invoke optional output committer in 
TezProcessor for FileSink (#4046)

No new revisions were added by this update.

Summary of changes:
 ql/src/java/org/apache/hadoop/hive/ql/exec/tez/DagUtils.java  | 4 +++-
 .../org/apache/hadoop/hive/ql/exec/tez/TestTezOutputCommitter.java| 1 +
 2 files changed, 4 insertions(+), 1 deletion(-)

[hive] branch branch-3 updated (e3a44d59b2c -> 6662bb9aee4)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


from e3a44d59b2c HIVE-27028: Backport HIVE-18874: JDBC: HiveConnection 
shades log4j interfaces (Prasanth Jayachandran reviewed by Gopal V) (#4022) 
(branch-3 backport by Aman Raj reviewed by Laszlo Bodor)
 add 6662bb9aee4 HIVE-27016: Backport HIVE-24629 Invoke optional output 
committer in TezProcessor (#4013)

No new revisions were added by this update.

Summary of changes:
 .../java/org/apache/hadoop/hive/conf/HiveConf.java |   3 +
 .../apache/hadoop/hive/ql/exec/tez/DagUtils.java   |  13 +-
 .../hadoop/hive/ql/exec/tez/TezProcessor.java  |  27 
 .../hadoop/hive/ql/exec/tez/TestDagUtils.java  |  27 
 .../hive/ql/exec/tez/TestTezOutputCommitter.java   | 176 +
 5 files changed, 243 insertions(+), 3 deletions(-)
 create mode 100644 
ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezOutputCommitter.java

[hive] branch master updated: HIVE-26918: Upgrade jamon-runtime to 2.4.1 (#3932)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 5617e5d2889 HIVE-26918: Upgrade jamon-runtime to 2.4.1 (#3932)
5617e5d2889 is described below

commit 5617e5d288977a5ade1e1334ad153cbf046b0b08
Author: Dongjoon Hyun 
AuthorDate: Thu Jan 12 08:54:11 2023 -0800

HIVE-26918: Upgrade jamon-runtime to 2.4.1 (#3932)
---
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/pom.xml b/pom.xml
index cf2fef7725f..45de65a3704 100644
--- a/pom.xml
+++ b/pom.xml
@@ -150,7 +150,7 @@
 2.5.1
 2.12.7
 2.3.4
-2.3.1
+2.4.1
 0.3.2
 3.1.0
 2.3.1

[hive] branch master updated: HIVE-26912: Publish SBOM artifacts (#3926)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 25c78a0d392 HIVE-26912: Publish SBOM artifacts (#3926)
25c78a0d392 is described below

commit 25c78a0d392ede731bfb5ecd7b2159be4887f182
Author: Dongjoon Hyun 
AuthorDate: Mon Jan 9 15:14:23 2023 -0800

HIVE-26912: Publish SBOM artifacts (#3926)
---
 pom.xml | 13 +
 1 file changed, 13 insertions(+)

diff --git a/pom.xml b/pom.xml
index 6b194a098d9..792b8ccdf20 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1790,6 +1790,19 @@
 jamon-maven-plugin
 ${jamon.plugin.version}
   
+  
+org.cyclonedx
+cyclonedx-maven-plugin
+2.7.3
+
+  
+package
+
+  makeBom
+
+  
+
+  
 
   
   

[hive] branch branch-3 updated (f45197e6bb3 -> 230e00ab6ae)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


from f45197e6bb3 HIVE-26815: Backport HIVE-26758 (Allow use scratchdir for 
staging final job) (#3840)
 add 230e00ab6ae HIVE-26819: Vectorization: wrong results when filter on 
repeating map key orc table (#3844)

No new revisions were added by this update.

Summary of changes:
 .../expressions/VectorUDFMapIndexStringScalar.java |  4 ++
 .../queries/clientpositive/orc_map_key_repeating.q | 17 +
 .../llap/orc_map_key_repeating.q.out   | 84 ++
 3 files changed, 105 insertions(+)
 create mode 100644 ql/src/test/queries/clientpositive/orc_map_key_repeating.q
 create mode 100644 
ql/src/test/results/clientpositive/llap/orc_map_key_repeating.q.out

[hive] branch branch-3 updated: HIVE-26815: Backport HIVE-26758 (Allow use scratchdir for staging final job) (#3840)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-3 by this push:
 new f45197e6bb3 HIVE-26815: Backport HIVE-26758 (Allow use scratchdir for 
staging final job) (#3840)
f45197e6bb3 is described below

commit f45197e6bb3c4d4d9413de2ad12b01c2b923f0fc
Author: yigress <104102129+yigr...@users.noreply.github.com>
AuthorDate: Wed Dec 7 13:23:12 2022 -0800

HIVE-26815: Backport HIVE-26758 (Allow use scratchdir for staging final 
job) (#3840)
---
 .../java/org/apache/hadoop/hive/conf/HiveConf.java |  6 ++-
 .../hadoop/hive/ql/exec/FileSinkOperator.java  | 13 --
 .../org/apache/hadoop/hive/ql/exec/MoveTask.java   |  4 ++
 .../org/apache/hadoop/hive/ql/metadata/Hive.java   |  7 ++-
 .../hadoop/hive/ql/optimizer/GenMapRedUtils.java   | 13 --
 .../hadoop/hive/ql/parse/SemanticAnalyzer.java | 53 ++
 6 files changed, 57 insertions(+), 39 deletions(-)

diff --git a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
index 31ea29bc81c..44acef4532d 100644
--- a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
+++ b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
@@ -4485,7 +4485,11 @@ public class HiveConf extends Configuration {
 "This parameter enables a number of optimizations when running on 
blobstores:\n" +
 "(1) If hive.blobstore.use.blobstore.as.scratchdir is false, force 
the last Hive job to write to the blobstore.\n" +
 "This is a performance optimization that forces the final 
FileSinkOperator to write to the blobstore.\n" +
-"See HIVE-15121 for details.");
+"See HIVE-15121 for details."),
+
+HIVE_USE_SCRATCHDIR_FOR_STAGING("hive.use.scratchdir.for.staging", false,
+"Use ${hive.exec.scratchdir} for query results instead of 
${hive.exec.stagingdir}.\n" +
+"This stages query results in ${hive.exec.scratchdir} before moving to 
final destination.");
 
 public final String varname;
 public final String altName;
diff --git a/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java 
b/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
index 56c32bf78cc..713c19a6888 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
@@ -845,11 +845,14 @@ public class FileSinkOperator extends 
TerminalOperator implements
   }
 
   private void createDpDirCheckSrc(final Path dpStagingPath, final Path 
dpFinalPath) throws IOException {
-if (!fs.exists(dpStagingPath) && !fs.exists(dpFinalPath)) {
-  fs.mkdirs(dpStagingPath);
-  // move task will create dp final path
-  if (reporter != null) {
-reporter.incrCounter(counterGroup, 
Operator.HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, 1);
+if (!fs.exists(dpStagingPath)) {
+  FileSystem dpFs = dpFinalPath.getFileSystem(hconf);
+  if (!dpFs.exists(dpFinalPath)) {
+fs.mkdirs(dpStagingPath);
+// move task will create dp final path
+if (reporter != null) {
+  reporter.incrCounter(counterGroup, 
Operator.HIVE_COUNTER_CREATED_DYNAMIC_PARTITIONS, 1);
+}
   }
 }
   }
diff --git a/ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 
b/ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java
index e6ab88fc127..315381d85b9 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java
@@ -311,6 +311,10 @@ public class MoveTask extends Task implements 
Serializable {
 }
   }
   else {
+FileSystem targetFs = targetPath.getFileSystem(conf);
+if (!targetFs.exists(targetPath.getParent())){
+  targetFs.mkdirs(targetPath.getParent());
+}
 moveFile(sourcePath, targetPath, lfd.getIsDfsDir());
   }
 }
diff --git a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 
b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
index 6ca82a67123..2d461ada49c 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
@@ -1805,8 +1805,8 @@ public class Hive {
* See: HIVE-1707 and HIVE-2117 for background
*/
   FileSystem oldPartPathFS = oldPartPath.getFileSystem(getConf());
-  FileSystem loadPathFS = loadPath.getFileSystem(getConf());
-  if (FileUtils.equalsFileSystem(oldPartPathFS,loadPathFS)) {
+  FileSystem tblPathFS = tblDataLocationPath.getFileSystem(getConf());
+  if (FileUtils.equalsFileSystem(oldPartPathFS, tb

[hive] branch master updated (374564f49b3 -> 6de98baa1a9)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


from 374564f49b3 HIVE-26692: Check for the expected thrift version before 
compiling (#3820). (Alessandro Solimando, reviewed by Ayush Saxena)
 add 6de98baa1a9 HIVE-26758: Allow use scratchdir for staging final job 
(#3831)

No new revisions were added by this update.

Summary of changes:
 .../java/org/apache/hadoop/hive/conf/HiveConf.java |  4 +
 .../hadoop/hive/ql/exec/FileSinkOperator.java  | 13 +--
 .../org/apache/hadoop/hive/ql/exec/MoveTask.java   |  4 +
 .../hadoop/hive/ql/exec/OrcFileMergeOperator.java  |  2 +
 .../org/apache/hadoop/hive/ql/metadata/Hive.java   |  7 +-
 .../hadoop/hive/ql/optimizer/GenMapRedUtils.java   | 16 ++--
 .../hadoop/hive/ql/parse/SemanticAnalyzer.java | 93 ++
 7 files changed, 77 insertions(+), 62 deletions(-)

[hive] branch master updated: HIVE-26564: Separate query live operation log and historical operation log (#3621)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 6efbcae38d6 HIVE-26564: Separate query live operation log and 
historical operation log (#3621)
6efbcae38d6 is described below

commit 6efbcae38d6ef201eab6c5a4e425ac771b9cec12
Author: yigress <104102129+yigr...@users.noreply.github.com>
AuthorDate: Thu Oct 6 15:57:04 2022 -0700

HIVE-26564: Separate query live operation log and historical operation log 
(#3621)
---
 .../java/org/apache/hadoop/hive/ql/QueryInfo.java  |   8 +-
 .../hive/service/cli/operation/Operation.java  |  11 +-
 .../service/cli/operation/OperationLogManager.java | 230 ++---
 .../hive/service/cli/operation/SQLOperation.java   |   3 +-
 .../hive/service/cli/session/SessionManager.java   |   2 +-
 .../cli/operation/TestOperationLogManager.java |  49 ++---
 .../TestQueryLifeTimeHooksWithSQLOperation.java|   5 +
 .../cli/operation/TestSQLOperationMetrics.java |   5 +
 8 files changed, 107 insertions(+), 206 deletions(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/QueryInfo.java 
b/ql/src/java/org/apache/hadoop/hive/ql/QueryInfo.java
index 376037a241d..ee2bc77f8ff 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/QueryInfo.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/QueryInfo.java
@@ -25,6 +25,7 @@ public class QueryInfo {
   private final String userName;
   private final String executionEngine;
   private final long beginTime;
+  private final String sessionId;
   private final String operationId;
   private Long runtime;  // tracks only running portion of the query.
 
@@ -34,11 +35,12 @@ public class QueryInfo {
 
   private String operationLogLocation;
 
-  public QueryInfo(String state, String userName, String executionEngine, 
String operationId) {
+  public QueryInfo(String state, String userName, String executionEngine, 
String sessionId, String operationId) {
 this.state = state;
 this.userName = userName;
 this.executionEngine = executionEngine;
 this.beginTime = System.currentTimeMillis();
+this.sessionId = sessionId;
 this.operationId = operationId;
   }
 
@@ -86,6 +88,10 @@ public class QueryInfo {
 this.state = state;
   }
 
+  public String getSessionId() {
+return sessionId;
+  }
+
   public String getOperationId() {
 return operationId;
   }
diff --git 
a/service/src/java/org/apache/hive/service/cli/operation/Operation.java 
b/service/src/java/org/apache/hive/service/cli/operation/Operation.java
index 91dfa955f3b..b48809e8f7b 100644
--- a/service/src/java/org/apache/hive/service/cli/operation/Operation.java
+++ b/service/src/java/org/apache/hive/service/cli/operation/Operation.java
@@ -226,7 +226,8 @@ public abstract class Operation {
 
   protected void createOperationLog() {
 if (parentSession.isOperationLogEnabled()) {
-  operationLog = OperationLogManager.createOperationLog(this, queryState);
+  File operationLogFile = new 
File(parentSession.getOperationLogSessionDir(), queryState.getQueryId());
+  operationLog = new OperationLog(opHandle.toString(), operationLogFile, 
parentSession.getHiveConf());
   isOperationLogEnabled = true;
 }
   }
@@ -287,8 +288,10 @@ public abstract class Operation {
   private static class OperationLogCleaner implements Runnable {
 public static final Logger LOG = 
LoggerFactory.getLogger(OperationLogCleaner.class.getName());
 private OperationLog operationLog;
+private Operation operation;
 
-public OperationLogCleaner(OperationLog operationLog) {
+public OperationLogCleaner(Operation operation, OperationLog operationLog) 
{
+  this.operation = operation;
   this.operationLog = operationLog;
 }
 
@@ -297,6 +300,7 @@ public abstract class Operation {
   if (operationLog != null) {
 LOG.info("Closing operation log {}", operationLog);
 operationLog.close();
+OperationLogManager.closeOperation(operation);
   }
 }
   }
@@ -314,12 +318,13 @@ public abstract class Operation {
   } else {
 if (operationLogCleanupDelayMs > 0) {
   ScheduledExecutorService scheduledExecutorService = 
Executors.newScheduledThreadPool(1);
-  scheduledExecutorService.schedule(new 
OperationLogCleaner(operationLog), operationLogCleanupDelayMs,
+  scheduledExecutorService.schedule(new OperationLogCleaner(this, 
operationLog), operationLogCleanupDelayMs,
 TimeUnit.MILLISECONDS);
   scheduledExecutorService.shutdown();
 } else {
   log.info("Closing operation log {} without delay", operationLog);
   operationLog.close();
+  OperationLogManager.closeOperation(this);
 }
   }
 }
diff --git 
a/service/src/java/org/apache/hive/service/cli/operation/OperationLogManager.java
 
b/ser

[hive] branch master updated: HIVE-26478: Explicitly set Content-Type in QueryProfileServlet (#3527)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 392944e12d4 HIVE-26478: Explicitly set Content-Type in 
QueryProfileServlet (#3527)
392944e12d4 is described below

commit 392944e12d40a5a53e6c549437650be87dd6259e
Author: yigress <104102129+yigr...@users.noreply.github.com>
AuthorDate: Fri Aug 19 14:05:21 2022 -0700

HIVE-26478: Explicitly set Content-Type in QueryProfileServlet (#3527)
---
 .../src/java/org/apache/hive/service/servlet/QueryProfileServlet.java   | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git 
a/service/src/java/org/apache/hive/service/servlet/QueryProfileServlet.java 
b/service/src/java/org/apache/hive/service/servlet/QueryProfileServlet.java
index f9133c4be74..fb38833b82e 100644
--- a/service/src/java/org/apache/hive/service/servlet/QueryProfileServlet.java
+++ b/service/src/java/org/apache/hive/service/servlet/QueryProfileServlet.java
@@ -53,7 +53,7 @@ public class QueryProfileServlet extends HttpServlet {
   LOG.debug("No display object found for operation {} ", opId);
   return;
 }
-
+response.setContentType("text/html; charset=utf-8");
 new QueryProfileTmpl().render(response.getWriter(), queryInfo, hiveConf);
   }
 }

[hive] branch master updated: HIVE-26447 (addendum): Fix orc_map_key_repeating.q.out location (#3509)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 7948ff5c3f2 HIVE-26447 (addendum): Fix orc_map_key_repeating.q.out 
location (#3509)
7948ff5c3f2 is described below

commit 7948ff5c3f226d2fe6d554beb6bffb071aa4cad9
Author: John Sherman 
AuthorDate: Sat Aug 6 11:39:29 2022 -0700

HIVE-26447 (addendum): Fix orc_map_key_repeating.q.out location (#3509)
---
 ql/src/test/results/clientpositive/{ => llap}/orc_map_key_repeating.q.out | 0
 1 file changed, 0 insertions(+), 0 deletions(-)

diff --git a/ql/src/test/results/clientpositive/orc_map_key_repeating.q.out 
b/ql/src/test/results/clientpositive/llap/orc_map_key_repeating.q.out
similarity index 100%
rename from ql/src/test/results/clientpositive/orc_map_key_repeating.q.out
rename to ql/src/test/results/clientpositive/llap/orc_map_key_repeating.q.out

[hive] branch master updated: HIVE-26447: Vectorization: wrong results when filter on repeating map key orc table (#3492)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 4b1f01f5b9 HIVE-26447: Vectorization: wrong results when filter on 
repeating map key orc table (#3492)
4b1f01f5b9 is described below

commit 4b1f01f5b97b0028047b63d1922db335dbaf5d8d
Author: yigress <104102129+yigr...@users.noreply.github.com>
AuthorDate: Fri Aug 5 11:52:45 2022 -0700

HIVE-26447: Vectorization: wrong results when filter on repeating map key 
orc table (#3492)
---
 .../expressions/VectorUDFMapIndexStringScalar.java |  5 +-
 .../queries/clientpositive/orc_map_key_repeating.q | 17 +
 .../clientpositive/orc_map_key_repeating.q.out | 84 ++
 3 files changed, 105 insertions(+), 1 deletion(-)

diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/VectorUDFMapIndexStringScalar.java
 
b/ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/VectorUDFMapIndexStringScalar.java
index 0d9b5ba631..02274924b9 100644
--- 
a/ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/VectorUDFMapIndexStringScalar.java
+++ 
b/ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/VectorUDFMapIndexStringScalar.java
@@ -66,10 +66,13 @@ public class VectorUDFMapIndexStringScalar extends 
VectorUDFMapIndexBaseScalar {
 byte[][] keyVector = keyColVector.vector;
 int[] keyStart = keyColVector.start;
 int[] keyLength = keyColVector.length;
+final boolean isRepeating = keyColVector.isRepeating;
 for (int i = 0; i < count; i++) {
   final int keyOffset = offset + i;
+  final int len = isRepeating? keyLength[0]: keyLength[keyOffset];
+  byte[] rowKey = isRepeating? keyVector[0]: keyVector[keyOffset];
   if (StringExpr.equal(key, 0, key.length,
-  keyVector[keyOffset], keyStart[keyOffset], keyLength[keyOffset])) {
+  rowKey, keyStart[keyOffset], len)) {
 return offset + i;
   }
 }
diff --git a/ql/src/test/queries/clientpositive/orc_map_key_repeating.q 
b/ql/src/test/queries/clientpositive/orc_map_key_repeating.q
new file mode 100644
index 00..ac29159406
--- /dev/null
+++ b/ql/src/test/queries/clientpositive/orc_map_key_repeating.q
@@ -0,0 +1,17 @@
+SET hive.vectorized.execution.enabled=true;
+SET hive.fetch.task.conversion=none;
+
+-- test single repeating key
+create temporary table foo (id int, x map) stored as orc;
+insert into foo values(1, map('ABC', 9)), (2, map('ABC', 7)), (3, map('ABC', 
8)), (4, map('ABC', 9));
+select id from foo where x['ABC']=9;
+
+-- test multiple repeating keys
+create temporary table bar (id int, x map) stored as orc;
+insert into bar values(1, map('A', 9, 'B', 1)), (2, map('A', 7, 'B', 2)), (3, 
map('A', 8, 'B', 3)), (4, map('A', 9, 'B', 4));
+select id from bar where x['A']=9;
+
+-- test mixed keys
+create temporary table doo (id int, x map) stored as orc;
+insert into doo values(1, map('ABC', 9, 'B', 1)), (2, map('AB', 7)), (3, 
map('A', 8, 'C', 3)), (4, map('D', 7, 'ABC', 9, 'E', 4));
+select id from doo where x['ABC']=9;
\ No newline at end of file
diff --git a/ql/src/test/results/clientpositive/orc_map_key_repeating.q.out 
b/ql/src/test/results/clientpositive/orc_map_key_repeating.q.out
new file mode 100644
index 00..745f80a42d
--- /dev/null
+++ b/ql/src/test/results/clientpositive/orc_map_key_repeating.q.out
@@ -0,0 +1,84 @@
+PREHOOK: query: create temporary table foo (id int, x map) stored 
as orc
+PREHOOK: type: CREATETABLE
+PREHOOK: Output: database:default
+PREHOOK: Output: default@foo
+POSTHOOK: query: create temporary table foo (id int, x map) stored 
as orc
+POSTHOOK: type: CREATETABLE
+POSTHOOK: Output: database:default
+POSTHOOK: Output: default@foo
+PREHOOK: query: insert into foo values(1, map('ABC', 9)), (2, map('ABC', 7)), 
(3, map('ABC', 8)), (4, map('ABC', 9))
+PREHOOK: type: QUERY
+PREHOOK: Input: _dummy_database@_dummy_table
+PREHOOK: Output: default@foo
+POSTHOOK: query: insert into foo values(1, map('ABC', 9)), (2, map('ABC', 7)), 
(3, map('ABC', 8)), (4, map('ABC', 9))
+POSTHOOK: type: QUERY
+POSTHOOK: Input: _dummy_database@_dummy_table
+POSTHOOK: Output: default@foo
+POSTHOOK: Lineage: foo.id SCRIPT []
+POSTHOOK: Lineage: foo.x SCRIPT []
+PREHOOK: query: select id from foo where x['ABC']=9
+PREHOOK: type: QUERY
+PREHOOK: Input: default@foo
+ A masked pattern was here 
+POSTHOOK: query: select id from foo where x['ABC']=9
+POSTHOOK: type: QUERY
+POSTHOOK: Input: default@foo
+ A masked pattern was here 
+1
+4

[hive] branch master updated: HIVE-26448: Improve UnsignedInt128.setV*() (#3501)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 5edae43178 HIVE-26448: Improve UnsignedInt128.setV*() (#3501)
5edae43178 is described below

commit 5edae43178b26456afd88b29c93faeaf5a3163d8
Author: Jiaan Geng 
AuthorDate: Sat Aug 6 02:08:22 2022 +0800

HIVE-26448: Improve UnsignedInt128.setV*() (#3501)
---
 .../hadoop/hive/common/type/UnsignedInt128.java| 12 +++-
 .../hive/common/type/TestUnsignedInt128.java   | 66 ++
 2 files changed, 75 insertions(+), 3 deletions(-)

diff --git 
a/common/src/java/org/apache/hadoop/hive/common/type/UnsignedInt128.java 
b/common/src/java/org/apache/hadoop/hive/common/type/UnsignedInt128.java
index 872b85fbba..c7affbfc96 100644
--- a/common/src/java/org/apache/hadoop/hive/common/type/UnsignedInt128.java
+++ b/common/src/java/org/apache/hadoop/hive/common/type/UnsignedInt128.java
@@ -215,7 +215,9 @@ public final class UnsignedInt128 implements 
Comparable, Seriali
*/
   public void setV0(int val) {
 v[0] = val;
-updateCount();
+if (count < 2) {
+  updateCount();
+}
   }
 
   /**
@@ -226,7 +228,9 @@ public final class UnsignedInt128 implements 
Comparable, Seriali
*/
   public void setV1(int val) {
 v[1] = val;
-updateCount();
+if (count < 3) {
+  updateCount();
+}
   }
 
   /**
@@ -237,7 +241,9 @@ public final class UnsignedInt128 implements 
Comparable, Seriali
*/
   public void setV2(int val) {
 v[2] = val;
-updateCount();
+if (count < 4) {
+  updateCount();
+}
   }
 
   /**
diff --git 
a/common/src/test/org/apache/hadoop/hive/common/type/TestUnsignedInt128.java 
b/common/src/test/org/apache/hadoop/hive/common/type/TestUnsignedInt128.java
index c711d5beb6..a0b6957945 100644
--- a/common/src/test/org/apache/hadoop/hive/common/type/TestUnsignedInt128.java
+++ b/common/src/test/org/apache/hadoop/hive/common/type/TestUnsignedInt128.java
@@ -186,6 +186,72 @@ public class TestUnsignedInt128 {
 assertEquals(0L, new UnsignedInt128().asLong());
   }
 
+  @Test
+  public void testUnsignedInt128Count() {
+UnsignedInt128 minValue = UnsignedInt128.MIN_VALUE;
+assertEquals((byte) 0, minValue.getCount());
+UnsignedInt128 maxValue = UnsignedInt128.MAX_VALUE;
+assertEquals((byte) 4, maxValue.getCount());
+UnsignedInt128 unsignedInt128 = new UnsignedInt128(0, 0, 0, 0);
+assertEquals((byte) 0, unsignedInt128.getCount());
+
+// Let count equals 4. updateCount() will not be called if update v0, v1, 
v2, v3.
+unsignedInt128.setV3(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.setV3(200);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.setV2(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.setV1(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.setV0(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.zeroClear();
+assertEquals((byte) 0, unsignedInt128.getCount());
+
+// Let count equals 3. updateCount() will not be called if update v0, v1, 
v2.
+unsignedInt128.setV2(100);
+assertEquals((byte) 3, unsignedInt128.getCount());
+unsignedInt128.setV2(200);
+assertEquals((byte) 3, unsignedInt128.getCount());
+unsignedInt128.setV1(100);
+assertEquals((byte) 3, unsignedInt128.getCount());
+unsignedInt128.setV0(100);
+assertEquals((byte) 3, unsignedInt128.getCount());
+unsignedInt128.setV3(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.zeroClear();
+assertEquals((byte) 0, unsignedInt128.getCount());
+
+// Let count equals 2. updateCount() will not be called if update v0, v1.
+unsignedInt128.setV1(100);
+assertEquals((byte) 2, unsignedInt128.getCount());
+unsignedInt128.setV1(100);
+assertEquals((byte) 2, unsignedInt128.getCount());
+unsignedInt128.setV0(1);
+assertEquals((byte) 2, unsignedInt128.getCount());
+unsignedInt128.setV2(100);
+assertEquals((byte) 3, unsignedInt128.getCount());
+unsignedInt128.setV3(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.zeroClear();
+assertEquals((byte) 0, unsignedInt128.getCount());
+
+// Let count equals 2. updateCount() will not be called if update v0.
+unsignedInt128.setV0(2);
+assertEquals((byte) 1, unsignedInt128.getCount());
+unsignedInt128.setV0(2);
+assertEquals((byte) 1, unsignedInt128.getCount());
+unsignedInt128.setV1(100);
+assertEquals((byte) 2, unsignedInt128.getCount());
+unsignedInt128.setV2(100);
+assertEquals((byte) 3, unsignedInt128.getCount());
+unsignedInt128.setV3(100);
+assertEquals((byte) 4, unsignedInt128.getCount());
+unsignedInt128.

[hive] branch branch-2.3 updated: HIVE-26434: Fix HMS thrift method recv_get_table_objects_by_name's exception list (#3483)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new a3e807af67f HIVE-26434: Fix HMS thrift method 
recv_get_table_objects_by_name's exception list (#3483)
a3e807af67f is described below

commit a3e807af67fb708acc5f6ab7d63575125615de3d
Author: Cheng Pan 
AuthorDate: Thu Jul 28 12:43:24 2022 +0800

HIVE-26434: Fix HMS thrift method recv_get_table_objects_by_name's 
exception list (#3483)
---
 metastore/if/hive_metastore.thrift |   3 +-
 .../src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp |  90 +
 .../src/gen/thrift/gen-cpp/ThriftHiveMetastore.h   |  28 +-
 .../hive/metastore/api/ThriftHiveMetastore.java| 369 -
 .../gen-php/metastore/ThriftHiveMetastore.php  |  87 +
 .../gen-py/hive_metastore/ThriftHiveMetastore.py   |  59 +++-
 .../src/gen/thrift/gen-rb/thrift_hive_metastore.rb |  21 +-
 7 files changed, 641 insertions(+), 16 deletions(-)

diff --git a/metastore/if/hive_metastore.thrift 
b/metastore/if/hive_metastore.thrift
index 8a66bbcc70d..9df27319ffa 100755
--- a/metastore/if/hive_metastore.thrift
+++ b/metastore/if/hive_metastore.thrift
@@ -1099,11 +1099,10 @@ service ThriftHiveMetastore extends 
fb303.FacebookService
   Table get_table(1:string dbname, 2:string tbl_name)
throws (1:MetaException o1, 2:NoSuchObjectException o2)
   list get_table_objects_by_name(1:string dbname, 2:list 
tbl_names)
+   throws (1:MetaException o1, 2:InvalidOperationException o2, 
3:UnknownDBException o3)
   GetTableResult get_table_req(1:GetTableRequest req)
throws (1:MetaException o1, 2:NoSuchObjectException o2)
   GetTablesResult get_table_objects_by_name_req(1:GetTablesRequest req)
-
-
   throws (1:MetaException o1, 
2:InvalidOperationException o2, 3:UnknownDBException o3)
 
   // Get a list of table names that match a filter.
diff --git a/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp 
b/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
index 155aab66aeb..cd59743f873 100644
--- a/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
+++ b/metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
@@ -7406,6 +7406,30 @@ uint32_t 
ThriftHiveMetastore_get_table_objects_by_name_result::read(::apache::th
   xfer += iprot->skip(ftype);
 }
 break;
+  case 1:
+if (ftype == ::apache::thrift::protocol::T_STRUCT) {
+  xfer += this->o1.read(iprot);
+  this->__isset.o1 = true;
+} else {
+  xfer += iprot->skip(ftype);
+}
+break;
+  case 2:
+if (ftype == ::apache::thrift::protocol::T_STRUCT) {
+  xfer += this->o2.read(iprot);
+  this->__isset.o2 = true;
+} else {
+  xfer += iprot->skip(ftype);
+}
+break;
+  case 3:
+if (ftype == ::apache::thrift::protocol::T_STRUCT) {
+  xfer += this->o3.read(iprot);
+  this->__isset.o3 = true;
+} else {
+  xfer += iprot->skip(ftype);
+}
+break;
   default:
 xfer += iprot->skip(ftype);
 break;
@@ -7436,6 +7460,18 @@ uint32_t 
ThriftHiveMetastore_get_table_objects_by_name_result::write(::apache::t
   xfer += oprot->writeListEnd();
 }
 xfer += oprot->writeFieldEnd();
+  } else if (this->__isset.o1) {
+xfer += oprot->writeFieldBegin("o1", ::apache::thrift::protocol::T_STRUCT, 
1);
+xfer += this->o1.write(oprot);
+xfer += oprot->writeFieldEnd();
+  } else if (this->__isset.o2) {
+xfer += oprot->writeFieldBegin("o2", ::apache::thrift::protocol::T_STRUCT, 
2);
+xfer += this->o2.write(oprot);
+xfer += oprot->writeFieldEnd();
+  } else if (this->__isset.o3) {
+xfer += oprot->writeFieldBegin("o3", ::apache::thrift::protocol::T_STRUCT, 
3);
+xfer += this->o3.write(oprot);
+xfer += oprot->writeFieldEnd();
   }
   xfer += oprot->writeFieldStop();
   xfer += oprot->writeStructEnd();
@@ -7488,6 +7524,30 @@ uint32_t 
ThriftHiveMetastore_get_table_objects_by_name_presult::read(::apache::t
   xfer += iprot->skip(ftype);
 }
 break;
+  case 1:
+if (ftype == ::apache::thrift::protocol::T_STRUCT) {
+  xfer += this->o1.read(iprot);
+  this->__isset.o1 = true;
+} else {
+  xfer += iprot->skip(ftype);
+}
+break;
+  case 2:
+if (ftype == ::apache::thrift::protocol::T_STRUCT) {
+  xfer += this->o2.read(iprot);
+  this->__isset.o2 = true;
+} else {
+  xfer += iprot->skip(ftype);
+}
+break;
+  cas

[hive] branch master updated: HIVE-26260: Use `Reader.getSchema` instead of deprecated `Reader.getTypes` (#3318)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new fd3990c0bdb HIVE-26260: Use `Reader.getSchema` instead of deprecated 
`Reader.getTypes` (#3318)
fd3990c0bdb is described below

commit fd3990c0bdb54010c6e64b167bec469152275b5f
Author: Dongjoon Hyun 
AuthorDate: Thu May 26 15:23:13 2022 -0700

HIVE-26260: Use `Reader.getSchema` instead of deprecated `Reader.getTypes` 
(#3318)

### What changes were proposed in this pull request?

This PR aims to use `org.apache.orc.Reader.getSchema` instead of the 
deprecated `org.apache.orc.Reader.getTypes` API.

### Why are the changes needed?

`getTypes` was deprecated.

- 
https://github.com/apache/orc/blob/main/java/core/src/java/org/apache/orc/Reader.java#L144
```java
  /**
   * Get the list of types contained in the file. The root type is the first
   * type in the list.
   * @return the list of flattened types
   * @deprecated use getSchema instead
   * @since 1.1.0
   */
  List getTypes();
```

In addition, AS-IS implementation is only a slow-wrapper.
- 
https://github.com/apache/orc/blob/1e2962064b209f1b00188877f08d4226da85c640/java/core/src/java/org/apache/orc/impl/ReaderImpl.java#L259-L262
```java
  @Override
  public List getTypes() {
return OrcUtils.getOrcTypes(schema);
  }
```

- 
https://github.com/apache/orc/blob/1e2962064b209f1b00188877f08d4226da85c640/java/core/src/java/org/apache/orc/OrcUtils.java#L108-L112
```java
  public static List getOrcTypes(TypeDescription typeDescr) {
List result = new ArrayList<>();
appendOrcTypes(result, typeDescr);
return result;
  }
```

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs
---
 ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java| 3 +--
 ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java | 3 +--
 2 files changed, 2 insertions(+), 4 deletions(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 
b/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
index a2936b36ffb..0f1333b9a68 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
@@ -252,9 +252,8 @@ public class OrcInputFormat implements 
InputFormat,
 
 OrcRecordReader(Reader file, Configuration conf,
 FileSplit split) throws IOException {
-  List types = file.getTypes();
   this.file = file;
-  numColumns = (types.size() == 0) ? 0 : types.get(0).getSubtypesCount();
+  numColumns = file.getSchema().getChildren().size();
   this.offset = split.getStart();
   this.length = split.getLength();
   this.reader = createReaderFromFile(file, conf, offset, length);
diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java 
b/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java
index fb04573c183..645f00602a9 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcNewInputFormat.java
@@ -66,8 +66,7 @@ public class OrcNewInputFormat extends 
InputFormat{
 
 OrcRecordReader(Reader file, Configuration conf,
 long offset, long length) throws IOException {
-  List types = file.getTypes();
-  numColumns = (types.size() == 0) ? 0 : types.get(0).getSubtypesCount();
+  numColumns = file.getSchema().getChildren().size();
   value = new OrcStruct(numColumns);
   this.reader = OrcInputFormat.createReaderFromFile(file, conf, offset,
   length);

[hive-site] branch main updated: dummy commit

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/hive-site.git


The following commit(s) were added to refs/heads/main by this push:
 new f2bc1dd  dummy commit
f2bc1dd is described below

commit f2bc1dd87c46f905c7d876c1655675175e4140e6
Author: Chao Sun 
AuthorDate: Wed Mar 9 12:01:54 2022 -0800

dummy commit
---
 downloads.md | 1 -
 1 file changed, 1 deletion(-)

diff --git a/downloads.md b/downloads.md
index e9a421a..e368a33 100644
--- a/downloads.md
+++ b/downloads.md
@@ -30,7 +30,6 @@ On the mirror, all recent releases are available, but are not
 guaranteed to be stable. For stable releases, look in the stable
 directory.
 
-
 ## News
 ### 9 June 2021: release 2.3.9 available
 This release works with Hadoop 2.x.y

[hive-site] branch gh-pages updated: dummy commit

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/hive-site.git


The following commit(s) were added to refs/heads/gh-pages by this push:
 new ba13381  dummy commit
ba13381 is described below

commit ba13381f367f39e0d5e319e9aa51c850487c06bf
Author: Chao Sun 
AuthorDate: Wed Mar 9 12:01:54 2022 -0800

dummy commit
---
 downloads.md | 1 -
 1 file changed, 1 deletion(-)

diff --git a/downloads.md b/downloads.md
index e9a421a..e368a33 100644
--- a/downloads.md
+++ b/downloads.md
@@ -30,7 +30,6 @@ On the mirror, all recent releases are available, but are not
 guaranteed to be stable. For stable releases, look in the stable
 directory.
 
-
 ## News
 ### 9 June 2021: release 2.3.9 available
 This release works with Hadoop 2.x.y

[hive-site] branch gh-pages updated: empty commit

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/hive-site.git


The following commit(s) were added to refs/heads/gh-pages by this push:
 new 408fadd  empty commit
408fadd is described below

commit 408fadd28755fe84d77857fb431f350142b99f36
Author: Chao Sun 
AuthorDate: Wed Mar 9 12:00:12 2022 -0800

empty commit

[hive-site] branch main updated (55711e6 -> 2b54cb5)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/hive-site.git.


from 55711e6  initialise repo with a basic readme
 add 360d200  Add all files from hive.git/docs to gh-pages branch of 
hive.git
 add b0b9961  Add .asf.yaml to publish the website whenever a push goes to 
main
 add d3cda40  Add Hive 2.3.8 release information
 add 2b54cb5  Add Hive 2.3.9 release information

No new revisions were added by this update.

Summary of changes:
 .asf.yaml   |   2 +
 Dockerfile  |  51 +++
 Gemfile |   3 +
 README.md   |  25 ++-
 _config.yml |  17 +++
 _includes/footer.html   |  14 ++
 _includes/header.html   |   5 +
 _includes/sidenav.html  |  50 ++
 _includes/top.html  |  21 +++
 _layouts/default.html   |  19 +++
 css/hive.css| 365 
 doap_Hive.rdf   |  58 +++
 downloads.md| 221 +++
 favicon.ico | Bin 0 -> 1150 bytes
 hcatalog_downloads.md   |  43 ++
 images/feather_small.gif| Bin 0 -> 7500 bytes
 images/hive-logo.jpg| Bin 0 -> 2498 bytes
 images/hive_logo_medium.jpg | Bin 0 -> 4372 bytes
 index.md|  62 
 issue_tracking.md   |  31 
 javadoc.md  |  32 
 mailing_lists.md|  78 ++
 people.md   | 156 +++
 privacy_policy.md   |  48 ++
 version_control.md  |  27 
 25 files changed, 1327 insertions(+), 1 deletion(-)
 create mode 100644 .asf.yaml
 create mode 100644 Dockerfile
 create mode 100644 Gemfile
 create mode 100644 _config.yml
 create mode 100644 _includes/footer.html
 create mode 100644 _includes/header.html
 create mode 100644 _includes/sidenav.html
 create mode 100644 _includes/top.html
 create mode 100644 _layouts/default.html
 create mode 100644 css/hive.css
 create mode 100644 doap_Hive.rdf
 create mode 100644 downloads.md
 create mode 100644 favicon.ico
 create mode 100644 hcatalog_downloads.md
 create mode 100644 images/feather_small.gif
 create mode 100644 images/hive-logo.jpg
 create mode 100644 images/hive_logo_medium.jpg
 create mode 100644 index.md
 create mode 100644 issue_tracking.md
 create mode 100644 javadoc.md
 create mode 100644 mailing_lists.md
 create mode 100644 people.md
 create mode 100644 privacy_policy.md
 create mode 100644 version_control.md

[hive-site] branch gh-pages updated: Add Hive 2.3.9 release information

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/hive-site.git


The following commit(s) were added to refs/heads/gh-pages by this push:
 new 2b54cb5  Add Hive 2.3.9 release information
2b54cb5 is described below

commit 2b54cb5d57089f50b8a38607d089849b2fe0e350
Author: Chao Sun 
AuthorDate: Wed Mar 9 09:54:00 2022 -0800

Add Hive 2.3.9 release information
---
 downloads.md | 5 +
 javadoc.md   | 2 +-
 2 files changed, 6 insertions(+), 1 deletion(-)

diff --git a/downloads.md b/downloads.md
index ceba18e..e9a421a 100644
--- a/downloads.md
+++ b/downloads.md
@@ -32,6 +32,10 @@ directory.
 
 
 ## News
+### 9 June 2021: release 2.3.9 available
+This release works with Hadoop 2.x.y
+You can look at the complete [JIRA change log for this release][HIVE_2_3_9_CL].
+
 ### 17 January 2021: release 2.3.8 available
 This release works with Hadoop 2.x.y
 You can look at the complete [JIRA change log for this release][HIVE_2_3_8_CL].
@@ -183,6 +187,7 @@ You can look at the complete [JIRA change log for this 
release][HIVE_10_CL].
 
 [HIVE_DL]: http://www.apache.org/dyn/closer.cgi/hive/
 [HIVE_3_1_2_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12344397&styleName=Html&projectId=12310843
+[HIVE_2_3_9_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350009&styleName=Text&projectId=12310843
 [HIVE_2_3_8_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12349428&styleName=Text&projectId=12310843
 [HIVE_2_3_7_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346056&styleName=Text&projectId=12310843
 [HIVE_2_3_6_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345603&styleName=Text&projectId=12310843
diff --git a/javadoc.md b/javadoc.md
index 1348128..16ab3a4 100644
--- a/javadoc.md
+++ b/javadoc.md
@@ -24,7 +24,7 @@ layout: default
 
   * [Hive 3.1.2 Javadocs]({{ site.old_javadoc }}/r3.1.2/api/index.html)
   * [Hive 3.0.0 Javadocs]({{ site.old_javadoc }}/r3.0.0/api/index.html)
-  * [Hive 2.3.8 Javadocs]({{ site.old_javadoc }}/r2.3.8/api/index.html)
+  * [Hive 2.3.9 Javadocs]({{ site.old_javadoc }}/r2.3.9/api/index.html)
   * [Hive 2.2.0 Javadocs]({{ site.old_javadoc }}/r2.2.0/api/index.html)
   * [Hive 2.1.1 Javadocs]({{ site.old_javadoc }}/r2.1.1/api/index.html)
   * [Hive 1.2.2 Javadocs]({{ site.old_javadoc }}/r1.2.2/api/index.html)

[hive-site] branch gh-pages updated: Add Hive 2.3.8 release information

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch gh-pages
in repository https://gitbox.apache.org/repos/asf/hive-site.git


The following commit(s) were added to refs/heads/gh-pages by this push:
 new d3cda40  Add Hive 2.3.8 release information
d3cda40 is described below

commit d3cda400fc0b149c4a3251120dd9f7f177b44f6d
Author: Chao Sun 
AuthorDate: Wed Mar 9 09:50:36 2022 -0800

Add Hive 2.3.8 release information
---
 downloads.md | 5 +
 javadoc.md   | 2 +-
 2 files changed, 6 insertions(+), 1 deletion(-)

diff --git a/downloads.md b/downloads.md
index 891dbad..ceba18e 100644
--- a/downloads.md
+++ b/downloads.md
@@ -32,6 +32,10 @@ directory.
 
 
 ## News
+### 17 January 2021: release 2.3.8 available
+This release works with Hadoop 2.x.y
+You can look at the complete [JIRA change log for this release][HIVE_2_3_8_CL].
+
 ### 18 April 2020: release 2.3.7 available
 This release works with Hadoop 2.x.y
 You can look at the complete [JIRA change log for this release][HIVE_2_3_7_CL].
@@ -179,6 +183,7 @@ You can look at the complete [JIRA change log for this 
release][HIVE_10_CL].
 
 [HIVE_DL]: http://www.apache.org/dyn/closer.cgi/hive/
 [HIVE_3_1_2_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12344397&styleName=Html&projectId=12310843
+[HIVE_2_3_8_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12349428&styleName=Text&projectId=12310843
 [HIVE_2_3_7_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346056&styleName=Text&projectId=12310843
 [HIVE_2_3_6_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345603&styleName=Text&projectId=12310843
 [HIVE_2_3_5_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345394&styleName=Text&projectId=12310843
diff --git a/javadoc.md b/javadoc.md
index 341c529..1348128 100644
--- a/javadoc.md
+++ b/javadoc.md
@@ -24,7 +24,7 @@ layout: default
 
   * [Hive 3.1.2 Javadocs]({{ site.old_javadoc }}/r3.1.2/api/index.html)
   * [Hive 3.0.0 Javadocs]({{ site.old_javadoc }}/r3.0.0/api/index.html)
-  * [Hive 2.3.7 Javadocs]({{ site.old_javadoc }}/r2.3.7/api/index.html)
+  * [Hive 2.3.8 Javadocs]({{ site.old_javadoc }}/r2.3.8/api/index.html)
   * [Hive 2.2.0 Javadocs]({{ site.old_javadoc }}/r2.2.0/api/index.html)
   * [Hive 2.1.1 Javadocs]({{ site.old_javadoc }}/r2.1.1/api/index.html)
   * [Hive 1.2.2 Javadocs]({{ site.old_javadoc }}/r1.2.2/api/index.html)

[hive] branch branch-2.3 updated: HIVE-25824: Upgrade log4j dependencies to 2.17.0 (#2908)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 7b7e8d4  HIVE-25824: Upgrade log4j dependencies to 2.17.0 (#2908)
7b7e8d4 is described below

commit 7b7e8d4d7910b9b6dc2fe498a6a4228c628853c1
Author: Luca Toscano 
AuthorDate: Thu Jan 13 07:05:53 2022 +0100

HIVE-25824: Upgrade log4j dependencies to 2.17.0 (#2908)

This change should mimic what done in the 3.x and master branches
to fix the various CVEs related to log4j.

The Apache Bigtop project used the same patch on top of 2.3.6
(released with Bigtop 1.5) and all our build/smoke-tests
passed.
---
 bin/hive-config.sh | 4 
 druid-handler/pom.xml  | 5 +
 hbase-handler/pom.xml  | 5 +
 jdbc/pom.xml   | 5 +
 llap-server/pom.xml| 5 +
 pom.xml| 6 +++---
 ql/pom.xml | 5 +
 .../org/apache/hadoop/hive/ql/log/NoDeleteRollingFileAppender.java | 2 +-
 service/pom.xml| 7 ++-
 testutils/ptest2/pom.xml   | 2 +-
 10 files changed, 40 insertions(+), 6 deletions(-)

diff --git a/bin/hive-config.sh b/bin/hive-config.sh
index d52b84e..8381a25 100644
--- a/bin/hive-config.sh
+++ b/bin/hive-config.sh
@@ -68,3 +68,7 @@ export HIVE_AUX_JARS_PATH=$HIVE_AUX_JARS_PATH
 
 # Default to use 256MB 
 export HADOOP_HEAPSIZE=${HADOOP_HEAPSIZE:-256}
+
+# Disable the JNDI. This feature has critical RCE vulnerability.
+# when 2.x <= log4j.version <= 2.14.1
+export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS 
-Dlog4j2.formatMsgNoLookups=true"
diff --git a/druid-handler/pom.xml b/druid-handler/pom.xml
index 9d163c6..86fd1da 100644
--- a/druid-handler/pom.xml
+++ b/druid-handler/pom.xml
@@ -223,6 +223,11 @@
   calcite-druid
   ${calcite.version}
 
+
+  com.lmax
+  disruptor
+  ${disruptor.version}
+
 
 
   junit
diff --git a/hbase-handler/pom.xml b/hbase-handler/pom.xml
index e56ef53..a831fed 100644
--- a/hbase-handler/pom.xml
+++ b/hbase-handler/pom.xml
@@ -102,6 +102,11 @@
   hbase-hadoop-compat
   ${hbase.version}
 
+
+  com.lmax
+  disruptor
+  ${disruptor.version}
+
 
 
 
diff --git a/jdbc/pom.xml b/jdbc/pom.xml
index 3bc69cd..aa70329 100644
--- a/jdbc/pom.xml
+++ b/jdbc/pom.xml
@@ -109,6 +109,11 @@
   ${hadoop.version}
   true
 
+
+  com.lmax
+  disruptor
+  ${disruptor.version}
+
 
 
   junit
diff --git a/llap-server/pom.xml b/llap-server/pom.xml
index d9ae1ad..1dac091 100644
--- a/llap-server/pom.xml
+++ b/llap-server/pom.xml
@@ -230,6 +230,11 @@
   org.codehaus.jettison
   jettison
 
+
+  com.lmax
+  disruptor
+  ${disruptor.version}
+
 
 
 
diff --git a/pom.xml b/pom.xml
index c20e8c6..0be98f8 100644
--- a/pom.xml
+++ b/pom.xml
@@ -98,7 +98,7 @@
 2.4
 2.4
 2.4
-2.4.3
+3.2.0
 3.0.0-M4
 2.4
 2.8
@@ -143,7 +143,7 @@
 1.1
 1.1.1
 
-3.3.0
+3.3.7
 2.5.1
 
 4.4
@@ -174,7 +174,7 @@
 3.0.3
 0.9.3
 0.9.3
-2.6.2
+2.17.0
 2.3
 1.3.4
 1.9.5
diff --git a/ql/pom.xml b/ql/pom.xml
index 4085de3..b83b9cd 100644
--- a/ql/pom.xml
+++ b/ql/pom.xml
@@ -141,6 +141,11 @@
 
 
   org.apache.logging.log4j
+  log4j-core
+  ${log4j2.version}
+
+
+  org.apache.logging.log4j
   log4j-slf4j-impl
   ${log4j2.version}
 
diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/log/NoDeleteRollingFileAppender.java 
b/ql/src/java/org/apache/hadoop/hive/ql/log/NoDeleteRollingFileAppender.java
index be32f06..5d10233 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/log/NoDeleteRollingFileAppender.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/log/NoDeleteRollingFileAppender.java
@@ -27,7 +27,7 @@ import org.apache.log4j.FileAppender;
 import org.apache.log4j.Layout;
 import org.apache.log4j.helpers.CountingQuietWriter;
 import org.apache.log4j.helpers.LogLog;
-import org.apache.log4j.helpers.OptionConverter;
+import org.apache.logging.log4j.core.util.OptionConverter;
 import org.apache.log4j.spi.LoggingEvent;
 
 public class NoDeleteRollingFileAppender extends FileAppender {
diff --git a/service/pom.xml b/service/pom.xml
index 40ef75b..de3504e 100644
--- a/service/pom.xml
+++ b/service/pom.xml
@@ -81,7 +81,12 @@
   
 

-
+
+  com.lmax
+  disruptor
+  ${d

[hive] branch master updated: HIVE-25729: ThriftUnionObjectInspector should be notified when fully inited (#2808)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 83e48c9  HIVE-25729: ThriftUnionObjectInspector should be notified 
when fully inited (#2808)
83e48c9 is described below

commit 83e48c9e06e19e97ffcf9254f26dce2fdb8d9add
Author: dengzh 
AuthorDate: Fri Dec 3 07:26:16 2021 +0800

HIVE-25729: ThriftUnionObjectInspector should be notified when fully inited 
(#2808)
---
 .../hadoop/hive/serde2/objectinspector/ThriftUnionObjectInspector.java   | 1 +
 1 file changed, 1 insertion(+)

diff --git 
a/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ThriftUnionObjectInspector.java
 
b/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ThriftUnionObjectInspector.java
index cdfaee2..d3260d7 100644
--- 
a/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ThriftUnionObjectInspector.java
+++ 
b/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ThriftUnionObjectInspector.java
@@ -102,6 +102,7 @@ public class ThriftUnionObjectInspector extends 
ReflectionStructObjectInspector
   final ObjectInspector reflectionObjectInspector = 
ObjectInspectorFactory.getReflectionObjectInspector(fieldType, options, false);
   fields.add(new StandardStructObjectInspector.MyField(fieldId, 
fieldName, reflectionObjectInspector));
   this.ois.add(reflectionObjectInspector);
+  this.notifyAll();
 }
 inited = true;
   }

[hive] branch master updated: HIVE-25522: NullPointerException in TxnHandler (#2647)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new c8a0b6f  HIVE-25522: NullPointerException in TxnHandler (#2647)
c8a0b6f is described below

commit c8a0b6f4887edc2f33ed5d2c77c8baf9c0bbd11c
Author: Szehon Ho 
AuthorDate: Sat Nov 6 12:52:39 2021 -0700

HIVE-25522: NullPointerException in TxnHandler (#2647)
---
 .../hadoop/hive/metastore/txn/TxnHandler.java  | 41 +-
 1 file changed, 24 insertions(+), 17 deletions(-)

diff --git 
a/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java
 
b/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java
index 9abe615..8b05e93 100644
--- 
a/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java
+++ 
b/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java
@@ -368,33 +368,36 @@ abstract class TxnHandler implements TxnStore, 
TxnStore.MutexAPI {
   public void setConf(Configuration conf){
 this.conf = conf;
 
+int maxPoolSize = MetastoreConf.getIntVar(conf, 
ConfVars.CONNECTION_POOLING_MAX_CONNECTIONS);
+long getConnectionTimeoutMs = 3;
 synchronized (TxnHandler.class) {
   if (connPool == null) {
-Connection dbConn = null;
-// Set up the JDBC connection pool
-try {
-  int maxPoolSize = MetastoreConf.getIntVar(conf, 
ConfVars.CONNECTION_POOLING_MAX_CONNECTIONS);
-  long getConnectionTimeoutMs = 3;
-  connPool = setupJdbcConnectionPool(conf, maxPoolSize, 
getConnectionTimeoutMs);
-  /*the mutex pools should ideally be somewhat larger since some 
operations require 1
+connPool = setupJdbcConnectionPool(conf, maxPoolSize, 
getConnectionTimeoutMs);
+  }
+
+  if (connPoolMutex == null) {
+/*the mutex pools should ideally be somewhat larger since some 
operations require 1
connection from each pool and we want to avoid taking a connection 
from primary pool
and then blocking because mutex pool is empty.  There is only 1 
thread in any HMS trying
to mutex on each MUTEX_KEY except MUTEX_KEY.CheckLock.  The 
CheckLock operation gets a
connection from connPool first, then connPoolMutex.  All others, go 
in the opposite
order (not very elegant...).  So number of connection requests for 
connPoolMutex cannot
exceed (size of connPool + MUTEX_KEY.values().length - 1).*/
-  connPoolMutex = setupJdbcConnectionPool(conf, maxPoolSize + 
MUTEX_KEY.values().length, getConnectionTimeoutMs);
-  dbConn = getDbConn(Connection.TRANSACTION_READ_COMMITTED);
+connPoolMutex = setupJdbcConnectionPool(conf, maxPoolSize + 
MUTEX_KEY.values().length, getConnectionTimeoutMs);
+  }
+
+  if (dbProduct == null) {
+try (Connection dbConn = 
getDbConn(Connection.TRANSACTION_READ_COMMITTED)) {
   determineDatabaseProduct(dbConn);
-  sqlGenerator = new SQLGenerator(dbProduct, conf);
 } catch (SQLException e) {
-  String msg = "Unable to instantiate JDBC connection pooling, " + 
e.getMessage();
-  LOG.error(msg);
+  LOG.error("Unable to determine database product", e);
   throw new RuntimeException(e);
-} finally {
-  closeDbConn(dbConn);
 }
   }
+
+  if (sqlGenerator == null) {
+sqlGenerator = new SQLGenerator(dbProduct, conf);
+  }
 }
 
 numOpenTxns = Metrics.getOrCreateGauge(MetricsConstants.NUM_OPEN_TXNS);
@@ -4611,7 +4614,6 @@ abstract class TxnHandler implements TxnStore, 
TxnStore.MutexAPI {
 
 
   private void determineDatabaseProduct(Connection conn) {
-if (dbProduct != null) return;
 try {
   String s = conn.getMetaData().getDatabaseProductName();
   dbProduct = DatabaseProduct.determineDatabaseProduct(s, conf);
@@ -5575,10 +5577,15 @@ abstract class TxnHandler implements TxnStore, 
TxnStore.MutexAPI {
 }
   }
 
-  private static synchronized DataSource setupJdbcConnectionPool(Configuration 
conf, int maxPoolSize, long getConnectionTimeoutMs) throws SQLException {
+  private synchronized static DataSource setupJdbcConnectionPool(Configuration 
conf, int maxPoolSize, long getConnectionTimeoutMs) {
 DataSourceProvider dsp = 
DataSourceProviderFactory.tryGetDataSourceProviderOrNull(conf);
 if (dsp != null) {
-  return dsp.create(conf);
+  try {
+return dsp.create(conf);
+  } catch (SQLException e) {
+LOG.error("Unable to instantiate JDBC connection pooling", e);
+throw new RuntimeException(e);
+  }
 } else {
   String connectionPool

[hive] branch branch-2.3 updated: HIVE-25500: Switch back to alter_partition(s) in HMS client for Hive 2.3.x (#2618)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new efd5212  HIVE-25500: Switch back to alter_partition(s) in HMS client 
for Hive 2.3.x (#2618)
efd5212 is described below

commit efd5212fd6273c6aa5e97b4dbe5183e43e1a9675
Author: cxzl25 
AuthorDate: Thu Sep 9 01:09:00 2021 +0800

HIVE-25500: Switch back to alter_partition(s) in HMS client for Hive 2.3.x 
(#2618)
---
 .../hadoop/hive/metastore/HiveMetaStoreClient.java   | 16 
 1 file changed, 12 insertions(+), 4 deletions(-)

diff --git 
a/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java 
b/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
index 53d97ff..3b774a0 100644
--- 
a/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
+++ 
b/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
@@ -1503,25 +1503,33 @@ public class HiveMetaStoreClient implements 
IMetaStoreClient {
   @Override
   public void alter_partition(String dbName, String tblName, Partition newPart)
   throws InvalidOperationException, MetaException, TException {
-client.alter_partition_with_environment_context(dbName, tblName, newPart, 
null);
+client.alter_partition(dbName, tblName, newPart);
   }
 
   @Override
   public void alter_partition(String dbName, String tblName, Partition 
newPart, EnvironmentContext environmentContext)
   throws InvalidOperationException, MetaException, TException {
-client.alter_partition_with_environment_context(dbName, tblName, newPart, 
environmentContext);
+if (environmentContext == null) {
+  client.alter_partition(dbName, tblName, newPart);
+} else {
+  client.alter_partition_with_environment_context(dbName, tblName, 
newPart, environmentContext);
+}
   }
 
   @Override
   public void alter_partitions(String dbName, String tblName, List 
newParts)
   throws InvalidOperationException, MetaException, TException {
-client.alter_partitions_with_environment_context(dbName, tblName, 
newParts, null);
+client.alter_partitions(dbName, tblName, newParts);
   }
 
   @Override
   public void alter_partitions(String dbName, String tblName, List 
newParts, EnvironmentContext environmentContext)
   throws InvalidOperationException, MetaException, TException {
-client.alter_partitions_with_environment_context(dbName, tblName, 
newParts, environmentContext);
+if (environmentContext == null) {
+  client.alter_partitions(dbName, tblName, newParts);
+} else {
+  client.alter_partitions_with_environment_context(dbName, tblName, 
newParts, environmentContext);
+}
 }
 
   @Override

[hive] branch master updated (c066d5d -> c6d78ef)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from c066d5d  HIVE-25482: Add option to enable connectionLeak detection for 
Hikari … (#2610)
 add c6d78ef  HIVE-25277: fix slow partition deletion issue by removing 
duplicated isEmpty checks (#2421)

No new revisions were added by this update.

Summary of changes:
 .../apache/hadoop/hive/metastore/HMSHandler.java   | 77 ++
 1 file changed, 63 insertions(+), 14 deletions(-)

[hive] branch branch-3.1 updated: HIVE-24324: Remove deprecated API usage from Avro (#1621) (#1711)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-3.1 by this push:
 new a2d82a7  HIVE-24324: Remove deprecated API usage from Avro (#1621) 
(#1711)
a2d82a7 is described below

commit a2d82a7244fd4037ed463db2532f64206f9abb71
Author: Chao Sun 
AuthorDate: Mon Aug 9 21:34:27 2021 -0700

HIVE-24324: Remove deprecated API usage from Avro (#1621) (#1711)
---
 .../apache/hadoop/hive/serde2/avro/AvroDeserializer.java   |  6 +++---
 .../org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java | 12 
 .../apache/hadoop/hive/serde2/avro/SchemaToTypeInfo.java   | 14 ++
 3 files changed, 25 insertions(+), 7 deletions(-)

diff --git 
a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java 
b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java
index db8db1c..e8d122e 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java
@@ -272,7 +272,7 @@ class AvroDeserializer {
 
   int scale = 0;
   try {
-scale = fileSchema.getJsonProp(AvroSerDe.AVRO_PROP_SCALE).asInt();
+scale = AvroSerdeUtils.getIntFromSchema(fileSchema, 
AvroSerDe.AVRO_PROP_SCALE);
   } catch(Exception ex) {
 throw new AvroSerdeException("Failed to obtain scale value from file 
schema: " + fileSchema, ex);
   }
@@ -288,7 +288,7 @@ class AvroDeserializer {
 
   int maxLength = 0;
   try {
-maxLength = 
fileSchema.getJsonProp(AvroSerDe.AVRO_PROP_MAX_LENGTH).getValueAsInt();
+maxLength = AvroSerdeUtils.getIntFromSchema(fileSchema, 
AvroSerDe.AVRO_PROP_MAX_LENGTH);
   } catch (Exception ex) {
 throw new AvroSerdeException("Failed to obtain maxLength value for 
char field from file schema: " + fileSchema, ex);
   }
@@ -303,7 +303,7 @@ class AvroDeserializer {
 
   maxLength = 0;
   try {
-maxLength = 
fileSchema.getJsonProp(AvroSerDe.AVRO_PROP_MAX_LENGTH).getValueAsInt();
+maxLength = AvroSerdeUtils.getIntFromSchema(fileSchema, 
AvroSerDe.AVRO_PROP_MAX_LENGTH);
   } catch (Exception ex) {
 throw new AvroSerdeException("Failed to obtain maxLength value for 
varchar field from file schema: " + fileSchema, ex);
   }
diff --git 
a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java 
b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
index d16abdb..3b96d30 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
@@ -322,6 +322,18 @@ public class AvroSerdeUtils {
 }
   }
 
+  public static int getIntFromSchema(Schema schema, String name) {
+Object obj = schema.getObjectProp(name);
+if (obj instanceof String) {
+  return Integer.parseInt((String) obj);
+} else if (obj instanceof Integer) {
+  return (int) obj;
+} else {
+  throw new IllegalArgumentException("Expect integer or string value from 
property " + name
++ " but found type " + obj.getClass().getName());
+}
+  }
+
   /**
* Called on specific alter table events, removes schema url and schema 
literal from given tblproperties
* After the change, HMS solely will be responsible for handling the schema
diff --git 
a/serde/src/java/org/apache/hadoop/hive/serde2/avro/SchemaToTypeInfo.java 
b/serde/src/java/org/apache/hadoop/hive/serde2/avro/SchemaToTypeInfo.java
index 35d83bd..5557a6a 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/avro/SchemaToTypeInfo.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/avro/SchemaToTypeInfo.java
@@ -136,8 +136,14 @@ class SchemaToTypeInfo {
   int precision = 0;
   int scale = 0;
   try {
-precision = 
schema.getJsonProp(AvroSerDe.AVRO_PROP_PRECISION).getIntValue();
-scale = schema.getJsonProp(AvroSerDe.AVRO_PROP_SCALE).getIntValue();
+Object o = schema.getObjectProp(AvroSerDe.AVRO_PROP_PRECISION);
+if (o instanceof Integer) {
+  precision = (int) o;
+}
+o = schema.getObjectProp(AvroSerDe.AVRO_PROP_SCALE);
+if (o instanceof Integer) {
+  scale = (int) o;
+}
   } catch (Exception ex) {
 throw new AvroSerdeException("Failed to obtain scale value from file 
schema: " + schema, ex);
   }
@@ -155,7 +161,7 @@ class SchemaToTypeInfo {
   
AvroSerDe.CHAR_TYPE_NAME.equalsIgnoreCase(schema.getProp(AvroSerDe.AVRO_PROP_LOGICAL_TYPE)))
 {
   int maxLength = 0;
   try {
-maxLength = 
schema.getJsonProp(AvroSerDe.AVRO_PROP_MAX_LENGTH).getValueAsInt();
+maxLength = AvroSerdeUtils.getIntFromSchema(schema, 
AvroSerDe.AVRO_PROP_MAX

[hive] branch master updated (4034e5f -> 8514c87)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 4034e5f  HIVE-25137: getAllWriteEventInfo should go through the HMS 
client instead of using RawStore directly (Yu-Wen Lai, reviewed by Pravin Kumar 
Sinha)
 add 8514c87  HIVE-25384: Bump ORC to 1.6.9 (#2530)

No new revisions were added by this update.

Summary of changes:
 pom.xml  | 2 +-
 standalone-metastore/pom.xml | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

[hive] branch branch-2.3 updated: Preparing for 2.3.10 development.

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new b28aa02  Preparing for 2.3.10 development.
b28aa02 is described below

commit b28aa0236a5691dada867f516ab8f82c6593bf0e
Author: Chao Sun 
AuthorDate: Tue Jul 6 09:32:04 2021 -0700

Preparing for 2.3.10 development.
---
 accumulo-handler/pom.xml | 2 +-
 beeline/pom.xml  | 2 +-
 cli/pom.xml  | 2 +-
 common/pom.xml   | 2 +-
 contrib/pom.xml  | 2 +-
 druid-handler/pom.xml| 2 +-
 hbase-handler/pom.xml| 2 +-
 hcatalog/core/pom.xml| 2 +-
 hcatalog/hcatalog-pig-adapter/pom.xml| 2 +-
 hcatalog/pom.xml | 2 +-
 hcatalog/server-extensions/pom.xml   | 2 +-
 hcatalog/streaming/pom.xml   | 2 +-
 hcatalog/webhcat/java-client/pom.xml | 2 +-
 hcatalog/webhcat/svr/pom.xml | 2 +-
 hplsql/pom.xml   | 2 +-
 itests/custom-serde/pom.xml  | 2 +-
 itests/custom-udfs/pom.xml   | 2 +-
 itests/custom-udfs/udf-classloader-udf1/pom.xml  | 2 +-
 itests/custom-udfs/udf-classloader-udf2/pom.xml  | 2 +-
 itests/custom-udfs/udf-classloader-util/pom.xml  | 2 +-
 itests/custom-udfs/udf-vectorized-badexample/pom.xml | 2 +-
 itests/hcatalog-unit/pom.xml | 2 +-
 itests/hive-blobstore/pom.xml| 2 +-
 itests/hive-jmh/pom.xml  | 2 +-
 itests/hive-minikdc/pom.xml  | 2 +-
 itests/hive-unit-hadoop2/pom.xml | 2 +-
 itests/hive-unit/pom.xml | 2 +-
 itests/pom.xml   | 2 +-
 itests/qtest-accumulo/pom.xml| 2 +-
 itests/qtest-spark/pom.xml   | 2 +-
 itests/qtest/pom.xml | 2 +-
 itests/test-serde/pom.xml| 2 +-
 itests/util/pom.xml  | 2 +-
 jdbc-handler/pom.xml | 2 +-
 jdbc/pom.xml | 2 +-
 llap-client/pom.xml  | 2 +-
 llap-common/pom.xml  | 2 +-
 llap-ext-client/pom.xml  | 2 +-
 llap-server/pom.xml  | 2 +-
 llap-tez/pom.xml | 2 +-
 metastore/pom.xml| 2 +-
 packaging/pom.xml| 2 +-
 pom.xml  | 2 +-
 ql/pom.xml   | 2 +-
 serde/pom.xml| 2 +-
 service-rpc/pom.xml  | 2 +-
 service/pom.xml  | 2 +-
 shims/0.23/pom.xml   | 2 +-
 shims/aggregator/pom.xml | 2 +-
 shims/common/pom.xml | 2 +-
 shims/pom.xml| 2 +-
 shims/scheduler/pom.xml  | 2 +-
 spark-client/pom.xml | 4 ++--
 testutils/pom.xml| 2 +-
 vector-code-gen/pom.xml  | 2 +-
 55 files changed, 56 insertions(+), 56 deletions(-)

diff --git a/accumulo-handler/pom.xml b/accumulo-handler/pom.xml
index 026bbf0..592c19e 100644
--- a/accumulo-handler/pom.xml
+++ b/accumulo-handler/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.9
+2.3.10-SNAPSHOT
 ../pom.xml
   
 
diff --git a/beeline/pom.xml b/beeline/pom.xml
index c35095c..57ed6b2 100644
--- a/beeline/pom.xml
+++ b/beeline/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.9
+2.3.10-SNAPSHOT
 ../pom.xml
   
 
diff --git a/cli/pom.xml b/cli/pom.xml
index f9a6818..003d960 100644
--- a/cli/pom.xml
+++ b/cli/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.9
+2.3.10-SNAPSHOT
 ../pom.xml
   
 
diff --git a/common/pom.xml b/common/pom.xml
index 4438e9b..1a92e64 100644
--- a/common/pom.xml
+++ b/common/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.9
+2.3.10-SNAPSHOT
 ../pom.xml
   
 
diff --git a/contrib/pom.xml b/contrib/pom.xml
index 4c7e271..85d35f9 100644
--- a/contrib/pom.xml
+++ b/contrib/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive

svn commit: r1890648 - in /hive/cms/trunk/content: downloads.mdtext javadoc.mdtext

[sunchao]

Author: sunchao
Date: Wed Jun  9 20:37:02 2021
New Revision: 1890648

URL: http://svn.apache.org/viewvc?rev=1890648&view=rev
Log:
Hive 2.3.9 release

Modified:
hive/cms/trunk/content/downloads.mdtext
hive/cms/trunk/content/javadoc.mdtext

Modified: hive/cms/trunk/content/downloads.mdtext
URL: 
http://svn.apache.org/viewvc/hive/cms/trunk/content/downloads.mdtext?rev=1890648&r1=1890647&r2=1890648&view=diff
==
--- hive/cms/trunk/content/downloads.mdtext (original)
+++ hive/cms/trunk/content/downloads.mdtext Wed Jun  9 20:37:02 2021
@@ -11,6 +11,10 @@ directory.
 
 
 ## News
+### 9 June 2021: release 2.3.9 available
+This release works with Hadoop 2.x.y
+You can look at the complete [JIRA change log for this release][HIVE_2_3_9_CL].
+
 ### 17 January 2021: release 2.3.8 available
 This release works with Hadoop 2.x.y
 You can look at the complete [JIRA change log for this release][HIVE_2_3_8_CL].
@@ -162,6 +166,7 @@ You can look at the complete [JIRA chang
 
 [HIVE_DL]: http://www.apache.org/dyn/closer.cgi/hive/
 [HIVE_3_1_2_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12344397&styleName=Html&projectId=12310843
+[HIVE_2_3_9_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350009&styleName=Text&projectId=12310843
 [HIVE_2_3_8_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12349428&styleName=Text&projectId=12310843
 [HIVE_2_3_7_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346056&styleName=Text&projectId=12310843
 [HIVE_2_3_6_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345603&styleName=Text&projectId=12310843

Modified: hive/cms/trunk/content/javadoc.mdtext
URL: 
http://svn.apache.org/viewvc/hive/cms/trunk/content/javadoc.mdtext?rev=1890648&r1=1890647&r2=1890648&view=diff
==
--- hive/cms/trunk/content/javadoc.mdtext (original)
+++ hive/cms/trunk/content/javadoc.mdtext Wed Jun  9 20:37:02 2021
@@ -4,7 +4,7 @@ Recent versions:
 
   * [Hive 3.1.2 Javadocs][r3.1.2]
   * [Hive 3.0.0 Javadocs][r3.0.0]
-  * [Hive 2.3.8 Javadocs][r2.3.8]
+  * [Hive 2.3.9 Javadocs][r2.3.9]
   * [Hive 2.2.0 Javadocs][r2.2.0]
   * [Hive 2.1.1 Javadocs][r2.1.1]
   * [Hive 1.2.2 Javadocs][r1.2.2]
@@ -20,7 +20,7 @@ javadoc and sources jars for use in an I
 
 [r3.1.2]: /javadocs/r3.1.2/api/index.html
 [r3.0.0]: /javadocs/r3.0.0/api/index.html
-[r2.3.8]: /javadocs/r2.3.8/api/index.html
+[r2.3.9]: /javadocs/r2.3.9/api/index.html
 [r2.2.0]: /javadocs/r2.2.0/api/index.html
 [r2.1.1]: /javadocs/r2.1.1/api/index.html
 [r1.2.2]: /javadocs/r1.2.2/api/index.html

svn commit: r1075593 - in /websites/production/hive/content/javadocs: r2.3.8/ r2.3.9/ r2.3.9/api/ r2.3.9/api/org/ r2.3.9/api/org/apache/ r2.3.9/api/org/apache/hadoop/ r2.3.9/api/org/apache/hadoop/fs/

[sunchao]

Author: sunchao
Date: Wed Jun  9 20:17:43 2021
New Revision: 1075593

Log:
Hive 2.3.9 release


[This commit notification would consist of 4090 parts, 
which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r48239 - in /release/hive: ./ hive-2.3.8/ hive-2.3.9/

[sunchao]

Author: sunchao
Date: Wed Jun  9 18:30:30 2021
New Revision: 48239

Log:
Hive 2.3.9 release distribution

Added:
release/hive/hive-2.3.9/
release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz   (with props)
release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.asc
release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.sha256
release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz   (with props)
release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.asc
release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.sha256
Removed:
release/hive/hive-2.3.8/
Modified:
release/hive/stable-2

Added: release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz
==
Binary file - no diff available.

Propchange: release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz
--
svn:mime-type = application/octet-stream

Added: release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.asc
==
--- release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.asc (added)
+++ release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.asc Wed Jun  9 
18:30:30 2021
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCAAdFiEE3n+iQespjQJ8l7Kh2PGpe+UeypgFAmC2o8wACgkQ2PGpe+Ue
+ypiRxRAArsPpF24hYYqkxdHneECDHCmEGLJmHsAMjG4s704WYnO5beMA/iE1dIFg
+9nLkFb9KQMGqlMpAEYhGecZR9p2D7wP1b/Dli2me3gtf5Tpj8kn46If+gGKHi+wh
+MklBwOnijJwLDWm175ktazWTbXB7f9syDb076zMZUAB+oqH9aRXyoKpA3ObounIF
+VG7mFdQKk38EIw6/xQ9dYxARweVAT86NBB+ka2jAENAsT3oDNLjVBgZOZ28lHsK6
+p5bILB72Xl8JoKwe6t35cq+939uNWCquD/2EAxJHUADn/GPiBtk+fh9YOuBtefPf
+Ruh+YzK1pslcjvmtkmZh5vHloH9hJsnFQId1WcDprYAxaIsMDlWlOQbREnFu5AUj
+C2HB3gJNmnPxriAfDYOnqmPmr1gJt9G2p6zLfs4Wbx0zGKeBW3JZoG7nkwpqd03L
+eKLSG5TCs+uMHIGkaMOad21K5830Z3YVGTTW3zWrf9RFf4r5IfJ2lKAWztgSctjp
+jCqG5C4W+GDAohAjAwYZ5HORzB2bzAtFy1pygCSTSj41vN1PO9DP4VMDJfu8JmUS
+CFbTOiszN2HVZnOCFCWtB076A/EjVmu2gZuCeMHONJl/tLSNJ0CsHRHwtTfCDVun
+R7hTh+uWUBSDDc4S9FM6vrJ1MAwgLWHgY45jr+xb8DIKW7jaK6w=
+=h3Y7
+-END PGP SIGNATURE-

Added: release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.sha256
==
--- release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.sha256 (added)
+++ release/hive/hive-2.3.9/apache-hive-2.3.9-bin.tar.gz.sha256 Wed Jun  9 
18:30:30 2021
@@ -0,0 +1 @@
+1996327c96672e7ea8eaa8fc63972c75bc095287a32612e545e0e51c1622cb5c  
apache-hive-2.3.9-bin.tar.gz

Added: release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz
==
Binary file - no diff available.

Propchange: release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz
--
svn:mime-type = application/octet-stream

Added: release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.asc
==
--- release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.asc (added)
+++ release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.asc Wed Jun  9 
18:30:30 2021
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCAAdFiEE3n+iQespjQJ8l7Kh2PGpe+UeypgFAmC2o+cACgkQ2PGpe+Ue
+ypjDAw//au05ijc+3Ud3/hCMUGf9sufOxTKfY5ZgsVxUgkDtUxQLPVKp1Rh8v/kH
+j2A8WT2uH6nl2NyZv3qcBBXu+D/biUCOgg8zVyN15+eb3q+NoM+NV2cWPxvCan9r
+tTjNyqFv5TS2bwf0ZhY5x1b69LlXZhfHtBDq6K+lkcuOJIjzDu9eHlsQXpQNOGMS
+BtIXYFeExBf/NmsjYF+NMNR41diP9AB2Sg/GqJ+nOIwpb/EwjbxDXlNrLJYVycqr
+FJHR5TDMykH7kl1yyRqoey2jg+P+XYxG3av6jM5SyLCauIt6/bpZiCnwWCt5fFJm
+kgMOO2T9wE9KuUGZ11EX3B6NuHtbn3fPSyxaiqZ90HUEiVGQIpvNDKkG3eSzr082
+43UmEsDyNKs1PqvQu3dnh4chwj/pgRgmrcxNpf6Ges+DL5rroE7UoPRzBT6AIsfe
+9pOvROdk7WFZGWUwiQ7+3cSRb7Idoo6u8KPCq6JHvlcNua8Y1FGNmukFJTrgXFcX
++SNxqrRovmeFTUgViRgS2GwPy3411NbhDUR2LRAfh+5cZUtyeoj2t3lYose90SmD
+hZmIm0BJ9vKuFxh9EvYDdtY6qREIEUs3gx/VjMwfULutyhjKW3rgM8X34bZ3l0sC
+7G0pu40lnL9EFLB1mQXdRdEQF92f7VkfKOMr58CPLLeb1J5DgxU=
+=SuSV
+-END PGP SIGNATURE-

Added: release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.sha256
==
--- release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.sha256 (added)
+++ release/hive/hive-2.3.9/apache-hive-2.3.9-src.tar.gz.sha256 Wed Jun  9 
18:30:30 2021
@@ -0,0 +1 @@
+55d2e87171e00b7f8ae9c10529beb3a8df9186be84cff2dbbc31b9462a1be9ea  
apache-hive-2.3.9-src.tar.gz

Modified: release/hive/stable-2
==
--- release/hive/stable-2 (original)
+++ release/hive/stable-2 Wed Jun  9 18:30:30 2021
@@ -1 +1 @@
-link hive-2.3.8
\ No newline at end of file
+link hive-2.3.9
\ No newline at end of file

[hive] annotated tag rel/release-2.3.9 updated (92dd015 -> 81691c2)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag rel/release-2.3.9
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag rel/release-2.3.9 was modified! ***

from 92dd015  (commit)
  to 81691c2  (tag)
 tagging 34a7708e5ac5e53c1160bc00d50159480e16c6c0 (tag)
  length 161 bytes
  by Chao Sun
  on Wed Jun 9 10:43:51 2021 -0700

- Log -
Hive 2.3.9 release.
---


No new revisions were added by this update.

Summary of changes:

[hive] annotated tag release-2.3.9-rc0 updated (92dd015 -> 34a7708)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.9-rc0
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag release-2.3.9-rc0 was modified! ***

from 92dd015  (commit)
  to 34a7708  (tag)
 tagging 92dd0159f440ca7863be3232f3a683a510a62b9d (commit)
 replaces rel/release-2.3.8
  by Chao Sun
  on Tue Jun 1 13:53:51 2021 -0700

- Log -
Hive 2.3.9-rc0 release.
---


No new revisions were added by this update.

Summary of changes:

[hive] branch branch-2.3 updated (1ffe2ab -> 92dd015)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 1ffe2ab  HIVE-19228: Remove commons-httpclient 3.x usage (Janaki 
Lahorani reviewed by Aihua Xu)
 add b1c779a  Preparing for 2.3.9 release
 add 92dd015  Updated release notes for 2.3.9 release

No new revisions were added by this update.

Summary of changes:
 RELEASE_NOTES.txt| 19 ---
 accumulo-handler/pom.xml |  2 +-
 beeline/pom.xml  |  2 +-
 cli/pom.xml  |  2 +-
 common/pom.xml   |  2 +-
 contrib/pom.xml  |  2 +-
 druid-handler/pom.xml|  2 +-
 hbase-handler/pom.xml|  2 +-
 hcatalog/core/pom.xml|  2 +-
 hcatalog/hcatalog-pig-adapter/pom.xml|  2 +-
 hcatalog/pom.xml |  2 +-
 hcatalog/server-extensions/pom.xml   |  2 +-
 hcatalog/streaming/pom.xml   |  2 +-
 hcatalog/webhcat/java-client/pom.xml |  2 +-
 hcatalog/webhcat/svr/pom.xml |  2 +-
 hplsql/pom.xml   |  2 +-
 itests/custom-serde/pom.xml  |  2 +-
 itests/custom-udfs/pom.xml   |  2 +-
 itests/custom-udfs/udf-classloader-udf1/pom.xml  |  2 +-
 itests/custom-udfs/udf-classloader-udf2/pom.xml  |  2 +-
 itests/custom-udfs/udf-classloader-util/pom.xml  |  2 +-
 itests/custom-udfs/udf-vectorized-badexample/pom.xml |  2 +-
 itests/hcatalog-unit/pom.xml |  2 +-
 itests/hive-blobstore/pom.xml|  2 +-
 itests/hive-jmh/pom.xml  |  2 +-
 itests/hive-minikdc/pom.xml  |  2 +-
 itests/hive-unit-hadoop2/pom.xml |  2 +-
 itests/hive-unit/pom.xml |  2 +-
 itests/pom.xml   |  2 +-
 itests/qtest-accumulo/pom.xml|  2 +-
 itests/qtest-spark/pom.xml   |  2 +-
 itests/qtest/pom.xml |  2 +-
 itests/test-serde/pom.xml|  2 +-
 itests/util/pom.xml  |  2 +-
 jdbc-handler/pom.xml |  2 +-
 jdbc/pom.xml |  2 +-
 llap-client/pom.xml  |  2 +-
 llap-common/pom.xml  |  2 +-
 llap-ext-client/pom.xml  |  2 +-
 llap-server/pom.xml  |  2 +-
 llap-tez/pom.xml |  2 +-
 metastore/pom.xml|  2 +-
 packaging/pom.xml|  2 +-
 pom.xml  |  2 +-
 ql/pom.xml   |  2 +-
 serde/pom.xml|  2 +-
 service-rpc/pom.xml  |  2 +-
 service/pom.xml  |  2 +-
 shims/0.23/pom.xml   |  2 +-
 shims/aggregator/pom.xml |  2 +-
 shims/common/pom.xml |  2 +-
 shims/pom.xml|  2 +-
 shims/scheduler/pom.xml  |  2 +-
 spark-client/pom.xml |  4 ++--
 testutils/pom.xml|  2 +-
 vector-code-gen/pom.xml  |  2 +-
 56 files changed, 64 insertions(+), 67 deletions(-)

[hive] branch branch-2.3 updated (9880ee6 -> 1ffe2ab)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 9880ee6  HIVE-21200: Vectorization: date column throwing 
java.lang.UnsupportedOperationException for parquet (#2276)
 add 1ffe2ab  HIVE-19228: Remove commons-httpclient 3.x usage (Janaki 
Lahorani reviewed by Aihua Xu)

No new revisions were added by this update.

Summary of changes:
 pom.xml  |  6 --
 ql/pom.xml   | 15 ---
 .../hadoop/hive/ql/parse/LoadSemanticAnalyzer.java   | 16 +++-
 shims/common/pom.xml |  6 ++
 4 files changed, 17 insertions(+), 26 deletions(-)

[hive] branch branch-2.3 updated: HIVE-21200: Vectorization: date column throwing java.lang.UnsupportedOperationException for parquet (#2276)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 9880ee6  HIVE-21200: Vectorization: date column throwing 
java.lang.UnsupportedOperationException for parquet (#2276)
9880ee6 is described below

commit 9880ee69b327efbd791d5b021115fee3e51903d2
Author: Daoyuan Wang 
AuthorDate: Sun May 16 01:15:50 2021 +0800

HIVE-21200: Vectorization: date column throwing 
java.lang.UnsupportedOperationException for parquet (#2276)
---
 .../vector/VectorizedPrimitiveColumnReader.java|  2 +-
 .../ql/io/parquet/TestVectorizedColumnReader.java  |  5 
 .../io/parquet/VectorizedColumnReaderTestBase.java | 33 +-
 3 files changed, 38 insertions(+), 2 deletions(-)

diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/vector/VectorizedPrimitiveColumnReader.java
 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/vector/VectorizedPrimitiveColumnReader.java
index 3d5c6e6..a0e9484 100644
--- 
a/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/vector/VectorizedPrimitiveColumnReader.java
+++ 
b/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/vector/VectorizedPrimitiveColumnReader.java
@@ -168,9 +168,9 @@ public class VectorizedPrimitiveColumnReader implements 
VectorizedColumnReader {
 case INT:
 case BYTE:
 case SHORT:
+case DATE:
   readIntegers(num, (LongColumnVector) column, rowId);
   break;
-case DATE:
 case INTERVAL_YEAR_MONTH:
 case LONG:
   readLongs(num, (LongColumnVector) column, rowId);
diff --git 
a/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/TestVectorizedColumnReader.java
 
b/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/TestVectorizedColumnReader.java
index 670bfa6..435acda 100644
--- 
a/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/TestVectorizedColumnReader.java
+++ 
b/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/TestVectorizedColumnReader.java
@@ -57,6 +57,11 @@ public class TestVectorizedColumnReader extends 
VectorizedColumnReaderTestBase {
   }
 
   @Test
+  public void testDateRead() throws Exception {
+dateRead(isDictionaryEncoding);
+  }
+
+  @Test
   public void testDoubleRead() throws Exception {
 doubleRead(isDictionaryEncoding);
   }
diff --git 
a/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/VectorizedColumnReaderTestBase.java
 
b/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/VectorizedColumnReaderTestBase.java
index f537cee..8fce9f1 100644
--- 
a/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/VectorizedColumnReaderTestBase.java
+++ 
b/ql/src/test/org/apache/hadoop/hive/ql/io/parquet/VectorizedColumnReaderTestBase.java
@@ -79,6 +79,7 @@ public class VectorizedColumnReaderTestBase {
   + "required int32 int32_field; "
   + "required int64 int64_field; "
   + "required int96 int96_field; "
+  + "required int32 date_field; "
   + "required double double_field; "
   + "required float float_field; "
   + "required boolean boolean_field; "
@@ -246,7 +247,8 @@ public class VectorizedColumnReaderTestBase {
 .append("double_field", doubleVal)
 .append("float_field", floatVal)
 .append("boolean_field", booleanVal)
-.append("flba_field", "abc");
+.append("flba_field", "abc")
+.append("date_field", intVal);
 
   if (!isNull) {
 group.append("some_null_field", "x");
@@ -372,6 +374,35 @@ public class VectorizedColumnReaderTestBase {
 }
   }
 
+  protected void dateRead(boolean isDictionaryEncoding) throws 
InterruptedException, HiveException, IOException {
+Configuration conf = new Configuration();
+conf.set(IOConstants.COLUMNS,"date_field");
+conf.set(IOConstants.COLUMNS_TYPES,"date");
+conf.setBoolean(ColumnProjectionUtils.READ_ALL_COLUMNS, false);
+conf.set(ColumnProjectionUtils.READ_COLUMN_IDS_CONF_STR, "0");
+VectorizedParquetRecordReader reader =
+createParquetReader("message test { required int date_field;}", 
conf);
+VectorizedRowBatch previous = reader.createValue();
+try {
+  int c = 0;
+  while (reader.next(NullWritable.get(), previous)) {
+LongColumnVector vector = (LongColumnVector) previous.cols[0];
+assertTrue(vector.noNulls);
+for (int i = 0; i < vector.vector.length; i++) {
+  if (c == nElements){
+break;
+  }
+  assertEquals("Failed at " + c, getIntValue(isDictionaryEncoding, c), 
vector.vector[i]);
+  assertFalse(vector.isNull[i]);
+  c++;
+}
+  }
+  assertEquals(nElements, c);
+} finally {
+  reader.close();
+}
+  }
+
   protected void doubleRead(boolean isDictionaryEncoding) throws Exception {
 Configuration conf = new Configuration();
 conf.set(IOConstants.COLUMNS, "double_field");

[hive] branch branch-2.3 updated: HIVE-24608: Switch back to get_table in HMS client for Hive 2.3.x (#2080)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new c78ff81  HIVE-24608: Switch back to get_table in HMS client for Hive 
2.3.x (#2080)
c78ff81 is described below

commit c78ff81915ff3f54d3b1e7c3ce1f11a6fdf749b2
Author: Chao Sun 
AuthorDate: Fri May 14 10:03:58 2021 -0700

HIVE-24608: Switch back to get_table in HMS client for Hive 2.3.x (#2080)
---
 common/src/java/org/apache/hadoop/hive/conf/HiveConf.java |  2 +-
 .../apache/hadoop/hive/metastore/HiveMetaStoreClient.java | 15 +++
 2 files changed, 4 insertions(+), 13 deletions(-)

diff --git a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
index 412e7d0..46a7430 100644
--- a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
+++ b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
@@ -601,7 +601,7 @@ public class HiveConf extends Configuration {
 METASTOREURIS("hive.metastore.uris", "",
 "Thrift URI for the remote metastore. Used by metastore client to 
connect to remote metastore."),
 
-METASTORE_CAPABILITY_CHECK("hive.metastore.client.capability.check", true,
+METASTORE_CAPABILITY_CHECK("hive.metastore.client.capability.check", false,
 "Whether to check client capabilities for potentially breaking API 
usage."),
 METASTORE_FASTPATH("hive.metastore.fastpath", false,
 "Used to avoid all of the proxies and object copies in the metastore.  
Note, if this is " +
diff --git 
a/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java 
b/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
index 971a8a4..53d97ff 100644
--- 
a/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
+++ 
b/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java
@@ -121,7 +121,6 @@ public class HiveMetaStoreClient implements 
IMetaStoreClient {
   // for thrift connects
   private int retries = 5;
   private long retryDelaySeconds = 0;
-  private final ClientCapabilities version;
 
   static final protected Logger LOG = 
LoggerFactory.getLogger("hive.metastore");
 
@@ -143,7 +142,6 @@ public class HiveMetaStoreClient implements 
IMetaStoreClient {
 } else {
   this.conf = new HiveConf(conf);
 }
-version = HiveConf.getBoolVar(conf, ConfVars.HIVE_IN_TEST) ? TEST_VERSION 
: VERSION;
 filterHook = loadFilterHooks();
 fileMetadataBatchSize = HiveConf.getIntVar(
 conf, HiveConf.ConfVars.METASTORE_BATCH_RETRIEVE_OBJECTS_MAX);
@@ -1345,9 +1343,7 @@ public class HiveMetaStoreClient implements 
IMetaStoreClient {
   @Override
   public Table getTable(String dbname, String name) throws MetaException,
   TException, NoSuchObjectException {
-GetTableRequest req = new GetTableRequest(dbname, name);
-req.setCapabilities(version);
-Table t = client.get_table_req(req).getTable();
+Table t = client.get_table(dbname, name);
 return fastpath ? t : deepCopy(filterHook.filterTable(t));
   }
 
@@ -1364,10 +1360,7 @@ public class HiveMetaStoreClient implements 
IMetaStoreClient {
   @Override
   public List getTableObjectsByName(String dbName, List 
tableNames)
   throws MetaException, InvalidOperationException, UnknownDBException, 
TException {
-GetTablesRequest req = new GetTablesRequest(dbName);
-req.setTblNames(tableNames);
-req.setCapabilities(version);
-List tabs = client.get_table_objects_by_name_req(req).getTables();
+List tabs = client.get_table_objects_by_name(dbName, tableNames);
 return fastpath ? tabs : deepCopyTables(filterHook.filterTables(tabs));
   }
 
@@ -1459,9 +1452,7 @@ public class HiveMetaStoreClient implements 
IMetaStoreClient {
   public boolean tableExists(String databaseName, String tableName) throws 
MetaException,
   TException, UnknownDBException {
 try {
-  GetTableRequest req = new GetTableRequest(databaseName, tableName);
-  req.setCapabilities(version);
-  return filterHook.filterTable(client.get_table_req(req).getTable()) != 
null;
+  return filterHook.filterTable(client.get_table(databaseName, tableName)) 
!= null;
 } catch (NoSuchObjectException e) {
   return false;
 }

[hive] branch branch-2.3 updated (b358f65 -> 61070b9)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from b358f65  Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
 add 61070b9  HIVE-18147 : Tests can fail with java.net.BindException: 
Address already in use (Janaki Lahorani, reviewed by Andrew Sherman and Vihang 
Karajgaonkar)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/hive/hcatalog/cli/TestPermsGrp.java |  4 +--
 .../mapreduce/TestHCatPartitionPublish.java|  4 +--
 .../hive/hcatalog/templeton/TestWebHCatE2e.java| 41 +++---
 .../AbstractTestAuthorizationApiAuthorizer.java|  3 +-
 .../hadoop/hive/metastore/TestFilterHooks.java |  3 +-
 .../metastore/TestHiveMetaStoreStatsMerge.java |  3 +-
 .../TestHiveMetaStoreWithEnvironmentContext.java   |  3 +-
 .../TestMetaStoreEndFunctionListener.java  |  3 +-
 .../hive/metastore/TestMetaStoreEventListener.java |  3 +-
 .../TestMetaStoreEventListenerOnlyOnCommit.java|  3 +-
 .../hive/metastore/TestMetaStoreInitListener.java  |  3 +-
 .../hive/metastore/TestMetaStoreMetrics.java   |  7 ++--
 .../hive/metastore/TestRemoteHiveMetaStore.java|  3 +-
 .../TestRemoteHiveMetaStoreIpAddress.java  |  5 ++-
 .../hive/metastore/TestRetryingHMSHandler.java |  3 +-
 .../TestDDLWithRemoteMetastoreSecondNamenode.java  |  3 +-
 .../hive/ql/security/FolderPermissionBase.java |  3 +-
 .../ql/security/StorageBasedMetastoreTestBase.java |  5 +--
 .../TestAuthorizationPreEventListener.java |  4 +--
 .../TestClientSideAuthorizationProvider.java   |  4 +--
 .../TestMetastoreAuthorizationProvider.java|  5 +--
 .../TestMultiAuthorizationPreEventListener.java|  6 +---
 .../thrift/ThriftCliServiceMessageSizeTest.java| 24 ++---
 .../java/org/apache/hive/jdbc/miniHS2/MiniHS2.java | 37 +++
 .../hadoop/hive/metastore/MetaStoreUtils.java  | 33 +
 .../cli/thrift/ThriftCliServiceTestWithCookie.java | 25 ++---
 26 files changed, 155 insertions(+), 85 deletions(-)

[hive] branch branch-3 updated: Improve Table#getEmptyTable performance by disabling registerAllFunctionsOnce (#2251)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-3 by this push:
 new fd870ef  Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
fd870ef is described below

commit fd870ef84926f4090ff4da57e1439e195fb24b9d
Author: Yuming Wang 
AuthorDate: Fri May 7 13:31:46 2021 +0800

Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
---
 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java| 7 +++
 ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java | 2 +-
 2 files changed, 8 insertions(+), 1 deletion(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 
b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
index 08d257d..6ca82a6 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
@@ -350,6 +350,13 @@ public class Hive {
 return getInternal(c, false, true, doRegisterAllFns);
   }
 
+  /**
+   * Same as {@link #get(HiveConf)}, except that it does not register all 
functions.
+   */
+  public static Hive getWithoutRegisterFns(HiveConf c) throws HiveException {
+return getInternal(c, false, false, false);
+  }
+
   private static Hive getInternal(HiveConf c, boolean needsRefresh, boolean 
isFastCheck,
   boolean doRegisterAllFns) throws HiveException {
 Hive db = hiveDB.get();
diff --git a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 
b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
index 8e6554c..56c32e8 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
@@ -961,7 +961,7 @@ public class SessionState {
 authorizerV2.applyAuthorizationConfigPolicy(sessionConf);
 // update config in Hive thread local as well and init the metastore client
 try {
-  Hive.get(sessionConf).getMSC();
+  Hive.getWithoutRegisterFns(sessionConf).getMSC();
 } catch (Exception e) {
   // catch-all due to some exec time dependencies on session state
   // that would cause ClassNoFoundException otherwise

[hive] branch branch-3.1 updated: Improve Table#getEmptyTable performance by disabling registerAllFunctionsOnce (#2251)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-3.1 by this push:
 new b46b025  Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
b46b025 is described below

commit b46b02524cbcef92eca346ffa5a9e9bba83776e3
Author: Yuming Wang 
AuthorDate: Fri May 7 13:31:46 2021 +0800

Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
---
 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java| 7 +++
 ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java | 2 +-
 2 files changed, 8 insertions(+), 1 deletion(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 
b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
index ea200c8..4d2e1a4 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
@@ -347,6 +347,13 @@ public class Hive {
 return getInternal(c, false, true, doRegisterAllFns);
   }
 
+  /**
+   * Same as {@link #get(HiveConf)}, except that it does not register all 
functions.
+   */
+  public static Hive getWithoutRegisterFns(HiveConf c) throws HiveException {
+return getInternal(c, false, false, false);
+  }
+
   private static Hive getInternal(HiveConf c, boolean needsRefresh, boolean 
isFastCheck,
   boolean doRegisterAllFns) throws HiveException {
 Hive db = hiveDB.get();
diff --git a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 
b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
index a3fde34..7a5866c 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
@@ -957,7 +957,7 @@ public class SessionState {
 authorizerV2.applyAuthorizationConfigPolicy(sessionConf);
 // update config in Hive thread local as well and init the metastore client
 try {
-  Hive.get(sessionConf).getMSC();
+  Hive.getWithoutRegisterFns(sessionConf).getMSC();
 } catch (Exception e) {
   // catch-all due to some exec time dependencies on session state
   // that would cause ClassNoFoundException otherwise

[hive] branch branch-2.3 updated: Improve Table#getEmptyTable performance by disabling registerAllFunctionsOnce (#2251)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new b358f65  Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
b358f65 is described below

commit b358f650479fa1e4f1f273a6a8ca38f3e77fc5ef
Author: Yuming Wang 
AuthorDate: Fri May 7 13:31:46 2021 +0800

Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)
---
 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java| 7 +++
 ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java | 2 +-
 2 files changed, 8 insertions(+), 1 deletion(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 
b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
index f64cfda..cc5712d 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java
@@ -304,6 +304,13 @@ public class Hive {
 return getInternal(c, false, true, doRegisterAllFns);
   }
 
+  /**
+   * Same as {@link #get(HiveConf)}, except that it does not register all 
functions.
+   */
+  public static Hive getWithoutRegisterFns(HiveConf c) throws HiveException {
+return getInternal(c, false, false, false);
+  }
+
   private static Hive getInternal(HiveConf c, boolean needsRefresh, boolean 
isFastCheck,
   boolean doRegisterAllFns) throws HiveException {
 Hive db = hiveDB.get();
diff --git a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 
b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
index 33f01d6..8efc531 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
@@ -914,7 +914,7 @@ public class SessionState {
 authorizerV2.applyAuthorizationConfigPolicy(sessionConf);
 // update config in Hive thread local as well and init the metastore client
 try {
-  Hive.get(sessionConf).getMSC();
+  Hive.getWithoutRegisterFns(sessionConf).getMSC();
 } catch (Exception e) {
   // catch-all due to some exec time dependencies on session state
   // that would cause ClassNoFoundException otherwise

[hive] branch master updated (073ca77 -> 2b196f1)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 073ca77  HIVE-24900: Failed compaction does not cleanup the 
directories (Ramesh Kumar Thangarajan, reviewed by Gopal V, Karen Coppage, 
Peter Varga, Denys Kuzmenko)
 add 2b196f1  Improve Table#getEmptyTable performance by disabling 
registerAllFunctionsOnce (#2251)

No new revisions were added by this update.

Summary of changes:
 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java| 7 +++
 ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java | 2 +-
 2 files changed, 8 insertions(+), 1 deletion(-)

[hive] branch master updated (a00621b -> 86fa9b3)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from a00621b  HIVE-24929: Allow correlated exists subqueries with windowing 
clause (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez)
 add 86fa9b3  HIVE-24922: Remove redundant code and improve readability 
(#2103)

No new revisions were added by this update.

Summary of changes:
 .../java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java   | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)

[hive] branch branch-2.3 updated: HIVE-24797: Disable validate default values when parsing Avro schemas (#1994)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 324f9fa  HIVE-24797: Disable validate default values when parsing Avro 
schemas (#1994)
324f9fa is described below

commit 324f9faf12d4b91a9359391810cb3312c004d356
Author: Yuming Wang 
AuthorDate: Wed Feb 24 01:59:51 2021 +0800

HIVE-24797: Disable validate default values when parsing Avro schemas 
(#1994)
---
 .../org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java | 14 --
 1 file changed, 8 insertions(+), 6 deletions(-)

diff --git 
a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java 
b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
index 79d31c7..0de690c 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
@@ -263,17 +263,20 @@ public class AvroSerdeUtils {
 return dec;
   }
 
+  private static Schema.Parser getSchemaParser() {
+// HIVE-24797: Disable validate default values when parsing Avro schemas.
+return new Schema.Parser().setValidateDefaults(false);
+  }
+
   public static Schema getSchemaFor(String str) {
-Schema.Parser parser = new Schema.Parser();
-Schema schema = parser.parse(str);
+Schema schema = getSchemaParser().parse(str);
 return schema;
   }
 
   public static Schema getSchemaFor(File file) {
-Schema.Parser parser = new Schema.Parser();
 Schema schema;
 try {
-  schema = parser.parse(file);
+  schema = getSchemaParser().parse(file);
 } catch (IOException e) {
   throw new RuntimeException("Failed to parse Avro schema from " + 
file.getName(), e);
 }
@@ -281,10 +284,9 @@ public class AvroSerdeUtils {
   }
 
   public static Schema getSchemaFor(InputStream stream) {
-Schema.Parser parser = new Schema.Parser();
 Schema schema;
 try {
-  schema = parser.parse(stream);
+  schema = getSchemaParser().parse(stream);
 } catch (IOException e) {
   throw new RuntimeException("Failed to parse Avro schema", e);
 }

[hive] branch master updated (fae1c83 -> 4dd2072)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from fae1c83  HIVE-24768: Using jackson bom everywhere, so that it'll be 
easy to ma… (#1969) (Sai Hemanth Gantasala, reviewed by Kevin Risden)
 add 4dd2072  HIVE-24797: Disable validate default values when parsing Avro 
schemas (#1994)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java | 14 --
 1 file changed, 8 insertions(+), 6 deletions(-)

[hive] branch branch-2.3 updated: HIVE-17155: findConfFile() in HiveConf.java has some issues with the conf path (Aihua Xu, reviewed by Yongzhi Chen) (#1820)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new d27bfae  HIVE-17155: findConfFile() in HiveConf.java has some issues 
with the conf path (Aihua Xu, reviewed by Yongzhi Chen) (#1820)
d27bfae is described below

commit d27bfaebf3949fa2bf490c48a4e0c59235d55060
Author: Chang chen 
AuthorDate: Sat Jan 30 06:45:22 2021 +0800

HIVE-17155: findConfFile() in HiveConf.java has some issues with the conf 
path (Aihua Xu, reviewed by Yongzhi Chen) (#1820)
---
 common/src/java/org/apache/hadoop/hive/conf/HiveConf.java | 12 +---
 1 file changed, 9 insertions(+), 3 deletions(-)

diff --git a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
index 41d12ce..412e7d0 100644
--- a/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
+++ b/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
@@ -161,19 +161,25 @@ public class HiveConf extends Configuration {
   result = checkConfigFile(new File(confPath, name));
   if (result == null) {
 String homePath = System.getenv("HIVE_HOME");
-String nameInConf = "conf" + File.pathSeparator + name;
+String nameInConf = "conf" + File.separator + name;
 result = checkConfigFile(new File(homePath, nameInConf));
 if (result == null) {
   URI jarUri = null;
   try {
-jarUri = 
HiveConf.class.getProtectionDomain().getCodeSource().getLocation().toURI();
+// Handle both file:// and jar:!{entry} in the case of shaded 
hive libs
+URL sourceUrl = 
HiveConf.class.getProtectionDomain().getCodeSource().getLocation();
+jarUri = sourceUrl.getProtocol().equalsIgnoreCase("jar") ? new 
URI(sourceUrl.getPath()) : sourceUrl.toURI();
   } catch (Throwable e) {
 if (l4j.isInfoEnabled()) {
   l4j.info("Cannot get jar URI", e);
 }
 System.err.println("Cannot get jar URI: " + e.getMessage());
   }
-  result = checkConfigFile(new File(new File(jarUri).getParentFile(), 
nameInConf));
+  // From the jar file, the parent is /lib folder
+  File parent = new File(jarUri).getParentFile();
+  if (parent != null) {
+result = checkConfigFile(new File(parent.getParentFile(), 
nameInConf));
+  }
 }
   }
 }

[hive] branch branch-2.3 updated: Preparing for 2.3.9 development.

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new c76d0ce  Preparing for 2.3.9 development.
c76d0ce is described below

commit c76d0cec600ebbfc774077ae3cef028a3d44c84e
Author: Chao Sun 
AuthorDate: Tue Jan 19 16:00:58 2021 -0800

Preparing for 2.3.9 development.
---
 accumulo-handler/pom.xml | 2 +-
 beeline/pom.xml  | 2 +-
 cli/pom.xml  | 2 +-
 common/pom.xml   | 2 +-
 contrib/pom.xml  | 2 +-
 druid-handler/pom.xml| 2 +-
 hbase-handler/pom.xml| 2 +-
 hcatalog/core/pom.xml| 2 +-
 hcatalog/hcatalog-pig-adapter/pom.xml| 2 +-
 hcatalog/pom.xml | 2 +-
 hcatalog/server-extensions/pom.xml   | 2 +-
 hcatalog/streaming/pom.xml   | 2 +-
 hcatalog/webhcat/java-client/pom.xml | 2 +-
 hcatalog/webhcat/svr/pom.xml | 2 +-
 hplsql/pom.xml   | 2 +-
 itests/custom-serde/pom.xml  | 2 +-
 itests/custom-udfs/pom.xml   | 2 +-
 itests/custom-udfs/udf-classloader-udf1/pom.xml  | 2 +-
 itests/custom-udfs/udf-classloader-udf2/pom.xml  | 2 +-
 itests/custom-udfs/udf-classloader-util/pom.xml  | 2 +-
 itests/custom-udfs/udf-vectorized-badexample/pom.xml | 2 +-
 itests/hcatalog-unit/pom.xml | 2 +-
 itests/hive-blobstore/pom.xml| 2 +-
 itests/hive-jmh/pom.xml  | 2 +-
 itests/hive-minikdc/pom.xml  | 2 +-
 itests/hive-unit-hadoop2/pom.xml | 2 +-
 itests/hive-unit/pom.xml | 2 +-
 itests/pom.xml   | 2 +-
 itests/qtest-accumulo/pom.xml| 2 +-
 itests/qtest-spark/pom.xml   | 2 +-
 itests/qtest/pom.xml | 2 +-
 itests/test-serde/pom.xml| 2 +-
 itests/util/pom.xml  | 2 +-
 jdbc-handler/pom.xml | 2 +-
 jdbc/pom.xml | 2 +-
 llap-client/pom.xml  | 2 +-
 llap-common/pom.xml  | 2 +-
 llap-ext-client/pom.xml  | 2 +-
 llap-server/pom.xml  | 2 +-
 llap-tez/pom.xml | 2 +-
 metastore/pom.xml| 2 +-
 packaging/pom.xml| 2 +-
 pom.xml  | 2 +-
 ql/pom.xml   | 2 +-
 serde/pom.xml| 2 +-
 service-rpc/pom.xml  | 2 +-
 service/pom.xml  | 2 +-
 shims/0.23/pom.xml   | 2 +-
 shims/aggregator/pom.xml | 2 +-
 shims/common/pom.xml | 2 +-
 shims/pom.xml| 2 +-
 shims/scheduler/pom.xml  | 2 +-
 spark-client/pom.xml | 4 ++--
 testutils/pom.xml| 2 +-
 vector-code-gen/pom.xml  | 2 +-
 55 files changed, 56 insertions(+), 56 deletions(-)

diff --git a/accumulo-handler/pom.xml b/accumulo-handler/pom.xml
index 00c3415..829cc36 100644
--- a/accumulo-handler/pom.xml
+++ b/accumulo-handler/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.8
+2.3.9-SNAPSHOT
 ../pom.xml
   
 
diff --git a/beeline/pom.xml b/beeline/pom.xml
index 971a631..bc4a8d2 100644
--- a/beeline/pom.xml
+++ b/beeline/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.8
+2.3.9-SNAPSHOT
 ../pom.xml
   
 
diff --git a/cli/pom.xml b/cli/pom.xml
index 4be8e0a..cccd005 100644
--- a/cli/pom.xml
+++ b/cli/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.8
+2.3.9-SNAPSHOT
 ../pom.xml
   
 
diff --git a/common/pom.xml b/common/pom.xml
index 068af92..98204f4 100644
--- a/common/pom.xml
+++ b/common/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.8
+2.3.9-SNAPSHOT
 ../pom.xml
   
 
diff --git a/contrib/pom.xml b/contrib/pom.xml
index 97acbe7..a2fcfb9 100644
--- a/contrib/pom.xml
+++ b/contrib/pom.xml
@@ -19,7 +19,7 @@
   
 org.apache.hive
 hive
-2.3.8

svn commit: r1070356 - in /websites/production/hive/content: ./ javadocs/

[sunchao]

Author: sunchao
Date: Tue Jan 19 23:18:16 2021
New Revision: 1070356

Log:
Hive 2.3.8 release

Added:
websites/production/hive/content/
  - copied from r1070355, websites/staging/hive/trunk/content/
websites/production/hive/content/javadocs/
  - copied from r1070355, websites/production/hive/content/javadocs/

svn commit: r1885615 - in /hive/cms/trunk/content: downloads.mdtext javadoc.mdtext

[sunchao]

Author: sunchao
Date: Sun Jan 17 17:37:15 2021
New Revision: 1885615

URL: http://svn.apache.org/viewvc?rev=1885615&view=rev
Log:
Hive 2.3.8 release

Modified:
hive/cms/trunk/content/downloads.mdtext
hive/cms/trunk/content/javadoc.mdtext

Modified: hive/cms/trunk/content/downloads.mdtext
URL: 
http://svn.apache.org/viewvc/hive/cms/trunk/content/downloads.mdtext?rev=1885615&r1=1885614&r2=1885615&view=diff
==
--- hive/cms/trunk/content/downloads.mdtext (original)
+++ hive/cms/trunk/content/downloads.mdtext Sun Jan 17 17:37:15 2021
@@ -11,6 +11,10 @@ directory.
 
 
 ## News
+### 17 January 2021: release 2.3.8 available
+This release works with Hadoop 2.x.y
+You can look at the complete [JIRA change log for this release][HIVE_2_3_8_CL].
+
 ### 18 April 2020: release 2.3.7 available
 This release works with Hadoop 2.x.y
 You can look at the complete [JIRA change log for this release][HIVE_2_3_7_CL].
@@ -158,6 +162,7 @@ You can look at the complete [JIRA chang
 
 [HIVE_DL]: http://www.apache.org/dyn/closer.cgi/hive/
 [HIVE_3_1_2_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12344397&styleName=Html&projectId=12310843
+[HIVE_2_3_8_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12349428&styleName=Text&projectId=12310843
 [HIVE_2_3_7_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346056&styleName=Text&projectId=12310843
 [HIVE_2_3_6_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345603&styleName=Text&projectId=12310843
 [HIVE_2_3_5_CL]: 
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345394&styleName=Text&projectId=12310843

Modified: hive/cms/trunk/content/javadoc.mdtext
URL: 
http://svn.apache.org/viewvc/hive/cms/trunk/content/javadoc.mdtext?rev=1885615&r1=1885614&r2=1885615&view=diff
==
--- hive/cms/trunk/content/javadoc.mdtext (original)
+++ hive/cms/trunk/content/javadoc.mdtext Sun Jan 17 17:37:15 2021
@@ -4,7 +4,7 @@ Recent versions:
 
   * [Hive 3.1.2 Javadocs][r3.1.2]
   * [Hive 3.0.0 Javadocs][r3.0.0]
-  * [Hive 2.3.7 Javadocs][r2.3.7]
+  * [Hive 2.3.8 Javadocs][r2.3.8]
   * [Hive 2.2.0 Javadocs][r2.2.0]
   * [Hive 2.1.1 Javadocs][r2.1.1]
   * [Hive 1.2.2 Javadocs][r1.2.2]
@@ -20,7 +20,7 @@ javadoc and sources jars for use in an I
 
 [r3.1.2]: /javadocs/r3.1.2/api/index.html
 [r3.0.0]: /javadocs/r3.0.0/api/index.html
-[r2.3.7]: /javadocs/r2.3.7/api/index.html
+[r2.3.8]: /javadocs/r2.3.8/api/index.html
 [r2.2.0]: /javadocs/r2.2.0/api/index.html
 [r2.1.1]: /javadocs/r2.1.1/api/index.html
 [r1.2.2]: /javadocs/r1.2.2/api/index.html

svn commit: r1070246 - in /websites/production/hive/content/javadocs: r2.3.7/ r2.3.8/ r2.3.8/api/ r2.3.8/api/org/ r2.3.8/api/org/apache/ r2.3.8/api/org/apache/hadoop/ r2.3.8/api/org/apache/hadoop/fs/

[sunchao]

Author: sunchao
Date: Sun Jan 17 01:39:41 2021
New Revision: 1070246

Log:
Hive 2.3.8 release


[This commit notification would consist of 4090 parts, 
which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r45450 - in /release/hive: ./ hive-2.3.7/ hive-2.3.8/

[sunchao]

Author: sunchao
Date: Fri Jan 15 21:12:32 2021
New Revision: 45450

Log:
Hive 2.3.8 release distribution

Added:
release/hive/hive-2.3.8/
release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz   (with props)
release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.asc
release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.sha256
release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz   (with props)
release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.asc
release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.sha256
Removed:
release/hive/hive-2.3.7/
Modified:
release/hive/stable-2

Added: release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz
==
Binary file - no diff available.

Propchange: release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz
--
svn:mime-type = application/octet-stream

Added: release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.asc
==
--- release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.asc (added)
+++ release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.asc Fri Jan 15 
21:12:32 2021
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCAAdFiEE3n+iQespjQJ8l7Kh2PGpe+UeypgFAl/3mEkACgkQ2PGpe+Ue
+yphRTA/8CZ8VMHHHf8/CFo4hvuv99BI6H6EPhUT6xeXnrHHYzJRoanLEh6QEKkoz
+Ge0ip74nxkEYr9UJS47Er6pa8HG/5XZ3OoEaXJ77rSpkEA/+S9Yft0ffkeGkQIxo
+EQRPYEpggJjME7uNn9yLw9W7T3EvvWUS1sJhUvzv9MkksVmI7wonKxNifqQHzd8g
+6mgozzD34mK6kbmZeYbNBfgdspjwJ0wMMpPV4F5B9WbBitEUY9M/q9SmDotyiLYB
+X78bMiTHvmyTSP4x6/1Fow5xc/6twRka+sBmWZyZhTc8JMc2+B89VILAVhpcqP4r
+4uzK5+SluiDs6uj1aFPnArgPoL531VMc7vEYqeqJAlnIghpm75jUm4RTUJ+S6u3v
+MYRYQJQKHyE2isZ4TT4Uo3qEjQQiXwJ3VLAl9ox/46S/gu/9gQZxZgc40m2QeTtf
+1cxT8ACmkGkWCyy8MRR/tRI9fAFtCnfY1AVwrM0e5+IxgZHoe4qdf+2xlu1huK2Q
+22oTtbyYAUkFW7RQpi67nbvE7XxP68e5p8k7bASRikYDFyulWW9nqE3LHY/jV7Nx
+0cgMqUdsd6vIjAlzA+e2zzWiHUne9HiszfvvLOh+knE6wMlZ0yFfBxBJTrYbh9UR
+PnkXep8/8oETFcqn+DTI2rjS9Jx0HvCqYS8log78V6nTtHaxCLU=
+=7IFZ
+-END PGP SIGNATURE-

Added: release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.sha256
==
--- release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.sha256 (added)
+++ release/hive/hive-2.3.8/apache-hive-2.3.8-bin.tar.gz.sha256 Fri Jan 15 
21:12:32 2021
@@ -0,0 +1 @@
+3746528298fb70938e30bfbb66f756d1810acafbe86ba84edef7bd3455589176  
apache-hive-2.3.8-bin.tar.gz

Added: release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz
==
Binary file - no diff available.

Propchange: release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz
--
svn:mime-type = application/octet-stream

Added: release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.asc
==
--- release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.asc (added)
+++ release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.asc Fri Jan 15 
21:12:32 2021
@@ -0,0 +1,16 @@
+-BEGIN PGP SIGNATURE-
+
+iQIzBAABCAAdFiEE3n+iQespjQJ8l7Kh2PGpe+UeypgFAl/3mkIACgkQ2PGpe+Ue
+yphFRBAAuQfwnpaBFBGDim/hPqKvdik+Otz2QdWTAvkUB5pQcsptZADA4BItqeNB
+StHEn/aM9qL3QA3wMovPAqO4NlD6ZdP0aBLrFVBV131VuOy9gi0AutSIS65GmLsX
+LaPTMBLGkJclxH4M3hSb2NgjCAENKsjlK+iHaoOmVTxNU8vWRVm0Fx9UvfVfsPuK
+Ce7kMZwgGEfZjnvc1OLw0ZlKUWGNvEAtRNxE4u18+fU+bZe/1kky01NxVT8obBht
+4CgUWowfyrZINNI7eRo1UmwtyLG3cdtoAyVA+wIBPdy8ImxtjckX7SYRnLlNL1fG
+vdzAye3cTG8D1QLX3FGr06qpl7gdaTRbGV6zjyV5HNx7D1O4U+yyDmpSh7IlUqdz
+ofr9z7NQCklD3WaQRPNJ3p6E/9YNom+FMuzKvpENnjiHJ67XMsdLhoNpaTlUzoPW
+2pFr3o3TOfPjGfsRk2/+HcWmpTefUUovnKI/dC2JgDS7ONFNzKaIbPuJCOyuEu1I
+fYPSM/9L0IJEOjkeyoB1wieBZYj4PgsiDogfhSvwVLq40414sahv5xhbDA+c67Sa
+jyodbRLjPB1SF55GIWIQztYfp+FpAUxQiUfBk76o6a/WzbGbdCF5jbDK9TsgqfbP
+Hes8kTUVxS/Nh1uNqsghbP773tYmz9dBKU8Q0jSm4bG50bBP16M=
+=xb0u
+-END PGP SIGNATURE-

Added: release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.sha256
==
--- release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.sha256 (added)
+++ release/hive/hive-2.3.8/apache-hive-2.3.8-src.tar.gz.sha256 Fri Jan 15 
21:12:32 2021
@@ -0,0 +1 @@
+db40355526a97213d15e72dc2e8c4af638320681d88b3322092687b4652cef27  
apache-hive-2.3.8-src.tar.gz

Modified: release/hive/stable-2
==
--- release/hive/stable-2 (original)
+++ release/hive/stable-2 Fri Jan 15 21:12:32 2021
@@ -1 +1 @@
-link hive-2.3.7
\ No newline at end of file
+link hive-2.3.8
\ No newline at end of file

[hive] annotated tag rel/release-2.3.8 updated (f1e8713 -> 248a61b)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag rel/release-2.3.8
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag rel/release-2.3.8 was modified! ***

from f1e8713  (commit)
  to 248a61b  (tag)
 tagging f1e87137034e4ecbe39a859d4ef44319800016d7 (commit)
 replaces release-2.3.8-rc2
  by Chao Sun
  on Fri Jan 15 11:28:38 2021 -0800

- Log -
Hive-2.3.8 release.
---


No new revisions were added by this update.

Summary of changes:

[hive] annotated tag release-2.3.8-rc3 updated (a97da0d -> d3d6319)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.8-rc3
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag release-2.3.8-rc3 was modified! ***

from a97da0d  (tag)
  to d3d6319  (tag)
 tagging f1e87137034e4ecbe39a859d4ef44319800016d7 (commit)
 replaces release-2.3.8-rc2
  by Chao Sun
  on Fri Jan 8 22:40:15 2021 -0800

- Log -
Hive 2.3.8-rc3 release.
---

 discard 1494f19  Updated release notes for 2.3.8 release RC3
 add 9fbcfdd  HIVE-24559: Fix some spelling issues (Ricky Ma reviewed by 
Vihang Karajgaonkar and Miklos Gergely)
 add f1e8713  Updated release notes for 2.3.8 release RC3

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
annotated tag are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (a97da0d)
\
 N -- N -- N   refs/tags/release-2.3.8-rc3 (d3d6319)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .../src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java   | 6 +++---
 ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java | 4 ++--
 .../apache/hadoop/hive/ql/parse/UpdateDeleteSemanticAnalyzer.java   | 2 +-
 ql/src/test/org/apache/hadoop/hive/ql/io/TestAcidUtils.java | 2 +-
 4 files changed, 7 insertions(+), 7 deletions(-)

[hive] branch master updated (fc2d47f -> 230dbce)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from fc2d47f  HIVE-24509: Move show specific codes under DDL and cut 
MetaDataFormatter classes to pieces (Miklos Gergely, reviewed by David Mollitor)
 add 230dbce  HIVE-24559: Fix some spelling issues (#1818)

No new revisions were added by this update.

Summary of changes:
 common/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java   | 4 ++--
 .../main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java| 2 +-
 2 files changed, 3 insertions(+), 3 deletions(-)

[hive] branch branch-2.3 updated (9fbcfdd -> f1e8713)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 9fbcfdd  HIVE-24559: Fix some spelling issues (Ricky Ma reviewed by 
Vihang Karajgaonkar and Miklos Gergely)
 add f1e8713  Updated release notes for 2.3.8 release RC3

No new revisions were added by this update.

Summary of changes:
 RELEASE_NOTES.txt | 2 ++
 1 file changed, 2 insertions(+)

[hive] annotated tag release-2.3.8-rc3 updated (1494f19 -> a97da0d)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.8-rc3
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag release-2.3.8-rc3 was modified! ***

from 1494f19  (commit)
  to a97da0d  (tag)
 tagging 1494f19db0cc7f7043c31d317dae0c54a59ed6e7 (commit)
 replaces release-2.3.8-rc2
  by Chao Sun
  on Mon Dec 21 10:31:22 2020 -0800

- Log -
Hive 2.3.8-rc3 release.
---


No new revisions were added by this update.

Summary of changes:

[hive] branch branch-2.3 updated: HIVE-24553. Exclude calcite from test-jar dependency of hive-exec (#1794)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new d7caeaf  HIVE-24553. Exclude calcite from test-jar dependency of 
hive-exec (#1794)
d7caeaf is described below

commit d7caeaf5d24c924720a93999ca1b8ef0f971c44e
Author: Liang-Chi Hsieh 
AuthorDate: Mon Dec 21 10:18:12 2020 -0800

HIVE-24553. Exclude calcite from test-jar dependency of hive-exec (#1794)
---
 beeline/pom.xml   | 14 ++
 hcatalog/core/pom.xml | 14 ++
 hcatalog/hcatalog-pig-adapter/pom.xml | 14 ++
 hcatalog/server-extensions/pom.xml| 14 ++
 hcatalog/webhcat/java-client/pom.xml  | 14 ++
 itests/hive-minikdc/pom.xml   | 14 ++
 itests/hive-unit-hadoop2/pom.xml  | 14 ++
 itests/hive-unit/pom.xml  | 14 ++
 itests/qtest-accumulo/pom.xml | 28 
 itests/util/pom.xml   | 14 ++
 service/pom.xml   | 14 ++
 11 files changed, 168 insertions(+)

diff --git a/beeline/pom.xml b/beeline/pom.xml
index 0d25ef9..971a631 100644
--- a/beeline/pom.xml
+++ b/beeline/pom.xml
@@ -99,6 +99,20 @@
   ${project.version}
   tests
   test
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
   org.apache.hive
diff --git a/hcatalog/core/pom.xml b/hcatalog/core/pom.xml
index 9dc2456..d81e492 100644
--- a/hcatalog/core/pom.xml
+++ b/hcatalog/core/pom.xml
@@ -66,6 +66,20 @@
   ${project.version}
   test-jar
   test
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
 
diff --git a/hcatalog/hcatalog-pig-adapter/pom.xml 
b/hcatalog/hcatalog-pig-adapter/pom.xml
index 66f1185..49c6861 100644
--- a/hcatalog/hcatalog-pig-adapter/pom.xml
+++ b/hcatalog/hcatalog-pig-adapter/pom.xml
@@ -101,6 +101,20 @@
   ${project.version}
   test-jar
   test
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
 
diff --git a/hcatalog/server-extensions/pom.xml 
b/hcatalog/server-extensions/pom.xml
index 4f334e4..4756f1d 100644
--- a/hcatalog/server-extensions/pom.xml
+++ b/hcatalog/server-extensions/pom.xml
@@ -75,6 +75,20 @@
   ${project.version}
   test-jar
   test
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
 
diff --git a/hcatalog/webhcat/java-client/pom.xml 
b/hcatalog/webhcat/java-client/pom.xml
index f19f18b..ff3f660 100644
--- a/hcatalog/webhcat/java-client/pom.xml
+++ b/hcatalog/webhcat/java-client/pom.xml
@@ -73,6 +73,20 @@
   ${project.version}
   test-jar
   test
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
   org.apache.hive.hcatalog
diff --git a/itests/hive-minikdc/pom.xml b/itests/hive-minikdc/pom.xml
index 4e05f4e..8f359a2 100644
--- a/itests/hive-minikdc/pom.xml
+++ b/itests/hive-minikdc/pom.xml
@@ -116,6 +116,20 @@
   ${project.version}
   test
   tests
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
 
diff --git a/itests/hive-unit-hadoop2/pom.xml b/itests/hive-unit-hadoop2/pom.xml
index 422a2fe..1b1cc56 100644
--- a/itests/hive-unit-hadoop2/pom.xml
+++ b/itests/hive-unit-hadoop2/pom.xml
@@ -97,6 +97,20 @@
   hive-exec
   ${project.version}
   tests
+  
+
+  org.apache.calcite
+  calcite-core
+
+
+  org.apache.calcite
+  calcite-druid
+
+
+  org.apache.calcite.avatica
+  avatica
+
+  
 
 
 
diff --git a/itests/hive-unit/pom.xml b/itests/hive-unit/pom.xml
index 8dc7971..d74ac34 100644
--- a/itests/hive

[hive] branch branch-2.3 updated (8c1dd36 -> 52a4ab8)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 8c1dd36  Updated release notes for 2.3.8 release RC2
 add 52a4ab8  HIVE-24551: Hive should include transitive dependencies from 
calcite after shading it (#1792)

No new revisions were added by this update.

Summary of changes:
 Jenkinsfile |  2 +-
 pom.xml | 36 +++-
 ql/pom.xml  | 16 
 3 files changed, 52 insertions(+), 2 deletions(-)

[hive] annotated tag release-2.3.8-rc2 updated (8c1dd36 -> 94b06c7)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.8-rc2
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag release-2.3.8-rc2 was modified! ***

from 8c1dd36  (commit)
  to 94b06c7  (tag)
 tagging 8c1dd3686581aa42e80d83710ca10e19ec64d935 (commit)
 replaces release-2.3.8-rc1
  by Chao Sun
  on Mon Dec 14 09:27:58 2020 -0800

- Log -
Hive 2.3.8-rc2 release.
---


No new revisions were added by this update.

Summary of changes:

[hive] branch branch-2.3 updated (f47f85a -> 8c1dd36)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from f47f85a  Updated release notes for 2.3.8 release RC1
 add ee5a6be  HIVE-22708: Fix for HttpTransport to replace String.equals 
(Naveen Gangam, reviewed by Peter Vary)
 add 8c1dd36  Updated release notes for 2.3.8 release RC2

No new revisions were added by this update.

Summary of changes:
 RELEASE_NOTES.txt  | 1 +
 service/src/java/org/apache/hive/service/CookieSigner.java | 2 +-
 2 files changed, 2 insertions(+), 1 deletion(-)

[hive] branch branch-2.3 updated (95fbc33 -> f47f85a)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 95fbc33  HIVE-24512: Exclude calcite in packaging. (#1760)
 add f47f85a  Updated release notes for 2.3.8 release RC1

No new revisions were added by this update.

Summary of changes:
 RELEASE_NOTES.txt | 1 +
 1 file changed, 1 insertion(+)

[hive] annotated tag release-2.3.8-rc1 updated (f47f85a -> 98a5e23)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.8-rc1
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag release-2.3.8-rc1 was modified! ***

from f47f85a  (commit)
  to 98a5e23  (tag)
 tagging f47f85a982cda776eb106bd61b6929735ecc6995 (commit)
 replaces release-2.3.8-rc0
  by Chao Sun
  on Wed Dec 9 14:51:39 2020 -0800

- Log -
Hive 2.3.8-rc1 release.
---


No new revisions were added by this update.

Summary of changes:

[hive] branch branch-2 updated: HIVE-24512: Exclude calcite in packaging. (#1760)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2 by this push:
 new 14f7c83  HIVE-24512: Exclude calcite in packaging. (#1760)
14f7c83 is described below

commit 14f7c8335eb6a77a64a965e171819dae3f6620ba
Author: Liang-Chi Hsieh 
AuthorDate: Wed Dec 9 14:39:07 2020 -0800

HIVE-24512: Exclude calcite in packaging. (#1760)
---
 packaging/src/main/assembly/bin.xml | 1 +
 1 file changed, 1 insertion(+)

diff --git a/packaging/src/main/assembly/bin.xml 
b/packaging/src/main/assembly/bin.xml
index 84686ee..3ffd99b 100644
--- a/packaging/src/main/assembly/bin.xml
+++ b/packaging/src/main/assembly/bin.xml
@@ -39,6 +39,7 @@
   true
   true
   
+org.apache.calcite:*
 org.apache.hadoop:*
 org.apache.hive.hcatalog:*
 org.slf4j:*

[hive] branch branch-2.3 updated: HIVE-24512: Exclude calcite in packaging. (#1760)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/branch-2.3 by this push:
 new 95fbc33  HIVE-24512: Exclude calcite in packaging. (#1760)
95fbc33 is described below

commit 95fbc33cbf0732dfc2ec3206cd8941e8ecd0a249
Author: Liang-Chi Hsieh 
AuthorDate: Wed Dec 9 14:39:07 2020 -0800

HIVE-24512: Exclude calcite in packaging. (#1760)
---
 packaging/src/main/assembly/bin.xml | 1 +
 1 file changed, 1 insertion(+)

diff --git a/packaging/src/main/assembly/bin.xml 
b/packaging/src/main/assembly/bin.xml
index 84686ee..3ffd99b 100644
--- a/packaging/src/main/assembly/bin.xml
+++ b/packaging/src/main/assembly/bin.xml
@@ -39,6 +39,7 @@
   true
   true
   
+org.apache.calcite:*
 org.apache.hadoop:*
 org.apache.hive.hcatalog:*
 org.slf4j:*

[hive] annotated tag release-2.3.8-rc0 updated (952dd94 -> 8b33bb7)

[sunchao]

This is an automated email from the ASF dual-hosted git repository.

sunchao pushed a change to annotated tag release-2.3.8-rc0
in repository https://gitbox.apache.org/repos/asf/hive.git.


*** WARNING: tag release-2.3.8-rc0 was modified! ***

from 952dd94  (commit)
  to 8b33bb7  (tag)
 tagging 952dd9426ceecb0f50f3cf95cb4d43074b01594b (commit)
 replaces rel/release-2.3.7
  by Chao Sun
  on Mon Dec 7 10:41:53 2020 -0800

- Log -
Hive 2.3.8-rc0 release.
---


No new revisions were added by this update.

Summary of changes: