Re: [VOTE] Release Apache Hive 4.0.0-beta-1 (Release Candidate 0)

2023-08-10 Thread Ayush Saxena
+1(Binding) * Built from source * Verified checksums * Verified signatures * Verified no code diff between the git tag & source tar * Checked the NOTICE & LICENSE files. * Skimmed over HS2 UI * Deployed with Derby and tried some operations on ACID & Iceberg tables. Thanx Stamatis for driving the

Re: [VOTE] Release Apache Hive 4.0.0-beta-1 (Release Candidate 0)

2023-08-10 Thread Denys Kuzmenko
+1 * Verified signatures and checksum; * Checked binary content and successfully built from the source; * Skimmed through the release notes; * Initialized backend DB schema and launched HMS & HS2 locally; * Conducted basic checks via beeline: - Created a few ACID & Iceberg tables and loaded

Re: [VOTE] Release Apache Hive 4.0.0-beta-1 (Release Candidate 0)

2023-08-10 Thread Simhadri G
Hi Everyone, Thanks, Stamatis for driving the release. +1 (non-binding) Verified the following: * Download the source tarball, signature (.asc), and checksum (.sha512): OK * Import gpg keys: download KEYS and run gpg --import /path/to/downloaded/KEYS.txt -> Verify the signature by running:gpg

Re: [VOTE] Release Apache Hive 4.0.0-beta-1 (Release Candidate 0)

2023-08-10 Thread Sourabh Badhya
I was able to do the following with RC0 artifacts - * Verified checksum of sources and binaries. * Successfully built from source. * Successful metastore DB setup with Postgres. * Brought up HS2 and HMS successfully and ran CREATE, INSERT, SELECT, DROP queries for external tables and CREATE,

Re: Possibility of supporting TIME or other standard types

2023-08-09 Thread Okumin
Hi Stamatis, Thanks for your reply and +1. Anyway, I also guess there is no semantic reason not to support the type. I created a ticket and may try to work on it when I have a chance. https://issues.apache.org/jira/browse/HIVE-27587 Please let me know if anyone else knows any difficulties or

Update on PowerMock elimination

2023-08-09 Thread Zsolt Miskolczi
I wanted to put this issue to the community in case you have any additional thoughts, ideas or doubts about it. Hi there, I dug deeper into the topic and have found some interesting maven dependency issues that will lead to some surprising pull requests so I wanted to update you about this: The

Re: Possibility of supporting TIME or other standard types

2023-08-09 Thread Stamatis Zampetakis
Hello Okumin, As you mentioned the TIME datatype is part of the SQL standard and it is also supported by many popular DBMS so it definitely makes sense to add it to Hive. I guess it was not implemented already cause users were able to store times using other existing types so it never became a

Re:[VOTE] Release Apache Hive 4.0.0-beta-1 (Release Candidate 0)

2023-08-08 Thread dengzhhu653
+1 (non-binding), and thanks for driving the release.* Verified signature/Checksum of sources and binaries;* Good rat check and source files;* Build from source successfully;* Inited meta scripts against Postgres;* Bring up HiveServer2 and Metastore, run some simple queries using Tez:

[VOTE] Release Apache Hive 4.0.0-beta-1 (Release Candidate 0)

2023-08-07 Thread Stamatis Zampetakis
Hi all, I have created a build for Apache Hive 4.0.0-beta-1 Release Candidate 0. Thanks to everyone who has contributed to this release. You can read the release notes here: https://github.com/apache/hive/blob/branch-4.0.0-beta-1/RELEASE_NOTES.txt The commit to be voted upon:

Re: Review Request 52912: HIVE-13557: Make interval keyword optional while specifying DAY in interval arithmetic

2023-08-06 Thread Jude Dike
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/52912/#review225629 --- Ship it! Ship It! - Jude Dike On Nov. 15, 2016, 11:13 p.m.,

Possibility of supporting TIME or other standard types

2023-08-04 Thread Okumin
Hi everyone, I happened to find some people struggling to store values of the TIME type in a Hive table from another query engine. A viable option is to use Iceberg or another format instead of Hive native tables since Hive doesn't directly support the type. I agree that it could be one of the

Re: Introduce Uniffle : A stability solution of Hive's shuffle

2023-08-04 Thread He Qi
Thanks, We're testing the Tez in production envrionment. The biggest issue is to add ability of recompute. You can see https://github.com/apache/incubator-uniffle/issues/1011 In the future, we want to make Hive won't rely on the disks. We can make Shuffle Server to sort the data and flush the

Re: remove list bucking from hive 4.0

2023-08-03 Thread Stamatis Zampetakis
Hello, As usual I would advise against sudden drop of functionality, especially SQL syntax. It would be better if we could disable/issue a warning in one release and drop in the next to give users at least some time to digest the changes. How about the following: In 4.0, disable the

Re: [EXTERNAL] Re: JDK 11 Support in Hive 3.x

2023-08-02 Thread Aman Raj
Can someone please review the 2 PRs for JDK 11 support in 3.x hive. Thanks, Aman. From: Aman Raj Sent: Monday, July 31, 2023 3:24 PM To: dev@hive.apache.org Subject: Re: [EXTERNAL] Re: JDK 11 Support in Hive 3.x Thanks, Stamatis, for the reply. Can someone else

Re: remove list bucking from hive 4.0

2023-08-02 Thread László Bodor
LOL, this title, I meant *list bucketing, *oh god, this is history now, mail archives don't forget https://cwiki.apache.org/confluence/display/Hive/ListBucketing László Bodor ezt írta (időpont: 2023. aug. 2., Sze, 11:01): > Hey Hive devs! > > What about removing list bucketing from hive? >

Re: Request for write access to Hive wiki

2023-08-02 Thread Simhadri G
Thanks Ayush! On Wed, Aug 2, 2023 at 4:25 PM Ayush Saxena wrote: > Hi Simhadri, > It is done. > > -Ayush > > On Wed, 2 Aug 2023 at 15:40, Simhadri G wrote: > > > > Hi Everyone, > > > > I need to update the Hive column stats page in the hive wiki : > > >

Re: Request for write access to Hive wiki

2023-08-02 Thread Ayush Saxena
Hi Simhadri, It is done. -Ayush On Wed, 2 Aug 2023 at 15:40, Simhadri G wrote: > > Hi Everyone, > > I need to update the Hive column stats page in the hive wiki : > https://cwiki.apache.org/confluence/display/Hive/Column+Statistics+in+Hive > because of a PR. > > I kindly request write access to

Request for write access to Hive wiki

2023-08-02 Thread Simhadri G
Hi Everyone, I need to update the Hive column stats page in the hive wiki : https://cwiki.apache.org/confluence/display/Hive/Column+Statistics+in+Hive because of a PR. I kindly request write access to the hive wiki(Confluence username: simhadri064). Thanks! Simhadri G

remove list bucking from hive 4.0

2023-08-02 Thread László Bodor
Hey Hive devs! What about removing list bucketing from hive? https://issues.apache.org/jira/browse/HIVE-17852 I remember I tried this, but the patch became huge, so I'm thinking about simply disabling the syntax first for 4.0 (making the user unable to create a table like that), and then we can

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-08-01 Thread Stamatis Zampetakis
Hello, HIVE-27504 is now merged to master. Thanks everyone for the reviews! I am going to prepare the release candidate for 4.0.0-beta-1 sometime this week. Best, Stamatis On Thu, Jul 27, 2023 at 1:54 PM Battula, Brahma Reddy wrote: > > Looks following PR is reviewed. Any chance to get it

Re: [EXTERNAL] Re: JDK 11 Support in Hive 3.x

2023-07-31 Thread Aman Raj
Thanks, Stamatis, for the reply. Can someone else who reviewed JDK 11 upgrade in Hive 2.3.x review this PR. This will come in the 3.2.0 release and a major improvement feature. Thanks, Aman. From: Stamatis Zampetakis Sent: Monday, July 31, 2023 3:10 PM To:

Re: JDK 11 Support in Hive 3.x

2023-07-31 Thread Stamatis Zampetakis
Thanks for pushing this forward Aman. The main focus at this point is 4.0.0-beta-1 so personally I don't have much free time to allocate to Hive 3.x releases. Best, Stamatis On Sat, Jul 29, 2023 at 12:21 PM Aman Raj wrote: > > Hi team, > > I have raised PR's in branch-3

JDK 11 Support in Hive 3.x

2023-07-29 Thread Aman Raj
Hi team, I have raised PR's in branch-3 https://github.com/apache/hive/pull/4495 and branch-3.1 https://github.com/apache/hive/pull/4522 to provide JDK 11 support for Hive 3.x releases. This was already committed in Hive 2.3.9 which supports JDK11 now through this ticket -

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-07-27 Thread Battula, Brahma Reddy
Looks following PR is reviewed. Any chance to get it merged and give the release.? On 18/07/23, 2:39 PM, "Stamatis Zampetakis" mailto:zabe...@gmail.com>> wrote: HIVE-27504 still lacks reviews from committers. Note that I will not be able to work on the release from 22/07 to 30/07. If

Re: Hive 2.3.10 release?

2023-07-26 Thread Wang, Yuming
+1. Could we also include this patch: https://github.com/apache/hive/pull/3066. From: Chao Sun Date: Monday, July 17, 2023 at 02:33 To: dev@hive.apache.org Subject: Re: Hive 2.3.10 release? External Email Thanks Stamatis! Will check out the JIRAs you mentioned. Chao On Sun, Jul 16, 2023 at

Re: [Twitter] Quickstart dock

2023-07-25 Thread Ayush Saxena
Thanx Attila, it is up: https://twitter.com/ApacheHive/status/1683841189987102722?s=20 -Ayush On Tue, 25 Jul 2023 at 19:31, Attila Turoczy wrote: > > 流 Interested in Apache Hive and @ApacheIceberg? Check out the QuickStart > documentation at https://iceberg.apache.org/hive-quickstart/ for all

[Twitter] Quickstart dock

2023-07-25 Thread Attila Turoczy
流 Interested in Apache Hive and @ApacheIceberg? Check out the QuickStart documentation at https://iceberg.apache.org/hive-quickstart/ for all the details! #ApacheHive #ApacheIceberg First 2 chars are icons :)

Re: Introduce Uniffle : A stability solution of Hive's shuffle

2023-07-20 Thread Okumin
Hi Rory, Let me express my gratitude and positive impression of Uniffle. Actually, we also feel the necessity of a shuffle service for our Hive deployment, and I've been watching the project. I will check the implementation for Tez and send feedback or PRs if I find something. Regards, Okumin

Fwd: Signing releases using automated release infra

2023-07-18 Thread Ayush Saxena
JFYI. Maybe worth exploring -Ayush Begin forwarded message: > From: Volkan Yazıcı > Date: 19 July 2023 at 1:24:49 AM IST > To: d...@community.apache.org > Subject: Signing releases using automated release infra > Reply-To: d...@community.apache.org > > Abstract: Signing release artifacts

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-07-18 Thread Stamatis Zampetakis
HIVE-27504 still lacks reviews from committers. Note that I will not be able to work on the release from 22/07 to 30/07. If HIVE-27504 does not land in the next day or two the beta-1 release might get delayed unless someone else picks up the RM role and cuts the RC. Best, Stamatis On Thu, Jul

Re: Hive 2.3.10 release?

2023-07-16 Thread Chao Sun
Thanks Stamatis! Will check out the JIRAs you mentioned. Chao On Sun, Jul 16, 2023 at 7:05 AM Stamatis Zampetakis wrote: > Hello, > > I don't know in what state is branch-2.3 right now but if someone is > willing to cut a release from there then sure why not. Just ensure > that LICENSE/NOTICE

Re: [Twitter] Blog on Hive's Data Federation Capabilities

2023-07-16 Thread Stamatis Zampetakis
Interesting read, thanks Akshat for putting this together. For those that didn't know that Hive is a powerful data federation engine the article is a great start. Looking forward to more great content! Best, Stamatis On Wed, Jul 12, 2023 at 7:54 AM Ayush Saxena wrote: > > Thanx Akshat, it is up

Re: Hive 2.3.10 release?

2023-07-16 Thread Stamatis Zampetakis
Hello, I don't know in what state is branch-2.3 right now but if someone is willing to cut a release from there then sure why not. Just ensure that LICENSE/NOTICE files conform to the ASF policy and the respective JIRAs are backported. Probably some of the following JIRAs are relevant (hoping

Re: Hive 2.3.10 release?

2023-07-13 Thread Cheng Pan
+1 Please consider including Thrift upgrading for security purpose. On 2023/07/12 04:09:19 Chao Sun wrote: > Hi all, > > It's been quite a while since the last 2.3.9 release, and there are > several commits accumulated in the branch-2.3, including a few > critical bug fixes. Since Hive 2.3.x is

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-07-13 Thread Attila Turoczy
Thanks for the update! Can't wait for the beta :) -Attila On Thu, Jul 13, 2023 at 5:19 PM Stamatis Zampetakis wrote: > Hey everyone, > > As you may have noticed there have been various tickets around LICENSE > and NOTICE files popping up recently. I just logged HIVE-27504 [1] > which hopefully

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-07-13 Thread Stamatis Zampetakis
Hey everyone, As you may have noticed there have been various tickets around LICENSE and NOTICE files popping up recently. I just logged HIVE-27504 [1] which hopefully addresses all remaining issues that were found while I was working with the RC. After this gets resolved we should be good to go

[DISCUSS] HPL/SQL website migration

2023-07-12 Thread Stamatis Zampetakis
Hey everyone, HPL/SQL has been part of Hive for a long time now. Surprisingly (at least for me), the main website and documentation around HPL/SQL[1] is not under the hive domain and I don't know how many people have access to it. Looking at the website [1] at the moment some things appear broken

Re: [Twitter] Blog on Hive's Data Federation Capabilities

2023-07-11 Thread Ayush Saxena
Thanx Akshat, it is up on twitter: https://twitter.com/ApacheHive -Ayush On Wed, 12 Jul 2023 at 10:08, Akshat m wrote: > > Delve into the world of data federation with Apache Hive in this blog. Explore > the essence of data federation, uncover Hive's capabilities, and learn > about its

[Twitter] Blog on Hive's Data Federation Capabilities

2023-07-11 Thread Akshat m
Delve into the world of data federation with Apache Hive in this blog. Explore the essence of data federation, uncover Hive's capabilities, and learn about its supported integrations. Don't miss out on the insights: https://akshatmat.medium.com/data-federation-with-apache-hive-74b3bc5fb72

Hive 2.3.10 release?

2023-07-11 Thread Chao Sun
Hi all, It's been quite a while since the last 2.3.9 release, and there are several commits accumulated in the branch-2.3, including a few critical bug fixes. Since Hive 2.3.x is still actively being used by projects such as Apache Spark, I'm thinking about initiating a new release process, if

Introduce Uniffle : A stability solution of Hive's shuffle

2023-07-11 Thread roryqi
Dear Apache Hive community, We are delighted to announce the support of Tez on Uniffle. Uniffle havs supported Apache Spark, Apache,Hadoop MapReduce and Apache Tez. Uniffle is a remote shuffle service. In several situations, Uniffle will provide great help. 1. If you use AWS spot instances

Re: Move to JDK-11

2023-07-11 Thread Attila Turoczy
Returning to this topic, I kindly request those who would like to advocate for the continued support of JDK8 to please share their reasoning and insights with us. Your input and perspective are greatly appreciated! Thank you. -Attila On Fri, Jun 2, 2023 at 12:43 PM Attila Turoczy wrote: > Hi

Re: Idea: Remove PowerMock

2023-07-11 Thread Zoltan Haindrich
Hey, #3798 looks promising; I've reopened - it seems like it have fallen between the cracks... testruns have become outdated and it seems like it needs a rebase. I think that the usage of powermock signals that something is wrong and a refactor step should be taken instead of introducing it

Re: Idea: Remove PowerMock

2023-07-10 Thread Attila Turoczy
+1 Kill it! :) mockito is a more modern approach. I think it is cool that we modernize our platform, and remove old and unsupported tools and components. On Mon, Jul 10, 2023 at 5:36 PM Ayush Saxena wrote: > +1, PowerMock as far as I remember has issues with JDK-11+ as well, > one such ref : >

Re: Is there a way to test schema evolution scripts?

2023-07-10 Thread Stamatis Zampetakis
Hello, The tests under DbInstallBase [1] seem to do more or less what you want. Check them out and if something is missing don't hesitate to enrich them. Best, Stamatis [1]

Re: Is there a way to test schema evolution scripts?

2023-07-10 Thread Ayush Saxena
Hi Zsolt, You can start by exploring this: https://github.com/apache/hive/blob/master/standalone-metastore/DEV-README It has steps to run those metatore scripts over different database types locally. -Ayush On Mon, 10 Jul 2023 at 20:30, Zsolt Miskolczi wrote: > > Hi, > > I just stared at a

Re: Idea: Remove PowerMock

2023-07-10 Thread Ayush Saxena
+1, PowerMock as far as I remember has issues with JDK-11+ as well, one such ref : https://stackoverflow.com/questions/52966897/powermock-java-11 -Ayush On Mon, 10 Jul 2023 at 20:18, Zsolt Miskolczi wrote: > > Hi, > > Hive heavily uses PowerMock . The main >

Is there a way to test schema evolution scripts?

2023-07-10 Thread Zsolt Miskolczi
Hi, I just stared at a pull request about using liquibase for schema evolution and I was thinking how such a change can be validated. I think the main issue is that we support multiple types of relational databases but precommit tests don't test them at all. I think if we want to check if the

Idea: Remove PowerMock

2023-07-10 Thread Zsolt Miskolczi
Hi, Hive heavily uses PowerMock . The main purpose of it is having static mocking. The sad thing is it seems PowerMock is dead: - The main branch got it's lot commit in 2022 and and most of the contributions last year were simple dependency upgrades:

Final Reminder: Community Over Code call for presentations closing soon

2023-06-28 Thread Rich Bowen
[Note: You're receiving this email because you are subscribed to one or more project dev@ mailing lists at the Apache Software Foundation.] This is your final reminder that the Call for Presentations for Community Over Code (formerly known as ApacheCon) is closing soon - on Thursday, 13 July 2023

Virtual key signing party

2023-06-28 Thread Stamatis Zampetakis
Hi all, The Calcite community is organising a key signing party tomorrow [1]. Such events are extremely useful for growing the web of trust and are particularly relevant for ASF committers which usually have to sign artifacts and releases. The event will not take more than a couple of minutes.

Query regarding Accumulo Support

2023-06-27 Thread Akshat m
Hi everyone I am writing to inquire about the current state of support for Accumulo in Hive, particularly with regard to its testing and stability. Furthermore, I would like to discuss the possibility of deprecating Accumulo in an upcoming release(4.x) unless there are specific plans or use cases

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-20 Thread Stamatis Zampetakis
Hey team, Small heads up regarding the progress of the 4.0.0-beta-1 release. Most of the release steps went out smoothly and I was able to get an RC0 ready [1]. However, I am afraid that our binary distribution does not comply fully with the ASF Policy [2]. We bundle a lot of dependencies

TAC Applications for Community Over Code North America and Asia now open

2023-06-16 Thread Gavin McDonald
Hi All, (This email goes out to all our user and dev project mailing lists, so you may receive this email more than once.) The Travel Assistance Committee has opened up applications to help get people to the following events: *Community Over Code Asia 2023 - * *August 18th to August 20th in

Re: [DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-14 Thread Zoltan Haindrich
Hive has >24hours of tests - in case of automated reruns... I wonder how a patch which breaks almost all tests should be handled? I believe we already have a process to step up against these things: if you encounter a flaky test - it should be checked by using:

Re: Blogs/Designs For Apache Hive

2023-06-12 Thread Ayush Saxena
Have played a bit with this today along with Simhadri. The page lies here: https://hive.blog.apache.org/ It is pretty simple, not very fancy, considering my Web Designing skills(which are technically non-existent). But gives us a template to put blogs related to hive in a single place. As it

Re: [DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-12 Thread Denys Kuzmenko
I’ll second the above. We already have a number of flaky tests that would go undetected and just increase the build time.

Re: [DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-12 Thread Stamatis Zampetakis
Hello, I tend to agree with Sai; if we can run on demand the failed tests that would be a cool feature. If we just rerun everything that fails without questions asked we may do more harm than good. Taking into account the fact that nobody runs all tests locally before submitting a PR (cause it is

Re: [EXTERNAL] Re: Request to join Hive slack channel

2023-06-09 Thread Zoltán Rátkai
Hi Ayush, can you please add me as well? Thanks, Zoltán Rátkai On Thu, Jun 8, 2023 at 7:40 AM Aman Raj wrote: > Got added. Thanks Ayush. > > Thanks, > Aman. > > From: Ayush Saxena > Sent: Thursday, June 8, 2023 11:06 AM > To: dev > Subject: [EXTERNAL] Re:

Re: Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-08 Thread Sai Hemanth Gantasala
Hi all, Thanks for the constructive feedback and I'm happy that the community agreed on one opinion. I'll go ahead with the consensus view. Thanks again for taking the time to provide valuable feedback. Thanks, Sai. On Wed, Jun 7, 2023 at 10:03 PM vihang karajgaonkar wrote: > +1 on removing

Re: [DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-08 Thread Sai Hemanth Gantasala
Hello everyone, My personal preference is that the option to rerun *only* the failed test suites should be manual. The reason is, there might be frequent intentional test failures (failures due to our own patch) and the tests being flaky is less likely. So giving the option to the user to rerun

Re: [DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-08 Thread Ayush Saxena
+1 from me as well to rerun the failing tests. The oracle docker is also a pain, it is one of the main reasons for retriggers, these retriggers wastes a lot of resources and increases the time to get build results for genuine runs. -Ayush On Thu, 8 Jun 2023 at 12:31, Butao Zhang wrote: > +1. I

Re: [DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-08 Thread Butao Zhang
+1. I often have to rerun whole pre-commit job due to individual unstable test, ant it is too time-consuming. It would be much better if we can set maven config to retry automatically. Thanks, Butao Zhang Replied Message | From | r12 t45 | | Date | 6/8/2023 14:52 | | To | | |

[DISCUSS] Automatic rerunning of failed tests in Hive Pre-commit

2023-06-08 Thread r12 t45
Hi All, It often happens that Hive unit tests fail during pre-commit which requires rerunning the whole pre-commit job and creates hours of delays. What if we set Maven config to retry failed tests automatically X times? There is "rerunFailingTestsCount" property in maven-surefire-plugin which

Re: [EXTERNAL] Re: Request to join Hive slack channel

2023-06-07 Thread Aman Raj
Got added. Thanks Ayush. Thanks, Aman. From: Ayush Saxena Sent: Thursday, June 8, 2023 11:06 AM To: dev Subject: [EXTERNAL] Re: Request to join Hive slack channel Have added everyone. Let me know if it didn't work. @Aman that mail id was giving me errors, I

Re: Request to join Hive slack channel

2023-06-07 Thread Ayush Saxena
Have added everyone. Let me know if it didn't work. @Aman that mail id was giving me errors, I added you manually, Let me know if it works, if not, we would need another mail id :-) -Ayush On Wed, 7 Jun 2023 at 21:25, Alagappan M wrote: > > Hi Ayush, > Can you add aswin.alagappa...@gmail.com

Re: Hive 4.0 branching

2023-06-07 Thread Ayush Saxena
Hi Vihang, Regarding " branch-4.0.0-alpha1 and branch-4.0.0-alpha-2" : Those branches were created for releasing those alpha1 & alpha2 versions. Currently, the master branch points to 4.0.0-Snapshot [1], so that would be used for the next release. A branch would be cut from the current master

Hive 4.0 branching

2023-06-07 Thread vihang karajgaonkar
Hello Dev community, I noticed that we have a branch-4.0.0-alpha1 and branch-4.0.0-alpha-2 but I don't see a branch-4. Does anyone know which branch would be used to cut out the final 4.0.0 release and when would a branch-4 be available? Thanks, Vihang

Re: Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-07 Thread vihang karajgaonkar
+1 on removing unreleased and deprecated APIs. For the APIs which have been released, we should mark them deprecated first and remove them only in the next major release. As many of you know, Hive metastore APIs are used by many other systems outside Hive too and we should be careful not make

Re: [EXTERNAL] Re: Request to join Hive slack channel

2023-06-07 Thread Aman Raj
Hi Ayush, Can you please add me as well. Mail Id - f20151...@alumni.bits-pilani.ac.in Thanks, Aman. From: Stephen Carlin Sent: Wednesday, June 7, 2023 8:36 PM To: dev@hive.apache.org Subject: [EXTERNAL] Re: Request to join Hive slack channel [You don't often

Re: Blogs/Designs For Apache Hive

2023-06-07 Thread Denys Kuzmenko
Nice, tnx Ayush!

Re: Request to join Hive slack channel

2023-06-07 Thread Stephen Carlin
Hi Ayush, can you add me (scar...@cloudera.com) as well? Thanks! On Wed, Jun 7, 2023 at 12:48 AM Ayush Saxena wrote: > Hi Dayakar, > I have added you, you must get a mail once that request gets approved from > Infra side > > -Ayush > > > On 07-Jun-2023, at 11:20 AM, Dayakar Morem > wrote: > >

Blogs/Designs For Apache Hive

2023-06-07 Thread Ayush Saxena
Hi All, As Infra has decommissioned blogs.apache.org, each project gets an individual space for blogs. I have configured one(With tons of help from Infra people) for us. It stays here: https://hive.blog.apache.org/ It is just an initial commit, to make sure our space works. We need to do some

Re: [apache/hive] HIVE-24706: add the HiveHBaseTableInputFormatV2 to fix the compatible… (PR #4199)

2023-06-07 Thread Attila Turoczy
Sure thing. On Wed, Jun 7, 2023 at 10:59 AM Dong Li wrote: > Hey team, > > Anyone can help to review this PR? > > -- Forwarded message - > From: github-actions[bot] > Date: Wed, 7 Jun 2023 at 10:22 > Subject: Re: [apache/hive] HIVE-24706: add the HiveHBaseTableInputFormatV2 >

Fwd: [apache/hive] HIVE-24706: add the HiveHBaseTableInputFormatV2 to fix the compatible… (PR #4199)

2023-06-07 Thread Dong Li
Hey team, Anyone can help to review this PR? -- Forwarded message - From: github-actions[bot] Date: Wed, 7 Jun 2023 at 10:22 Subject: Re: [apache/hive] HIVE-24706: add the HiveHBaseTableInputFormatV2 to fix the compatible… (PR #4199) To: apache/hive Cc: alexdongli0829 , Author

Re: Request to join Hive slack channel

2023-06-07 Thread Ayush Saxena
Hi Dayakar, I have added you, you must get a mail once that request gets approved from Infra side -Ayush > On 07-Jun-2023, at 11:20 AM, Dayakar Morem wrote: > > Hi Ayush, > > Can you please add me to the channel. My email id is daya.apa...@gmail.com > > Thanks & Regards, > Dayakar. > >>

Re: Request to join Hive slack channel

2023-06-06 Thread Dayakar Morem
Hi Ayush, Can you please add me to the channel. My email id is daya.apa...@gmail.com Thanks & Regards, Dayakar. On Sat, May 20, 2023 at 10:02 AM Ayush Saxena wrote: > Have added all the people who requested here + Attila Turoczy and Simhadri > G (received offline requests). > > I hope

Call for Presentations, Community Over Code Asia 2023

2023-06-05 Thread Rich Bowen
You are receiving this message because you are subscribed to one more more developer mailing lists at the Apache Software Foundation. The call for presentations is now open at "https://apachecon.com/acasia2023/cfp.html;, and will be closed by Sunday, Jun 18th, 2023 11:59 PM GMT. The event will

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-02 Thread Stamatis Zampetakis
I can start preparing the RC towards the end of next week. If somebody has more time and wants to start earlier I am fine to switch. Best, Stamatis On Fri, Jun 2, 2023 at 5:36 PM Denys Kuzmenko wrote: > > great, this is the current list of release managers: > > 4.0.0 Stamatis Zampetakis > 4.1.0

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-02 Thread Denys Kuzmenko
great, this is the current list of release managers: 4.0.0 Stamatis Zampetakis 4.1.0 Denys Kuzmenko 4.2.0 Sai Hemanth Gantasala Should we keep the same RM order and just shift the releases or find a volunteer for the 4.0.0-beta release, WDYT?

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-02 Thread Ayush Saxena
+1, for a pre GA release Beta sounds better to me, we don’t have any half baked major features, just probabilities of some bugs -Ayush On Thu, 1 Jun 2023 at 4:24 PM, Attila Turoczy wrote: > Ayush just told me, the mailing list does not support images. It is a very > sad world :-( > > Previous

Re: Move to JDK-11

2023-06-02 Thread Attila Turoczy
Hi All, I know my opinion might not be the most popular, but I advocate for using* JDK 17*. Here's why: Let's consider a scenario where a customer wants to use the latest version of Apache Hive. They would typically install it locally or on a small cluster. In 2023, is it realistic to assume

Re: Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-01 Thread Stamatis Zampetakis
Zhihua brought up a good point. Yes if it was introduced in 4.0.0-alpha and then was deprecated we can remove it. On Thu, Jun 1, 2023 at 1:00 PM Attila Turoczy wrote: > > +1 from me as well. Let's clean it up. Still, because we have struggled > with the data correctness issue, we have time to

Re: Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-01 Thread Attila Turoczy
+1 from me as well. Let's clean it up. Still, because we have struggled with the data correctness issue, we have time to introduce these changes. If won't fit then won't be a problem as well, as the next release will contain it. As I wrote earlier, as the 4.0 goes out I want to help to have

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-01 Thread Attila Turoczy
Ayush just told me, the mailing list does not support images. It is a very sad world :-( Previous meme: https://imgflip.com/i/7nuzql On Thu, Jun 1, 2023 at 11:46 AM Attila Turoczy wrote: > OK. Then let's go with beta. Please start. (if not started already) a vote > for a release. > > I think

Re:Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-01 Thread dengzhhu653
Hi Thanks Sai for driving this, the request based API makes sense to me. For the removal of deprecated API: a) +1 if it is marked as deprecated in 3.x; b) If the API is introduced after 4.0.0-alpha, but tend to become obsolete in 4.x GA, I think we can remove it as well. Thanks, Zhihua. At

Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-01 Thread Ayush Saxena
+1 to what Stamatis said, if it is there in 3.X we can explore their removal, else let them go in 4.x GA release and we can remove then in the subsequent release -Ayush > On 01-Jun-2023, at 3:08 PM, Stamatis Zampetakis wrote: > > Hello, > > Ideally we should deprecate APIs in one release

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-01 Thread Attila Turoczy
OK. Then let's go with beta. Please start. (if not started already) a vote for a release. I think we should have a more frequent release cadence. The community needs it, we need this, also without frequent release nobody will believe this project is healthy. I know the first will be the hardest,

Re: Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-06-01 Thread Stamatis Zampetakis
Hello, Ideally we should deprecate APIs in one release and remove them in a subsequent major release. If the HMS deprecations were added in Hive 3.X then I am ok removing them now. Otherwise it is not really that we will remove deprecated APIs but we will remove regular APIs without any notice.

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-06-01 Thread Stamatis Zampetakis
+1 from me as well. Any alpha or beta name should be fine I have no strong preferences. On Wed, May 31, 2023, 2:30 PM László Bodor wrote: > Hi! > > +1 for creating a new release before GA in the presence of possible > correctness problems. I'm not 100% sure about alpha or beta, I'm fine with >

Re: Move to JDK-11

2023-06-01 Thread Stamatis Zampetakis
Hey everyone, If we claim that Hive supports a certain JDK then we should compile and run tests with it. The more JDKs we can support the better for everyone but this comes at a cost (resources mostly). We should have a precommit run for every supported JDK (frequency to be determined once per

Re: Move to JDK-11

2023-05-31 Thread Sungwoo Park
Hi, everyone. I have not tested the master branch with Java 11/17 yet, but I would like to share my experience with testing a fork of branch-3.1 with Java 11/17 (as part of developing Hive-MR3), in case that it can be useful for the discussion. I merged the patches listed in [1] HIVE-22415 and

Reg: Discussion on removal of deprecated APIs in the HMS thrift interface

2023-05-31 Thread Sai Hemanth Gantasala
Hi everyone, This thread is to initiate a discussion on the removal of deprecated APIs in the HMS thrift class. Any client including HiveMetastoreClient talks to HiveMetaStore Server via the thrift layer. Over the past few years, the thrift class is bloated with duplicated APIs with varying

Re: Move to JDK-11

2023-05-31 Thread Sai Hemanth Gantasala
Hi All, I would strongly advocate keeping support for JDK8. Between JDK11 and JDK17, Depending on the amount of effort on the upgrade I'm inclined towards JDK17 (JDK21 LTS will be released in Sep 2023). Thanks, Sai. On Wed, May 31, 2023 at 5:39 AM László Bodor wrote: > *Hi!* > > > *Should we

Re: Move to JDK-11

2023-05-31 Thread László Bodor
*Hi!* *Should we support both JDK-11 & JDK-8?* IMO absolutely yes, let's not break up with JDK-8: according to its lifecycle, it's going to stay with us for a long time. I believe a) we should be able to compile on JDK8, JDK11, and JDK17 (github actions can cover this conveniently in precommit

Re: Move to JDK-11

2023-05-31 Thread Butao Zhang
Thanks Ayush for driving this! Good to know that Hive is getting ready for newer JDK. From my opinon, if we have more community energy to put into it, we can support both JDK-11 and JDK-17 like Spark[1]. If we have to make a choice between a JDK-11 and JDK-17, i would like to choose the

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-05-31 Thread László Bodor
Hi! +1 for creating a new release before GA in the presence of possible correctness problems. I'm not 100% sure about alpha or beta, I'm fine with alpha-3. Regards, Laszlo Bodor Denys Kuzmenko ezt írta (időpont: 2023. máj. 31., Sze, 14:22): > Hi folks, > > The master branch has many new

Re: [DISCUSS] HIVE 4.0.0 GA Release Proposal

2023-05-31 Thread Denys Kuzmenko
Hi folks, The master branch has many new features, bug fixes, and performance improvements since alpha-2. However, we still have several correctness bugs [HIVE-26654] and performance issues that should be eliminated before the GA. Could we consider doing a beta release to keep at least a

Move to JDK-11

2023-05-31 Thread Ayush Saxena
Hi Everyone, Want to pull in the attention of folks towards moving to JDK-11 compile time support in Hive. There was a ticket in the past [1] which talks about it and If I could decode it right, it was blocked because the Hadoop version used by Hive didn't had JDK-11 runtime support, But with [2]

Re: [DISCUSS] Nightly snaphot builds

2023-05-26 Thread vihang karajgaonkar
Thanks Zoltan. Makes sense. Also, we should definitely strive to release within 180 days especially when there are lots of commits to a branch. -Vihang On Fri, May 26, 2023 at 12:04 AM Zoltan Haindrich wrote: > On 5/25/23 19:58, vihang karajgaonkar wrote: > > I just tried the job and it worked

<    1   2   3   4   5   6   7   8   9   10   >