[Discussion] HIVE-28211: Restore hive-exec:core jar

2024-04-25 Thread Simhadri G
Hi Everyone,

The hive-exec:core jar is used by spark, oozie, hudi and many other
projects. Removal of the hive-exec:core jar has caused the following issues.

   - Spark : https://lists.apache.org/list?dev@hive.apache.org:lte=1M:joda
   - Oozie: https://lists.apache.org/thread/yld75ltf9y8d9q3cow3xqlg0fqyj6mkg
   - Hudi: apache/hudi#8147 
   - Apache IotDB:
https://lists.apache.org/thread/wdqsyj89w9cvyk1pyxr83hlxpg6zp1go

   - Guava: https://github.com/google/guava/issues/
   - joda-time:
   https://lists.apache.org/thread/sphgcvod3qx9wtc51ltpfyr8dpx9p294

I understand that there is prior discussion about why the hive-exec:core
jar was removed here:
https://lists.apache.org/thread/cwtxnffoqpwgmdtlc9hyor2cm22djpkg

We agreed that ultimately hive-exec jar should be used over hive-exec:core
but there are quite a few dependencies that need to be shaded and relocated
for this.  https://issues.apache.org/jira/browse/HIVE-26220 .

Until we shade & relocate dependencies in hive-exec, we should restore the
hive-exec:core jar . The intention for this is to provide a smoother
transition from the hive-exec:core to hive-exec jar for projects that
depend on hive .

Seeking inputs from the community  and a way to move forward on this topic.

I apologize in advance if I have missed anything.

Thanks!

Simhadri G


Re: [VOTE] Apache Hive 2.3.10 Release Candidate 0

2024-04-24 Thread Chao Sun
Thanks Cheng, I'll take a look at HIVE-28121 and create another RC.

> The vote email seems to have a wrong repository link, 1106. IIUC, 1128 is
the valid one, isn't it?

Oops. Yes it should be 1128. I reused the email content from my previous
release but forgot to change the link. Sorry about that.

Chao

On Wed, Apr 24, 2024 at 9:08 AM Dongjoon Hyun  wrote:

> Hi, Chao.
>
> The vote email seems to have a wrong repository link, 1106. IIUC, 1128 is
> the valid one, isn't it?
>
> Dongjoon.
>
> On 2024/04/20 20:01:53 Chao Sun wrote:
> > Apache Hive 2.3.10 Release Candidate 0 is available here:
> > https://people.apache.org/~sunchao/apache-hive-2.3.10-rc-0/
> > Maven artifacts are available here:
> > https://repository.apache.org/content/repositories/orgapachehive-1128
> >  >The
> > tag release-2.3.10-rc0 has been applied to the source for this
> > release in github, you can see it at
> > https://github.com/apache/hive/tree/release-2.3.10-rc0
> > Voting will conclude in 72 hours (or whenever I scrounge together enough
> > votes).
> >
> > Hive PMC Members: Please test and vote.
> >
> > Thanks.
> >
>


Re: [VOTE] Apache Hive 2.3.10 Release Candidate 0

2024-04-24 Thread Dongjoon Hyun
Hi, Chao.

The vote email seems to have a wrong repository link, 1106. IIUC, 1128 is the 
valid one, isn't it?

Dongjoon.

On 2024/04/20 20:01:53 Chao Sun wrote:
> Apache Hive 2.3.10 Release Candidate 0 is available here:
> https://people.apache.org/~sunchao/apache-hive-2.3.10-rc-0/
> Maven artifacts are available here:
> https://repository.apache.org/content/repositories/orgapachehive-1128
> The
> tag release-2.3.10-rc0 has been applied to the source for this
> release in github, you can see it at
> https://github.com/apache/hive/tree/release-2.3.10-rc0
> Voting will conclude in 72 hours (or whenever I scrounge together enough
> votes).
> 
> Hive PMC Members: Please test and vote.
> 
> Thanks.
> 


Re: [VOTE] Apache Hive 2.3.10 Release Candidate 0

2024-04-24 Thread Cheng Pan
Hi Stamatis,

HIVE-26882 got in 2.3.10, while a correctness issue was identified recently, 
HIVE-28121 fixes that.

I highly suggest including such a correctness patch in the final release of 2.3 
serials.

Thanks,
Cheng Pan




Re: [VOTE] Apache Hive 2.3.10 Release Candidate 0

2024-04-24 Thread Stamatis Zampetakis
Hello,

I am not sure how to interpret the comments about HIVE-28121. Are we
waiting for HIVE-28121 to be merged for 2.3.10 or this release can
proceed even without it?

Best,
Stamatis

On Mon, Apr 22, 2024 at 10:37 AM Cheng Pan  wrote:
>
> I made integration tests with Apache Spark[1] and Apache Kyuubi[2], and 
> everything looks good so far.
>
> We may need to wait for HIVE-28121(affects HMS)[3] and prepare for the next 
> RC.
>
> Thanks to Chao for your efforts in making this release.
>
> [1] https://github.com/apache/spark/pull/45372
> [2] https://github.com/apache/kyuubi/pull/6328
> [3] https://github.com/apache/hive/pull/5204
>
> Thanks,
> Cheng Pan
>
>


Re: [VOTE] Apache Hive 2.3.10 Release Candidate 0

2024-04-22 Thread Cheng Pan
I made integration tests with Apache Spark[1] and Apache Kyuubi[2], and 
everything looks good so far.

We may need to wait for HIVE-28121(affects HMS)[3] and prepare for the next RC. 

Thanks to Chao for your efforts in making this release.

[1] https://github.com/apache/spark/pull/45372
[2] https://github.com/apache/kyuubi/pull/6328
[3] https://github.com/apache/hive/pull/5204

Thanks,
Cheng Pan




Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-22 Thread Kirti Ruge
Congratulations Simhadri!!!

> On 20-Apr-2024, at 11:36 AM, Akshat m  wrote:
> 
> Congratulations Simhadri!, very well deserved 
> 
> On Fri, Apr 19, 2024 at 3:37 PM Simhadri G  > wrote:
> Thanks again everyone :) 
> 
> On Fri, Apr 19, 2024, 2:15 AM Rajesh Balamohan  > wrote:
> Congratulations Simhadri. :)
> 
> ~Rajesh.B
> 
> On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha  > wrote:
> Congrats Simhadri ! 
> 
> On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam  
> wrote:
> Congrats Simhadri. Looking forward to many more contributions in the future.
> 
> On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala 
>  wrote:
> Congratulations Simhadri  well deserved
> 
> On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  > wrote:
> Congratulations
> 
> Missatge de Alessandro Solimando  > del dia dj., 18 d’abr. 2024 a les 
> 17:40:
> Great news, Simhadri, very well deserved!
> 
> On Thu, 18 Apr 2024 at 15:07, Simhadri G  > wrote:
> Thanks everyone! 
> I really appreciate it, it means a lot to me :) 
> The Apache Hive project and its community have truly inspired me . I'm 
> grateful for the chance to contribute to such a remarkable project.
> 
> Thanks!
> Simhadri Govindappa
> 
> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan 
>  wrote:
> Congrats Simhadri!
> 
>  
> 
> -Sankar
> 
>  
> 
> From: Butao Zhang mailto:butaozha...@163.com>> 
> Sent: Thursday, April 18, 2024 5:39 PM
> To: u...@hive.apache.org ; dev 
> mailto:dev@hive.apache.org>>
> Subject: [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
> 
>  
> 
> You don't often get email from butaozha...@163.com 
> . Learn why this is important 
>   
> Congratulations Simhadri !!!
> 
>  
> 
> Thanks.
> 
>  
> 
> 发件人: user-return-28075-butaozhang1=163@hive.apache.org 
>  
>  > 代表 Ayush 
> Saxena mailto:ayush...@gmail.com>>
> 发送时间: 星期四, 四月 18, 2024 7:50 下午
> 收件人: dev mailto:dev@hive.apache.org>>; 
> u...@hive.apache.org   >
> 主题: [ANNOUNCE] New Committer: Simhadri Govindappa
> 
>  
> 
> Hi All,
> 
> Apache Hive's Project Management Committee (PMC) has invited Simhadri 
> Govindappa to become a committer, and we are pleased to announce that he has 
> accepted.
> 
>  
> 
> Please join me in congratulating him, Congratulations Simhadri, Welcome 
> aboard!!!
> 
>  
> 
> -Ayush Saxena
> 
> (On behalf of Apache Hive PMC)
> 
> 
> 
> -- 
> --
> Pau Tallada Crespí
> Departament de Serveis
> Port d'Informació Científica (PIC)
> Tel: +34 93 170 2729
> --
> 



Re: Query Regarding Core Classified Hive-Exec Artifact in Future Releases

2024-04-21 Thread Mergu Ravi
Hi Team,
Is there any plan to include core classified HIve-exec artifacts in future
releases?

On Wed, Apr 17, 2024 at 1:09 PM Mergu Ravi 
wrote:

> Hi Hive Team,
> From this Hive ticket https://issues.apache.org/jira/browse/HIVE-25531, I
> understood that the core classified hive-exec artifact was removed. Is
> there any plan to include this core artifact in upcoming releases?
> --
>
> Thanks & Regards,
> Ravi Mergu
>


-- 

Thanks & Regards,



Ravi Mergu
SMTS-2
o:  +91 40 64535355
m: +91 9959618687
w: www.gaiansolutions.com





*Please consider the environment before printing this email.* This message
contains confidential information and is intended only for the individual
named. If you are not the named addressee you should not disseminate,
distribute or copy this e-mail


Re: [DISCUSS] End of life for Hive 1.x, 2.x, 3.x

2024-04-20 Thread Chao Sun
Hi Cheng,

Sorry for the long delay. I was distracted by other things.

I just created RC0 for the Hive 2.3.10 release, and started a vote thread.
Please help to test if it looks good, especially from Spark side. Thanks!

Best,
Chao



On Thu, Apr 18, 2024 at 5:15 AM Cheng Pan  wrote:

> Hi Chao,
>
> The Spark community is starting to discuss the 4.0 release[1], can we make
> the Hive 2.3.10 release happen soon?
>
> [1] https://lists.apache.org/thread/nxmvz2j7kp96otzlnl3kd277knlb6qgb
>
> Thanks,
> Cheng Pan
>
> On 2024/01/17 17:50:37 Chao Sun wrote:
> > Hi Ayush,
> >
> > I'm working on the last few commits to backport to the branch.
> > Hopefully within 1-2 months I can start the release process. Our goal
> > is to upgrade Hive 2.x before the Spark 4.0 release coming up mid this
> > year.
> >
> > Chao
> >
> > On Tue, Jan 16, 2024 at 10:17 PM Ayush Saxena  wrote:
> > >
> > > Thanx everyone for the feedback, I have started a formal thread to
> mark 1.x
> > > EOL. We can have one last release for 2.x as Chao mentioned, with some
> > > required changes + our CVE's & get the release line marked as EOL then.
> > >
> > > @Chao Sun  Do let us know if you have a proposed
> > > timeline for that.
> > >
> > > -Ayush
> > >
> > > On Wed, 17 Jan 2024 at 08:23, vihang karajgaonkar 
> > > wrote:
> > >
> > > > I was confused about the subject line since it says 3.x as well
> along with
> > > > 1.x and 2.x. Does this discussion include all 1.x, 2.x and 3.x or
> just 1.x
> > > > and 2.x?
> > > >
> > > > I think it makes sense to EOL 1.x. Looks like 2.x is still being
> maintained
> > > > by Chao and I think we were backporting PRs to the 3.x line pretty
> recently
> > > > so I believe we should wait out for a release on Hive 3.x.
> > > >
> > > > Thanks,
> > > > Vihang
> > > >
> > > > On Tue, Jan 16, 2024 at 3:40 PM Attila Turoczy
> > > >  wrote:
> > > >
> > > > > Dear PMC's,
> > > > >
> > > > > Do we have a verdict / decision about this?
> > > > >
> > > > > -Attila
> > > > >
> > > > > On Wed, Jan 10, 2024 at 5:45 PM Chao Sun  wrote:
> > > > >
> > > > > > On Hive 2.x, I'm still preparing for another release 2.3.10
> (Hive 2.3
> > > > > > branch is being actively maintained so far). Hopefully this will
> be
> > > > > > the last release in the branch-2 line.
> > > > > >
> > > > > > +1 on making Hive 1 EOL for the time being.
> > > > > >
> > > > > > Chao
> > > > > >
> > > > > > On Wed, Jan 10, 2024 at 8:10 AM Sankar Hariappan
> > > > > >  wrote:
> > > > > > >
> > > > > > > +1 for making both Hive 1&2 EOL
> > > > > > >
> > > > > > > -Sankar
> > > > > > > -Original Message-
> > > > > > > From: Attila Turoczy 
> > > > > > > Sent: Wednesday, January 10, 2024 7:37 PM
> > > > > > > To: dev@hive.apache.org
> > > > > > > Subject: [EXTERNAL] Re: [DISCUSS] End of life for Hive 1.x,
> 2.x, 3.x
> > > > > > >
> > > > > > > [You don't often get email from aturo...@cloudera.com.invalid.
> Learn
> > > > > > why this is important at
> https://aka.ms/LearnAboutSenderIdentification
> > > > ]
> > > > > > >
> > > > > > > +1 for making it EOL for Hive 1 and Hive 2. I do not think
> these 2
> > > > > > product
> > > > > > > branches are relevant in 2023.
> > > > > > >
> > > > > > > -Attila
> > > > > > >
> > > > > > > On Wed, Jan 10, 2024 at 12:59 PM Denys Kuzmenko <
> > > > dkuzme...@apache.org>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > +1 for marking Hive 1.x EOL
> > > > > > > >
> > > > > > > > Assuming no volunteers willing to take ownership of branch-2
> > > > > > maintenance,
> > > > > > > > +1 to declare it EOL as well.
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Denys
> > > > > > > >
> > > > > >
> > > > >
> > > >
> >
>
>
>
>


[VOTE] Apache Hive 2.3.10 Release Candidate 0

2024-04-20 Thread Chao Sun
Apache Hive 2.3.10 Release Candidate 0 is available here:
https://people.apache.org/~sunchao/apache-hive-2.3.10-rc-0/
Maven artifacts are available here:
https://repository.apache.org/content/repositories/orgapachehive-1128
The
tag release-2.3.10-rc0 has been applied to the source for this
release in github, you can see it at
https://github.com/apache/hive/tree/release-2.3.10-rc0
Voting will conclude in 72 hours (or whenever I scrounge together enough
votes).

Hive PMC Members: Please test and vote.

Thanks.


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-20 Thread Akshat m
Congratulations Simhadri!, very well deserved

On Fri, Apr 19, 2024 at 3:37 PM Simhadri G  wrote:

> Thanks again everyone :)
>
> On Fri, Apr 19, 2024, 2:15 AM Rajesh Balamohan 
> wrote:
>
>> Congratulations Simhadri. :)
>>
>> ~Rajesh.B
>>
>> On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha  wrote:
>>
>>> Congrats Simhadri !
>>>
>>> On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam
>>>  wrote:
>>>
 Congrats Simhadri. Looking forward to many more contributions in the
 future.

 On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala
  wrote:

> Congratulations Simhadri  well deserved
>
> On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  wrote:
>
>> Congratulations
>>
>> Missatge de Alessandro Solimando 
>> del dia dj., 18 d’abr. 2024 a les 17:40:
>>
>>> Great news, Simhadri, very well deserved!
>>>
>>> On Thu, 18 Apr 2024 at 15:07, Simhadri G 
>>> wrote:
>>>
 Thanks everyone!
 I really appreciate it, it means a lot to me :)
 The Apache Hive project and its community have truly inspired me .
 I'm grateful for the chance to contribute to such a remarkable project.

 Thanks!
 Simhadri Govindappa

 On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
  wrote:

> Congrats Simhadri!
>
>
>
> -Sankar
>
>
>
> *From:* Butao Zhang 
> *Sent:* Thursday, April 18, 2024 5:39 PM
> *To:* u...@hive.apache.org; dev 
> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri
> Govindappa
>
>
>
> You don't often get email from butaozha...@163.com. Learn why
> this is important 
>
> Congratulations Simhadri !!!
>
>
>
> Thanks.
>
>
> --
>
> *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
> user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush
> Saxena 
> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
> *收件人**:* dev ; u...@hive.apache.org <
> u...@hive.apache.org>
> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>
>
>
> Hi All,
>
> Apache Hive's Project Management Committee (PMC) has invited
> Simhadri Govindappa to become a committer, and we are pleased to 
> announce
> that he has accepted.
>
>
>
> Please join me in congratulating him, Congratulations Simhadri,
> Welcome aboard!!!
>
>
>
> -Ayush Saxena
>
> (On behalf of Apache Hive PMC)
>

>>
>> --
>> --
>> Pau Tallada Crespí
>> Departament de Serveis
>> Port d'Informació Científica (PIC)
>> Tel: +34 93 170 2729
>> --
>>
>>


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-19 Thread Simhadri G
Thanks again everyone :)

On Fri, Apr 19, 2024, 2:15 AM Rajesh Balamohan 
wrote:

> Congratulations Simhadri. :)
>
> ~Rajesh.B
>
> On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha  wrote:
>
>> Congrats Simhadri !
>>
>> On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam
>>  wrote:
>>
>>> Congrats Simhadri. Looking forward to many more contributions in the
>>> future.
>>>
>>> On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala
>>>  wrote:
>>>
 Congratulations Simhadri  well deserved

 On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  wrote:

> Congratulations
>
> Missatge de Alessandro Solimando  del
> dia dj., 18 d’abr. 2024 a les 17:40:
>
>> Great news, Simhadri, very well deserved!
>>
>> On Thu, 18 Apr 2024 at 15:07, Simhadri G 
>> wrote:
>>
>>> Thanks everyone!
>>> I really appreciate it, it means a lot to me :)
>>> The Apache Hive project and its community have truly inspired me .
>>> I'm grateful for the chance to contribute to such a remarkable project.
>>>
>>> Thanks!
>>> Simhadri Govindappa
>>>
>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>  wrote:
>>>
 Congrats Simhadri!



 -Sankar



 *From:* Butao Zhang 
 *Sent:* Thursday, April 18, 2024 5:39 PM
 *To:* u...@hive.apache.org; dev 
 *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri
 Govindappa



 You don't often get email from butaozha...@163.com. Learn why this
 is important 

 Congratulations Simhadri !!!



 Thanks.


 --

 *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
 user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush
 Saxena 
 *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
 *收件人**:* dev ; u...@hive.apache.org <
 u...@hive.apache.org>
 *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa



 Hi All,

 Apache Hive's Project Management Committee (PMC) has invited
 Simhadri Govindappa to become a committer, and we are pleased to 
 announce
 that he has accepted.



 Please join me in congratulating him, Congratulations Simhadri,
 Welcome aboard!!!



 -Ayush Saxena

 (On behalf of Apache Hive PMC)

>>>
>
> --
> --
> Pau Tallada Crespí
> Departament de Serveis
> Port d'Informació Científica (PIC)
> Tel: +34 93 170 2729
> --
>
>


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Rajesh Balamohan
Congratulations Simhadri. :)

~Rajesh.B

On Fri, Apr 19, 2024 at 2:02 AM Aman Sinha  wrote:

> Congrats Simhadri !
>
> On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam
>  wrote:
>
>> Congrats Simhadri. Looking forward to many more contributions in the
>> future.
>>
>> On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala
>>  wrote:
>>
>>> Congratulations Simhadri  well deserved
>>>
>>> On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  wrote:
>>>
 Congratulations

 Missatge de Alessandro Solimando  del
 dia dj., 18 d’abr. 2024 a les 17:40:

> Great news, Simhadri, very well deserved!
>
> On Thu, 18 Apr 2024 at 15:07, Simhadri G 
> wrote:
>
>> Thanks everyone!
>> I really appreciate it, it means a lot to me :)
>> The Apache Hive project and its community have truly inspired me .
>> I'm grateful for the chance to contribute to such a remarkable project.
>>
>> Thanks!
>> Simhadri Govindappa
>>
>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>  wrote:
>>
>>> Congrats Simhadri!
>>>
>>>
>>>
>>> -Sankar
>>>
>>>
>>>
>>> *From:* Butao Zhang 
>>> *Sent:* Thursday, April 18, 2024 5:39 PM
>>> *To:* u...@hive.apache.org; dev 
>>> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri
>>> Govindappa
>>>
>>>
>>>
>>> You don't often get email from butaozha...@163.com. Learn why this
>>> is important 
>>>
>>> Congratulations Simhadri !!!
>>>
>>>
>>>
>>> Thanks.
>>>
>>>
>>> --
>>>
>>> *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
>>> user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush
>>> Saxena 
>>> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
>>> *收件人**:* dev ; u...@hive.apache.org <
>>> u...@hive.apache.org>
>>> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>>>
>>>
>>>
>>> Hi All,
>>>
>>> Apache Hive's Project Management Committee (PMC) has invited
>>> Simhadri Govindappa to become a committer, and we are pleased to 
>>> announce
>>> that he has accepted.
>>>
>>>
>>>
>>> Please join me in congratulating him, Congratulations Simhadri,
>>> Welcome aboard!!!
>>>
>>>
>>>
>>> -Ayush Saxena
>>>
>>> (On behalf of Apache Hive PMC)
>>>
>>

 --
 --
 Pau Tallada Crespí
 Departament de Serveis
 Port d'Informació Científica (PIC)
 Tel: +34 93 170 2729
 --




Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Aman Sinha
Congrats Simhadri !

On Thu, Apr 18, 2024 at 12:25 PM Naveen Gangam 
wrote:

> Congrats Simhadri. Looking forward to many more contributions in the
> future.
>
> On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala
>  wrote:
>
>> Congratulations Simhadri  well deserved
>>
>> On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  wrote:
>>
>>> Congratulations
>>>
>>> Missatge de Alessandro Solimando  del
>>> dia dj., 18 d’abr. 2024 a les 17:40:
>>>
 Great news, Simhadri, very well deserved!

 On Thu, 18 Apr 2024 at 15:07, Simhadri G  wrote:

> Thanks everyone!
> I really appreciate it, it means a lot to me :)
> The Apache Hive project and its community have truly inspired me . I'm
> grateful for the chance to contribute to such a remarkable project.
>
> Thanks!
> Simhadri Govindappa
>
> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>  wrote:
>
>> Congrats Simhadri!
>>
>>
>>
>> -Sankar
>>
>>
>>
>> *From:* Butao Zhang 
>> *Sent:* Thursday, April 18, 2024 5:39 PM
>> *To:* u...@hive.apache.org; dev 
>> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri
>> Govindappa
>>
>>
>>
>> You don't often get email from butaozha...@163.com. Learn why this
>> is important 
>>
>> Congratulations Simhadri !!!
>>
>>
>>
>> Thanks.
>>
>>
>> --
>>
>> *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
>> user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush
>> Saxena 
>> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
>> *收件人**:* dev ; u...@hive.apache.org <
>> u...@hive.apache.org>
>> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>>
>>
>>
>> Hi All,
>>
>> Apache Hive's Project Management Committee (PMC) has invited Simhadri
>> Govindappa to become a committer, and we are pleased to announce that he
>> has accepted.
>>
>>
>>
>> Please join me in congratulating him, Congratulations Simhadri,
>> Welcome aboard!!!
>>
>>
>>
>> -Ayush Saxena
>>
>> (On behalf of Apache Hive PMC)
>>
>
>>>
>>> --
>>> --
>>> Pau Tallada Crespí
>>> Departament de Serveis
>>> Port d'Informació Científica (PIC)
>>> Tel: +34 93 170 2729
>>> --
>>>
>>>


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Naveen Gangam
Congrats Simhadri. Looking forward to many more contributions in the future.

On Thu, Apr 18, 2024 at 12:25 PM Sai Hemanth Gantasala
 wrote:

> Congratulations Simhadri  well deserved
>
> On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  wrote:
>
>> Congratulations
>>
>> Missatge de Alessandro Solimando  del
>> dia dj., 18 d’abr. 2024 a les 17:40:
>>
>>> Great news, Simhadri, very well deserved!
>>>
>>> On Thu, 18 Apr 2024 at 15:07, Simhadri G  wrote:
>>>
 Thanks everyone!
 I really appreciate it, it means a lot to me :)
 The Apache Hive project and its community have truly inspired me . I'm
 grateful for the chance to contribute to such a remarkable project.

 Thanks!
 Simhadri Govindappa

 On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
  wrote:

> Congrats Simhadri!
>
>
>
> -Sankar
>
>
>
> *From:* Butao Zhang 
> *Sent:* Thursday, April 18, 2024 5:39 PM
> *To:* u...@hive.apache.org; dev 
> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri
> Govindappa
>
>
>
> You don't often get email from butaozha...@163.com. Learn why this is
> important 
>
> Congratulations Simhadri !!!
>
>
>
> Thanks.
>
>
> --
>
> *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
> user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush
> Saxena 
> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
> *收件人**:* dev ; u...@hive.apache.org <
> u...@hive.apache.org>
> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>
>
>
> Hi All,
>
> Apache Hive's Project Management Committee (PMC) has invited Simhadri
> Govindappa to become a committer, and we are pleased to announce that he
> has accepted.
>
>
>
> Please join me in congratulating him, Congratulations Simhadri,
> Welcome aboard!!!
>
>
>
> -Ayush Saxena
>
> (On behalf of Apache Hive PMC)
>

>>
>> --
>> --
>> Pau Tallada Crespí
>> Departament de Serveis
>> Port d'Informació Científica (PIC)
>> Tel: +34 93 170 2729
>> --
>>
>>


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Sai Hemanth Gantasala
Congratulations Simhadri  well deserved

On Thu, Apr 18, 2024 at 8:41 AM Pau Tallada  wrote:

> Congratulations
>
> Missatge de Alessandro Solimando  del dia
> dj., 18 d’abr. 2024 a les 17:40:
>
>> Great news, Simhadri, very well deserved!
>>
>> On Thu, 18 Apr 2024 at 15:07, Simhadri G  wrote:
>>
>>> Thanks everyone!
>>> I really appreciate it, it means a lot to me :)
>>> The Apache Hive project and its community have truly inspired me . I'm
>>> grateful for the chance to contribute to such a remarkable project.
>>>
>>> Thanks!
>>> Simhadri Govindappa
>>>
>>> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>>>  wrote:
>>>
 Congrats Simhadri!



 -Sankar



 *From:* Butao Zhang 
 *Sent:* Thursday, April 18, 2024 5:39 PM
 *To:* u...@hive.apache.org; dev 
 *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa



 You don't often get email from butaozha...@163.com. Learn why this is
 important 

 Congratulations Simhadri !!!



 Thanks.


 --

 *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
 user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush Saxena
 
 *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
 *收件人**:* dev ; u...@hive.apache.org <
 u...@hive.apache.org>
 *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa



 Hi All,

 Apache Hive's Project Management Committee (PMC) has invited Simhadri
 Govindappa to become a committer, and we are pleased to announce that he
 has accepted.



 Please join me in congratulating him, Congratulations Simhadri, Welcome
 aboard!!!



 -Ayush Saxena

 (On behalf of Apache Hive PMC)

>>>
>
> --
> --
> Pau Tallada Crespí
> Departament de Serveis
> Port d'Informació Científica (PIC)
> Tel: +34 93 170 2729
> --
>
>


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Alessandro Solimando
Great news, Simhadri, very well deserved!

On Thu, 18 Apr 2024 at 15:07, Simhadri G  wrote:

> Thanks everyone!
> I really appreciate it, it means a lot to me :)
> The Apache Hive project and its community have truly inspired me . I'm
> grateful for the chance to contribute to such a remarkable project.
>
> Thanks!
> Simhadri Govindappa
>
> On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
>  wrote:
>
>> Congrats Simhadri!
>>
>>
>>
>> -Sankar
>>
>>
>>
>> *From:* Butao Zhang 
>> *Sent:* Thursday, April 18, 2024 5:39 PM
>> *To:* u...@hive.apache.org; dev 
>> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
>>
>>
>>
>> You don't often get email from butaozha...@163.com. Learn why this is
>> important 
>>
>> Congratulations Simhadri !!!
>>
>>
>>
>> Thanks.
>>
>>
>> --
>>
>> *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
>> user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush Saxena <
>> ayush...@gmail.com>
>> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
>> *收件人**:* dev ; u...@hive.apache.org <
>> u...@hive.apache.org>
>> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>>
>>
>>
>> Hi All,
>>
>> Apache Hive's Project Management Committee (PMC) has invited Simhadri
>> Govindappa to become a committer, and we are pleased to announce that he
>> has accepted.
>>
>>
>>
>> Please join me in congratulating him, Congratulations Simhadri, Welcome
>> aboard!!!
>>
>>
>>
>> -Ayush Saxena
>>
>> (On behalf of Apache Hive PMC)
>>
>


Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Krisztian Kasa
Congratulations Simhadri!

Regards,
Krisztian

On Thu, Apr 18, 2024 at 3:25 PM kokila narayanan <
kokilanarayana...@gmail.com> wrote:

> Congratulations Simhadri 
>
> On Thu, 18 Apr, 2024, 17:22 Ayush Saxena,  wrote:
>
>> Hi All,
>> Apache Hive's Project Management Committee (PMC) has invited Simhadri
>> Govindappa to become a committer, and we are pleased to announce that he
>> has accepted.
>>
>> Please join me in congratulating him, Congratulations Simhadri, Welcome
>> aboard!!!
>>
>> -Ayush Saxena
>> (On behalf of Apache Hive PMC)
>>
>


Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread kokila narayanan
Congratulations Simhadri 

On Thu, 18 Apr, 2024, 17:22 Ayush Saxena,  wrote:

> Hi All,
> Apache Hive's Project Management Committee (PMC) has invited Simhadri
> Govindappa to become a committer, and we are pleased to announce that he
> has accepted.
>
> Please join me in congratulating him, Congratulations Simhadri, Welcome
> aboard!!!
>
> -Ayush Saxena
> (On behalf of Apache Hive PMC)
>


Re: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Simhadri G
Thanks everyone!
I really appreciate it, it means a lot to me :)
The Apache Hive project and its community have truly inspired me . I'm
grateful for the chance to contribute to such a remarkable project.

Thanks!
Simhadri Govindappa

On Thu, Apr 18, 2024 at 6:18 PM Sankar Hariappan
 wrote:

> Congrats Simhadri!
>
>
>
> -Sankar
>
>
>
> *From:* Butao Zhang 
> *Sent:* Thursday, April 18, 2024 5:39 PM
> *To:* u...@hive.apache.org; dev 
> *Subject:* [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa
>
>
>
> You don't often get email from butaozha...@163.com. Learn why this is
> important 
>
> Congratulations Simhadri !!!
>
>
>
> Thanks.
>
>
> --
>
> *发件人**:* user-return-28075-butaozhang1=163@hive.apache.org <
> user-return-28075-butaozhang1=163@hive.apache.org> 代表 Ayush Saxena <
> ayush...@gmail.com>
> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
> *收件人**:* dev ; u...@hive.apache.org <
> u...@hive.apache.org>
> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>
>
>
> Hi All,
>
> Apache Hive's Project Management Committee (PMC) has invited Simhadri
> Govindappa to become a committer, and we are pleased to announce that he
> has accepted.
>
>
>
> Please join me in congratulating him, Congratulations Simhadri, Welcome
> aboard!!!
>
>
>
> -Ayush Saxena
>
> (On behalf of Apache Hive PMC)
>


RE: Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Sankar Hariappan
Congrats Simhadri!

-Sankar

From: Butao Zhang 
Sent: Thursday, April 18, 2024 5:39 PM
To: u...@hive.apache.org; dev 
Subject: [EXTERNAL] Re: [ANNOUNCE] New Committer: Simhadri Govindappa

You don't often get email from butaozha...@163.com. 
Learn why this is important
Congratulations Simhadri !!!

Thanks.


发件人: 
user-return-28075-butaozhang1=163@hive.apache.org
 
mailto:user-return-28075-butaozhang1=163@hive.apache.org>>
 代表 Ayush Saxena mailto:ayush...@gmail.com>>
发送时间: 星期四, 四月 18, 2024 7:50 下午
收件人: dev mailto:dev@hive.apache.org>>; 
u...@hive.apache.org 
mailto:u...@hive.apache.org>>
主题: [ANNOUNCE] New Committer: Simhadri Govindappa

Hi All,
Apache Hive's Project Management Committee (PMC) has invited Simhadri 
Govindappa to become a committer, and we are pleased to announce that he has 
accepted.

Please join me in congratulating him, Congratulations Simhadri, Welcome 
aboard!!!

-Ayush Saxena
(On behalf of Apache Hive PMC)


Re: [DISCUS] Plan the next Hive release

2024-04-18 Thread Denys Kuzmenko
The idea is to cherry-pick individual bug fixes/improvements that could be 
easily tested to avoid a complete release test cycle (TPC-DS performance suite, 
multi-db tests, etc)

On 2024/04/18 11:22:09 Stamatis Zampetakis wrote:
> There are also many projects that never create minor version releases;
> it's up to each project to decide what fits best on each occasion.
> 
> I am not against minor releases nor suggest that this should be the
> way to go for every release from now onwards. I am just saying that at
> this point in time I don't see a big benefit to release from side
> branches.
> 
> Again the motivation for releasing early and often from master is that
> it has less maintenance overhead for the community and the end-users
> can benefit from all improvements as soon as possible. Certainly if we
> introduce breaking changes and big risky features this approach cannot
> work.
> 
> Anyways, I am glad that we are having this discussion and it's also
> very positive that we are talking about a new release in less than a
> month since 4.0.0 came out. No matter if it is 4.0.1 or 4.1.0 I am
> fully onboard and happy to help as much as I can :)
> 
> Best,
> Stamatis
> 
> On Thu, Apr 18, 2024 at 11:53 AM Denys Kuzmenko  wrote:
> >
> > Hi Stamatis,
> >
> > That is the standard practice to create minor version release for bugfixes. 
> > Many upstream projects follow that same strategy, check Iceberg for example.
> >
> > Regards,
> > Denys
> >
> > On 2024/04/18 07:49:59 Stamatis Zampetakis wrote:
> > > The 4.0.0 release was quite recent so I assume we don't have major
> > > breaking changes in there at the moment so we could cut the release
> > > directly from master as soon as we want. HIVE-28166 is already merged
> > > so we could aim to cut 4.1.0 as soon as HIVE-28190 goes in.
> > >
> > > The experience shows that we are not very good at maintaining multiple
> > > release branches so in general I would prefer to focus on releasing
> > > only from master for the time being. Hive is a quite mature project so
> > > in principle breaking changes should be rather rare which gives us a
> > > bit of margin. I think a scheme where we backport less and release
> > > more is preferable.
> > >
> > > Best,
> > > Stamatis
> > >
> > > On Wed, Apr 17, 2024 at 9:56 AM Ayush Saxena  wrote:
> > > >
> > > > Hi Stamatis,
> > > > The plan is to have a release line cut from the branch-4.0, So, we plan 
> > > > to pull in some critical bug fixes & improvements into the 4.0.1 
> > > > release and have a quicker release.
> > > > As of now we are just putting the label "hive-4.0.1-must" on the 
> > > > tickets and we plan to make sure those get c-picked to the release 
> > > > line. AFAIK we haven't started committing to any branch yet, was 
> > > > waiting if anyone feels differently, so we can hold back if you have 
> > > > concerns or take a different approach as well.
> > > >
> > > > From CI you mean to say the daily builds? else if you create a PR 
> > > > targeting to branch-4.0, it will run the entire test suite I believe? 
> > > > In the meantime I will update the instructions regarding the target 
> > > > branch & the label if anyone wants that a particular ticket to be part 
> > > > of the 4.0.1 release.
> > > >
> > > > -Ayush
> > > >
> > > > On Wed, 17 Apr 2024 at 12:42, Stamatis Zampetakis  
> > > > wrote:
> > > >>
> > > >> Thanks for starting the discussion Ayush.
> > > >>
> > > >> Having frequent releases is definitely needed so we should keep the
> > > >> momentum going.
> > > >>
> > > >> I had the impression from other threads that the next Hive release
> > > >> would be 4.1.0 and that it would be cut from master. I would like to
> > > >> understand how 4.0.1 is different and if it is, what is the
> > > >> contribution pattern that contributors and committers should follow?
> > > >> If the idea is to maintain and commit in two (or more) branches the
> > > >> steps should be documented and CI should be running on those branches.
> > > >>
> > > >> Best,
> > > >> Stamatis
> > > >>
> > > >> On Wed, Apr 10, 2024 at 1:18 PM Denys Kuzmenko  
> > > >> wrote:
> > > >> >
> > > >> > We might need it sooner as identified some critical issues in the 
> > > >> > recent code:
> > > >> > 1. HIVE-28166: Truncate on Iceberg table disregards the branch name 
> > > >> > and operates on a main;
> > > >> > 2. HIVE-28190: Materialized view rebuild lock heart-beating is 
> > > >> > broken;
> > >
> 


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-18 Thread Cheng Pan
Simhadri, thank you for sharing the information.

Thanks,
Cheng Pan




Re: [DISCUSS] End of life for Hive 1.x, 2.x, 3.x

2024-04-18 Thread Cheng Pan
Hi Chao,

The Spark community is starting to discuss the 4.0 release[1], can we make the 
Hive 2.3.10 release happen soon?

[1] https://lists.apache.org/thread/nxmvz2j7kp96otzlnl3kd277knlb6qgb

Thanks,
Cheng Pan

On 2024/01/17 17:50:37 Chao Sun wrote:
> Hi Ayush,
> 
> I'm working on the last few commits to backport to the branch.
> Hopefully within 1-2 months I can start the release process. Our goal
> is to upgrade Hive 2.x before the Spark 4.0 release coming up mid this
> year.
> 
> Chao
> 
> On Tue, Jan 16, 2024 at 10:17 PM Ayush Saxena  wrote:
> >
> > Thanx everyone for the feedback, I have started a formal thread to mark 1.x
> > EOL. We can have one last release for 2.x as Chao mentioned, with some
> > required changes + our CVE's & get the release line marked as EOL then.
> >
> > @Chao Sun  Do let us know if you have a proposed
> > timeline for that.
> >
> > -Ayush
> >
> > On Wed, 17 Jan 2024 at 08:23, vihang karajgaonkar 
> > wrote:
> >
> > > I was confused about the subject line since it says 3.x as well along with
> > > 1.x and 2.x. Does this discussion include all 1.x, 2.x and 3.x or just 1.x
> > > and 2.x?
> > >
> > > I think it makes sense to EOL 1.x. Looks like 2.x is still being 
> > > maintained
> > > by Chao and I think we were backporting PRs to the 3.x line pretty 
> > > recently
> > > so I believe we should wait out for a release on Hive 3.x.
> > >
> > > Thanks,
> > > Vihang
> > >
> > > On Tue, Jan 16, 2024 at 3:40 PM Attila Turoczy
> > >  wrote:
> > >
> > > > Dear PMC's,
> > > >
> > > > Do we have a verdict / decision about this?
> > > >
> > > > -Attila
> > > >
> > > > On Wed, Jan 10, 2024 at 5:45 PM Chao Sun  wrote:
> > > >
> > > > > On Hive 2.x, I'm still preparing for another release 2.3.10 (Hive 2.3
> > > > > branch is being actively maintained so far). Hopefully this will be
> > > > > the last release in the branch-2 line.
> > > > >
> > > > > +1 on making Hive 1 EOL for the time being.
> > > > >
> > > > > Chao
> > > > >
> > > > > On Wed, Jan 10, 2024 at 8:10 AM Sankar Hariappan
> > > > >  wrote:
> > > > > >
> > > > > > +1 for making both Hive 1&2 EOL
> > > > > >
> > > > > > -Sankar
> > > > > > -Original Message-
> > > > > > From: Attila Turoczy 
> > > > > > Sent: Wednesday, January 10, 2024 7:37 PM
> > > > > > To: dev@hive.apache.org
> > > > > > Subject: [EXTERNAL] Re: [DISCUSS] End of life for Hive 1.x, 2.x, 3.x
> > > > > >
> > > > > > [You don't often get email from aturo...@cloudera.com.invalid. Learn
> > > > > why this is important at https://aka.ms/LearnAboutSenderIdentification
> > > ]
> > > > > >
> > > > > > +1 for making it EOL for Hive 1 and Hive 2. I do not think these 2
> > > > > product
> > > > > > branches are relevant in 2023.
> > > > > >
> > > > > > -Attila
> > > > > >
> > > > > > On Wed, Jan 10, 2024 at 12:59 PM Denys Kuzmenko <
> > > dkuzme...@apache.org>
> > > > > > wrote:
> > > > > >
> > > > > > > +1 for marking Hive 1.x EOL
> > > > > > >
> > > > > > > Assuming no volunteers willing to take ownership of branch-2
> > > > > maintenance,
> > > > > > > +1 to declare it EOL as well.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Denys
> > > > > > >
> > > > >
> > > >
> > >
>  





Re: [ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Butao Zhang

  
  
  

Congratulations Simhadri !!!
Thanks.
  

 发件人: user-return-28075-butaozhang1=163@hive.apache.org  代表 Ayush Saxena 发送时间: 星期四, 四月 18, 2024 7:50 下午收件人: dev ; u...@hive.apache.org 主题: [ANNOUNCE] New Committer: Simhadri Govindappa Hi All,Apache Hive's Project Management Committee (PMC) has invited Simhadri Govindappa to become a committer, and we are pleased to announce that he has accepted.Please join me in congratulating him, Congratulations Simhadri, Welcome aboard!!!-Ayush Saxena(On behalf of Apache Hive PMC)




[ANNOUNCE] New Committer: Simhadri Govindappa

2024-04-18 Thread Ayush Saxena
Hi All,
Apache Hive's Project Management Committee (PMC) has invited Simhadri
Govindappa to become a committer, and we are pleased to announce that he
has accepted.

Please join me in congratulating him, Congratulations Simhadri, Welcome
aboard!!!

-Ayush Saxena
(On behalf of Apache Hive PMC)


Re: [DISCUS] Plan the next Hive release

2024-04-18 Thread Stamatis Zampetakis
There are also many projects that never create minor version releases;
it's up to each project to decide what fits best on each occasion.

I am not against minor releases nor suggest that this should be the
way to go for every release from now onwards. I am just saying that at
this point in time I don't see a big benefit to release from side
branches.

Again the motivation for releasing early and often from master is that
it has less maintenance overhead for the community and the end-users
can benefit from all improvements as soon as possible. Certainly if we
introduce breaking changes and big risky features this approach cannot
work.

Anyways, I am glad that we are having this discussion and it's also
very positive that we are talking about a new release in less than a
month since 4.0.0 came out. No matter if it is 4.0.1 or 4.1.0 I am
fully onboard and happy to help as much as I can :)

Best,
Stamatis

On Thu, Apr 18, 2024 at 11:53 AM Denys Kuzmenko  wrote:
>
> Hi Stamatis,
>
> That is the standard practice to create minor version release for bugfixes. 
> Many upstream projects follow that same strategy, check Iceberg for example.
>
> Regards,
> Denys
>
> On 2024/04/18 07:49:59 Stamatis Zampetakis wrote:
> > The 4.0.0 release was quite recent so I assume we don't have major
> > breaking changes in there at the moment so we could cut the release
> > directly from master as soon as we want. HIVE-28166 is already merged
> > so we could aim to cut 4.1.0 as soon as HIVE-28190 goes in.
> >
> > The experience shows that we are not very good at maintaining multiple
> > release branches so in general I would prefer to focus on releasing
> > only from master for the time being. Hive is a quite mature project so
> > in principle breaking changes should be rather rare which gives us a
> > bit of margin. I think a scheme where we backport less and release
> > more is preferable.
> >
> > Best,
> > Stamatis
> >
> > On Wed, Apr 17, 2024 at 9:56 AM Ayush Saxena  wrote:
> > >
> > > Hi Stamatis,
> > > The plan is to have a release line cut from the branch-4.0, So, we plan 
> > > to pull in some critical bug fixes & improvements into the 4.0.1 release 
> > > and have a quicker release.
> > > As of now we are just putting the label "hive-4.0.1-must" on the tickets 
> > > and we plan to make sure those get c-picked to the release line. AFAIK we 
> > > haven't started committing to any branch yet, was waiting if anyone feels 
> > > differently, so we can hold back if you have concerns or take a different 
> > > approach as well.
> > >
> > > From CI you mean to say the daily builds? else if you create a PR 
> > > targeting to branch-4.0, it will run the entire test suite I believe? In 
> > > the meantime I will update the instructions regarding the target branch & 
> > > the label if anyone wants that a particular ticket to be part of the 
> > > 4.0.1 release.
> > >
> > > -Ayush
> > >
> > > On Wed, 17 Apr 2024 at 12:42, Stamatis Zampetakis  
> > > wrote:
> > >>
> > >> Thanks for starting the discussion Ayush.
> > >>
> > >> Having frequent releases is definitely needed so we should keep the
> > >> momentum going.
> > >>
> > >> I had the impression from other threads that the next Hive release
> > >> would be 4.1.0 and that it would be cut from master. I would like to
> > >> understand how 4.0.1 is different and if it is, what is the
> > >> contribution pattern that contributors and committers should follow?
> > >> If the idea is to maintain and commit in two (or more) branches the
> > >> steps should be documented and CI should be running on those branches.
> > >>
> > >> Best,
> > >> Stamatis
> > >>
> > >> On Wed, Apr 10, 2024 at 1:18 PM Denys Kuzmenko  
> > >> wrote:
> > >> >
> > >> > We might need it sooner as identified some critical issues in the 
> > >> > recent code:
> > >> > 1. HIVE-28166: Truncate on Iceberg table disregards the branch name 
> > >> > and operates on a main;
> > >> > 2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;
> >


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-18 Thread Ayush Saxena
Update:
I submitted this last week, and I circled back to check, this is being
reviewed and they are dropping, tweaking a couple of things and writing
some Apache stuff & all to follow their template(Which I should have done
myself, they shared the template of Apache Wicket), those things we don’t
have any control over. M folks will take care of it. So, it will look a
bit different then what we submitted.

I have been communicated that:* It is supposed to be published before end
of month*

PS. They asked for some quotes for the release, which I have said I don’t
have. We can drop adding that, either they will drop or add from their own.
But I think they will write something themselves

I think it will be finalized soon, I will keep the thread updated as I get
anything or If I find it got published itself :-)

-Ayush


On 5 Apr 2024, at 5:39 PM, Ayush Saxena  wrote:


Hi Stamatis,
I have changed the permissions to allow everyone with the link to have
comment access. I have additionally given you edit access as well.

Let me know if things don't work

-Ayush

On Fri, 5 Apr 2024 at 17:34, Stamatis Zampetakis  wrote:

> Great initiative and nice content. Overall, it looks great!
>
> I have some minor comments. Is it possible to change permissions allow
> comments from anyone or it has to be done on a per user basis?
>
> Best,
> Stamatis
>
> On Fri, Apr 5, 2024 at 1:54 PM Ayush Saxena  wrote:
> >
> > Hi All,
> >
> > Have been talking to the ASF M & P team and they recongonise the 4.0
> release is a big milestone for our project.
> >
> > They are happy to have an entry for us in the their news column, ex:
> >
> https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10
> >
> > So, I along with Denys, Simhadri & tons of help from ChatGpt have
> prepared a draft to share with them.
> > The draft is here:
> >
> >
> https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit
> >
> > If you have some feedback or concerns, please share with us.
> >
> > If you want some improvements or removals, let us know here & we will do
> that, or if you need write access to this page, just let me know.
> >
> > If nobody objects, I plan to send this to the team by next week Tuesday
> >
> >
> > -Ayush
>


Re: [DISCUS] Plan the next Hive release

2024-04-18 Thread Denys Kuzmenko
Hi Stamatis,

That is the standard practice to create minor version release for bugfixes. 
Many upstream projects follow that same strategy, check Iceberg for example.

Regards,
Denys

On 2024/04/18 07:49:59 Stamatis Zampetakis wrote:
> The 4.0.0 release was quite recent so I assume we don't have major
> breaking changes in there at the moment so we could cut the release
> directly from master as soon as we want. HIVE-28166 is already merged
> so we could aim to cut 4.1.0 as soon as HIVE-28190 goes in.
> 
> The experience shows that we are not very good at maintaining multiple
> release branches so in general I would prefer to focus on releasing
> only from master for the time being. Hive is a quite mature project so
> in principle breaking changes should be rather rare which gives us a
> bit of margin. I think a scheme where we backport less and release
> more is preferable.
> 
> Best,
> Stamatis
> 
> On Wed, Apr 17, 2024 at 9:56 AM Ayush Saxena  wrote:
> >
> > Hi Stamatis,
> > The plan is to have a release line cut from the branch-4.0, So, we plan to 
> > pull in some critical bug fixes & improvements into the 4.0.1 release and 
> > have a quicker release.
> > As of now we are just putting the label "hive-4.0.1-must" on the tickets 
> > and we plan to make sure those get c-picked to the release line. AFAIK we 
> > haven't started committing to any branch yet, was waiting if anyone feels 
> > differently, so we can hold back if you have concerns or take a different 
> > approach as well.
> >
> > From CI you mean to say the daily builds? else if you create a PR targeting 
> > to branch-4.0, it will run the entire test suite I believe? In the meantime 
> > I will update the instructions regarding the target branch & the label if 
> > anyone wants that a particular ticket to be part of the 4.0.1 release.
> >
> > -Ayush
> >
> > On Wed, 17 Apr 2024 at 12:42, Stamatis Zampetakis  wrote:
> >>
> >> Thanks for starting the discussion Ayush.
> >>
> >> Having frequent releases is definitely needed so we should keep the
> >> momentum going.
> >>
> >> I had the impression from other threads that the next Hive release
> >> would be 4.1.0 and that it would be cut from master. I would like to
> >> understand how 4.0.1 is different and if it is, what is the
> >> contribution pattern that contributors and committers should follow?
> >> If the idea is to maintain and commit in two (or more) branches the
> >> steps should be documented and CI should be running on those branches.
> >>
> >> Best,
> >> Stamatis
> >>
> >> On Wed, Apr 10, 2024 at 1:18 PM Denys Kuzmenko  
> >> wrote:
> >> >
> >> > We might need it sooner as identified some critical issues in the recent 
> >> > code:
> >> > 1. HIVE-28166: Truncate on Iceberg table disregards the branch name and 
> >> > operates on a main;
> >> > 2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;
> 


Re: [DISCUS] Plan the next Hive release

2024-04-18 Thread Stamatis Zampetakis
The 4.0.0 release was quite recent so I assume we don't have major
breaking changes in there at the moment so we could cut the release
directly from master as soon as we want. HIVE-28166 is already merged
so we could aim to cut 4.1.0 as soon as HIVE-28190 goes in.

The experience shows that we are not very good at maintaining multiple
release branches so in general I would prefer to focus on releasing
only from master for the time being. Hive is a quite mature project so
in principle breaking changes should be rather rare which gives us a
bit of margin. I think a scheme where we backport less and release
more is preferable.

Best,
Stamatis

On Wed, Apr 17, 2024 at 9:56 AM Ayush Saxena  wrote:
>
> Hi Stamatis,
> The plan is to have a release line cut from the branch-4.0, So, we plan to 
> pull in some critical bug fixes & improvements into the 4.0.1 release and 
> have a quicker release.
> As of now we are just putting the label "hive-4.0.1-must" on the tickets and 
> we plan to make sure those get c-picked to the release line. AFAIK we haven't 
> started committing to any branch yet, was waiting if anyone feels 
> differently, so we can hold back if you have concerns or take a different 
> approach as well.
>
> From CI you mean to say the daily builds? else if you create a PR targeting 
> to branch-4.0, it will run the entire test suite I believe? In the meantime I 
> will update the instructions regarding the target branch & the label if 
> anyone wants that a particular ticket to be part of the 4.0.1 release.
>
> -Ayush
>
> On Wed, 17 Apr 2024 at 12:42, Stamatis Zampetakis  wrote:
>>
>> Thanks for starting the discussion Ayush.
>>
>> Having frequent releases is definitely needed so we should keep the
>> momentum going.
>>
>> I had the impression from other threads that the next Hive release
>> would be 4.1.0 and that it would be cut from master. I would like to
>> understand how 4.0.1 is different and if it is, what is the
>> contribution pattern that contributors and committers should follow?
>> If the idea is to maintain and commit in two (or more) branches the
>> steps should be documented and CI should be running on those branches.
>>
>> Best,
>> Stamatis
>>
>> On Wed, Apr 10, 2024 at 1:18 PM Denys Kuzmenko  wrote:
>> >
>> > We might need it sooner as identified some critical issues in the recent 
>> > code:
>> > 1. HIVE-28166: Truncate on Iceberg table disregards the branch name and 
>> > operates on a main;
>> > 2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-18 Thread Simhadri G
Hi Cheng Pan,

There is long running Hive mail thread discussing this here:
https://lists.apache.org/thread/sxcrcf4v9j630tl9domp0bn4m33bdq0s


On Thu, Apr 18, 2024 at 11:15 AM Cheng Pan  wrote:

> Hi Ayush,
>
> > Hive is already in discussion of marking Hive-2.x EOL, so at very best
> we would have one release and immediately after that we will announce it EOL
>
> Does the discussion happen in public? Is there an ETA for the final
> release of branch-2.3?
>
> Thanks,
> Cheng Pan
>
>
> > On Apr 17, 2024, at 18:03, Ayush Saxena  wrote:
> >
> > Thanx Cheng Pan for sharing the pointers, Do you have any list of issues
> or pointers on what are the challenges for Spark to move to a higher Hive
> version? I know upgrading libraries is quite challenging but it is
> inevitable.
> >
> > Hive is already in discussion of marking Hive-2.x EOL, so at very best
> we would have one release and immediately after that we will announce it
> EOL, maintaining a release line is quite an effort for us at Hive & doing
> it because other projects doesn't want to upgrade isn't a convincing reason
> for most of us. The best we can do is or are trying is to address issues
> for Spark whatever we can do as part of Hive code & would definitely need
> help/support from Spark side as well, since the move is from 2.x to 4.x, it
> would be a big change and would offer resistance on both sides.
> >
> > So, it would be great help if any pointers can be shared from Spark side
> for the move, if there is no help/interest from Spark then we can't do
> anything & there is no need for Hive-2.x either in that case :-)
> >
> > -Ayush
> >
> > On Wed, 17 Apr 2024 at 15:00, Cheng Pan  wrote:
> > > … we are exploring ways to get Spark move from 2.3.9 to 4.0, Our
> initial hunch is that it would be quite challenging without a hive-exec
> slim jar …
> >
> > It should be challenging to upgrade Spark’s built-in Hive version.
> Actually, we already did lots of work on branch-2.3 which focuses on CVE
> reduction, for example, allowing Spark to upgrade Guava to modern versions
> to get rid of Guava 14, it was tested with the latest Spark master
> branch[1], maybe we need a release for 2.3.10 now.
> >
> > [1] https://github.com/apache/spark/pull/45372
> >
> > Thanks,
> > Cheng Pan
> >
> >
>
>


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-17 Thread Cheng Pan
Hi Ayush,

> Hive is already in discussion of marking Hive-2.x EOL, so at very best we 
> would have one release and immediately after that we will announce it EOL

Does the discussion happen in public? Is there an ETA for the final release of 
branch-2.3?

Thanks,
Cheng Pan


> On Apr 17, 2024, at 18:03, Ayush Saxena  wrote:
> 
> Thanx Cheng Pan for sharing the pointers, Do you have any list of issues or 
> pointers on what are the challenges for Spark to move to a higher Hive 
> version? I know upgrading libraries is quite challenging but it is inevitable.
> 
> Hive is already in discussion of marking Hive-2.x EOL, so at very best we 
> would have one release and immediately after that we will announce it EOL, 
> maintaining a release line is quite an effort for us at Hive & doing it 
> because other projects doesn't want to upgrade isn't a convincing reason for 
> most of us. The best we can do is or are trying is to address issues for 
> Spark whatever we can do as part of Hive code & would definitely need 
> help/support from Spark side as well, since the move is from 2.x to 4.x, it 
> would be a big change and would offer resistance on both sides.
> 
> So, it would be great help if any pointers can be shared from Spark side for 
> the move, if there is no help/interest from Spark then we can't do anything & 
> there is no need for Hive-2.x either in that case :-) 
> 
> -Ayush
> 
> On Wed, 17 Apr 2024 at 15:00, Cheng Pan  wrote:
> > … we are exploring ways to get Spark move from 2.3.9 to 4.0, Our initial 
> > hunch is that it would be quite challenging without a hive-exec slim jar …
> 
> It should be challenging to upgrade Spark’s built-in Hive version. Actually, 
> we already did lots of work on branch-2.3 which focuses on CVE reduction, for 
> example, allowing Spark to upgrade Guava to modern versions to get rid of 
> Guava 14, it was tested with the latest Spark master branch[1], maybe we need 
> a release for 2.3.10 now.
> 
> [1] https://github.com/apache/spark/pull/45372
> 
> Thanks,
> Cheng Pan
> 
> 



Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-17 Thread Ayush Saxena
Thanx Cheng Pan for sharing the pointers, Do you have any list of issues or
pointers on what are the challenges for Spark to move to a higher Hive
version? I know upgrading libraries is quite challenging but it
is inevitable.

Hive is already in discussion of marking Hive-2.x EOL, so at very best we
would have one release and immediately after that we will announce it EOL,
maintaining a release line is quite an effort for us at Hive & doing it
because other projects doesn't want to upgrade isn't a convincing reason
for most of us. The best we can do is or are trying is to address issues
for Spark whatever we can do as part of Hive code & would definitely need
help/support from Spark side as well, since the move is from 2.x to 4.x, it
would be a big change and would offer resistance on both sides.

So, it would be great help if any pointers can be shared from Spark side
for the move, if there is no help/interest from Spark then we can't do
anything & there is no need for Hive-2.x either in that case :-)

-Ayush

On Wed, 17 Apr 2024 at 15:00, Cheng Pan  wrote:

> > … we are exploring ways to get Spark move from 2.3.9 to 4.0, Our initial
> hunch is that it would be quite challenging without a hive-exec slim jar …
>
> It should be challenging to upgrade Spark’s built-in Hive version.
> Actually, we already did lots of work on branch-2.3 which focuses on CVE
> reduction, for example, allowing Spark to upgrade Guava to modern versions
> to get rid of Guava 14, it was tested with the latest Spark master
> branch[1], maybe we need a release for 2.3.10 now.
>
> [1] https://github.com/apache/spark/pull/45372
>
> Thanks,
> Cheng Pan
>
>
>


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-17 Thread Cheng Pan
> … we are exploring ways to get Spark move from 2.3.9 to 4.0, Our initial 
> hunch is that it would be quite challenging without a hive-exec slim jar …

It should be challenging to upgrade Spark’s built-in Hive version. Actually, we 
already did lots of work on branch-2.3 which focuses on CVE reduction, for 
example, allowing Spark to upgrade Guava to modern versions to get rid of Guava 
14, it was tested with the latest Spark master branch[1], maybe we need a 
release for 2.3.10 now.

[1] https://github.com/apache/spark/pull/45372

Thanks,
Cheng Pan




Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-17 Thread Cheng Pan
There is a JIRA ticket[1] that tracks "upgrading built-in Hive to 3+”

BTW, regarding HMS API used by Spark, the Hive 2.3.9 client is compatible with 
HMS from 2.0 to 4.0, while the upcoming Hive 2.3.10 client should be compatible 
with HMS from 1.2 to 4.0, if we decide to upgrade the built-in Hive, it’s 
better to keep such compatibility.

[1] https://issues.apache.org/jira/browse/SPARK-44114

Thanks,
Cheng Pan


> On Apr 17, 2024, at 18:03, Ayush Saxena  wrote:
> 
> Thanx Cheng Pan for sharing the pointers, Do you have any list of issues or 
> pointers on what are the challenges for Spark to move to a higher Hive 
> version? I know upgrading libraries is quite challenging but it is inevitable.
> 
> Hive is already in discussion of marking Hive-2.x EOL, so at very best we 
> would have one release and immediately after that we will announce it EOL, 
> maintaining a release line is quite an effort for us at Hive & doing it 
> because other projects doesn't want to upgrade isn't a convincing reason for 
> most of us. The best we can do is or are trying is to address issues for 
> Spark whatever we can do as part of Hive code & would definitely need 
> help/support from Spark side as well, since the move is from 2.x to 4.x, it 
> would be a big change and would offer resistance on both sides.
> 
> So, it would be great help if any pointers can be shared from Spark side for 
> the move, if there is no help/interest from Spark then we can't do anything & 
> there is no need for Hive-2.x either in that case :-) 
> 
> -Ayush
> 
> On Wed, 17 Apr 2024 at 15:00, Cheng Pan  wrote:
> > … we are exploring ways to get Spark move from 2.3.9 to 4.0, Our initial 
> > hunch is that it would be quite challenging without a hive-exec slim jar …
> 
> It should be challenging to upgrade Spark’s built-in Hive version. Actually, 
> we already did lots of work on branch-2.3 which focuses on CVE reduction, for 
> example, allowing Spark to upgrade Guava to modern versions to get rid of 
> Guava 14, it was tested with the latest Spark master branch[1], maybe we need 
> a release for 2.3.10 now.
> 
> [1] https://github.com/apache/spark/pull/45372
> 
> Thanks,
> Cheng Pan
> 
> 



Re: [DISCUS] Plan the next Hive release

2024-04-17 Thread Ayush Saxena
Hi Stamatis,
The plan is to have a release line cut from the branch-4.0, So, we plan to
pull in some critical bug fixes & improvements into the 4.0.1 release and
have a quicker release.
As of now we are just putting the label "hive-4.0.1-must" on the tickets
and we plan to make sure those get c-picked to the release line. AFAIK we
haven't started committing to any branch yet, was waiting if anyone feels
differently, so we can hold back if you have concerns or take a different
approach as well.

>From CI you mean to say the daily builds? else if you create a PR
targeting to branch-4.0, it will run the entire test suite I believe? In
the meantime I will update the instructions regarding the target branch &
the label if anyone wants that a particular ticket to be part of the 4.0.1
release.

-Ayush

On Wed, 17 Apr 2024 at 12:42, Stamatis Zampetakis  wrote:

> Thanks for starting the discussion Ayush.
>
> Having frequent releases is definitely needed so we should keep the
> momentum going.
>
> I had the impression from other threads that the next Hive release
> would be 4.1.0 and that it would be cut from master. I would like to
> understand how 4.0.1 is different and if it is, what is the
> contribution pattern that contributors and committers should follow?
> If the idea is to maintain and commit in two (or more) branches the
> steps should be documented and CI should be running on those branches.
>
> Best,
> Stamatis
>
> On Wed, Apr 10, 2024 at 1:18 PM Denys Kuzmenko 
> wrote:
> >
> > We might need it sooner as identified some critical issues in the recent
> code:
> > 1. HIVE-28166: Truncate on Iceberg table disregards the branch name and
> operates on a main;
> > 2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;
>


Archive old Hive releases

2024-04-17 Thread Stamatis Zampetakis
Hi all,

Following the INFRA policy [1] about handling current and older
releases, I just removed the following releases from the main download
site [2].

Apache Hive 1.2.2
Apache Hive 3.1.2
Apache Hive 1.2.2
Apache Hive 4.0.0-alpha-1
Apache Hive 4.0.0-alpha-2
Apache Hive 4.0.0-beta-1

The aforementioned releases can now be found in the archive [3]. When
a new release comes out we should keep in mind to perform the
necessary cleanup thus I added a new section in the wiki [4].

Best,
Stamatis

[1] 
https://infra.apache.org/release-download-pages.html#current-and-older-releases
[2] https://downloads.apache.org/hive/
[3] https://archive.apache.org/dist/hive/
[4] 
https://cwiki.apache.org/confluence/display/Hive/HowToRelease#HowToRelease-Archiveoldreleases


Query Regarding Core Classified Hive-Exec Artifact in Future Releases

2024-04-17 Thread Mergu Ravi
Hi Hive Team,
>From this Hive ticket https://issues.apache.org/jira/browse/HIVE-25531, I
understood that the core classified hive-exec artifact was removed. Is
there any plan to include this core artifact in upcoming releases?
-- 

Thanks & Regards,
Ravi Mergu


Re: [DISCUS] Plan the next Hive release

2024-04-17 Thread Stamatis Zampetakis
Thanks for starting the discussion Ayush.

Having frequent releases is definitely needed so we should keep the
momentum going.

I had the impression from other threads that the next Hive release
would be 4.1.0 and that it would be cut from master. I would like to
understand how 4.0.1 is different and if it is, what is the
contribution pattern that contributors and committers should follow?
If the idea is to maintain and commit in two (or more) branches the
steps should be documented and CI should be running on those branches.

Best,
Stamatis

On Wed, Apr 10, 2024 at 1:18 PM Denys Kuzmenko  wrote:
>
> We might need it sooner as identified some critical issues in the recent code:
> 1. HIVE-28166: Truncate on Iceberg table disregards the branch name and 
> operates on a main;
> 2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread Mergu Ravi
I've observed the hive-exec:3.x version, where in the 3.1.0 version, I
found the core classifier library. When we can expect a similar core
classifier library in the 4.1.0 version.


On Wed, Apr 17, 2024 at 4:14 AM Ayush Saxena  wrote:

> Some can't be relocated, it is pretty challenging to relocate them, one I
> remember is calcite, I tried that here:
> https://issues.apache.org/jira/browse/HIVE-23772 & it didn't work, I am
> not sure if things have changed now.
>
> Relocated dependencies shouldn't be problematic I believe, having jars
> shaded but not relocated is problematic in some cases, you can't get rid of
> them via exclusion and then they tend to create classpath conflicts, we are
> exploring ways to get Spark move from 2.3.9 to 4.0, Our initial hunch is
>  that it would be quite challenging without a hive-exec slim jar which
> doesn't have these dependencies or has minimal shading.
>
> -Ayush
>
> On Tue, 16 Apr 2024 at 21:07, László Bodor 
> wrote:
>
>> isn't this as simple to solve as relocating joda (or what causes problems
>> in general)? I cannot recall when and why we removed the core jar, and I'm
>> not against it, but I feel that relocating something that is already shaded
>> in the uber jar is much easier
>>
>> looks like we shade a lot:
>> https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1032
>> but relocate only a few:
>> https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1110
>>
>> we already have a huge uber jar due to including everything, I feel
>> relocation doesn't make it any worse
>> relocation is only dangerous if the relocated classes are present in
>> hive-exec public method signatures (TODO check joda from this aspect)
>>
>> Mergu Ravi  ezt írta (időpont:
>> 2024. ápr. 16., K, 17:21):
>>
>>> When can we expect the core jar for 4.0.0 version.
>>>
>>> On Tue, Apr 16, 2024 at 4:57 PM Denys Kuzmenko 
>>> wrote:
>>>
 Hi Ravi,

 hive-exec is the uber jar, the same thing is done in Hive-3.x. We are
 considering restoring the hive-core jar that only has classes from ql

 On 2024/04/16 06:24:20 Mergu Ravi wrote:
 > Hi Hive Team,
 >
 > I'm currently using the Hive 4.0.0 libraries and facing an issue with
 the
 > hive-exec:4.0.0 library. It seems that the Joda-Time library is
 bundled
 > within it, preventing me from excluding it and using my existing
 Joda-Time
 > library. Could you please provide insight into why this bundling has
 been
 > implemented? Additionally, is there any plan to unbundle the Joda-Time
 > library in future releases?
 >
 > --
 >
 > Thanks & Regards,
 >
 >
 > 
 > Ravi Mergu
 > SMTS-2
 > o:  +91 40 64535355
 > m: +91 9959618687
 > w: www.gaiansolutions.com
 >
 > 
 > 
 > 
 >
 > *Please consider the environment before printing this email.* This
 message
 > contains confidential information and is intended only for the
 individual
 > named. If you are not the named addressee you should not disseminate,
 > distribute or copy this e-mail
 >

>>>
>>>
>>> --
>>>
>>> Thanks & Regards,
>>>
>>>
>>> 
>>> Ravi Mergu
>>> SMTS-2
>>> o:  +91 40 64535355
>>> m: +91 9959618687
>>> w: www.gaiansolutions.com
>>>
>>> 
>>> 
>>> 
>>>
>>> *Please consider the environment before printing this email.* This
>>> message contains confidential information and is intended only for the
>>> individual named. If you are not the named addressee you should not
>>> disseminate, distribute or copy this e-mail
>>>
>>>

-- 

Thanks & Regards,



Ravi Mergu
SMTS-2
o:  +91 40 64535355
m: +91 9959618687
w: www.gaiansolutions.com





*Please consider the environment before printing this email.* This message
contains confidential information and is intended only for the individual
named. If you are not the named addressee you should not disseminate,
distribute or copy this e-mail


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread Ayush Saxena
Some can't be relocated, it is pretty challenging to relocate them, one I
remember is calcite, I tried that here:
https://issues.apache.org/jira/browse/HIVE-23772 & it didn't work, I am not
sure if things have changed now.

Relocated dependencies shouldn't be problematic I believe, having jars
shaded but not relocated is problematic in some cases, you can't get rid of
them via exclusion and then they tend to create classpath conflicts, we are
exploring ways to get Spark move from 2.3.9 to 4.0, Our initial hunch is
 that it would be quite challenging without a hive-exec slim jar which
doesn't have these dependencies or has minimal shading.

-Ayush

On Tue, 16 Apr 2024 at 21:07, László Bodor 
wrote:

> isn't this as simple to solve as relocating joda (or what causes problems
> in general)? I cannot recall when and why we removed the core jar, and I'm
> not against it, but I feel that relocating something that is already shaded
> in the uber jar is much easier
>
> looks like we shade a lot:
> https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1032
> but relocate only a few:
> https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1110
>
> we already have a huge uber jar due to including everything, I feel
> relocation doesn't make it any worse
> relocation is only dangerous if the relocated classes are present in
> hive-exec public method signatures (TODO check joda from this aspect)
>
> Mergu Ravi  ezt írta (időpont:
> 2024. ápr. 16., K, 17:21):
>
>> When can we expect the core jar for 4.0.0 version.
>>
>> On Tue, Apr 16, 2024 at 4:57 PM Denys Kuzmenko 
>> wrote:
>>
>>> Hi Ravi,
>>>
>>> hive-exec is the uber jar, the same thing is done in Hive-3.x. We are
>>> considering restoring the hive-core jar that only has classes from ql
>>>
>>> On 2024/04/16 06:24:20 Mergu Ravi wrote:
>>> > Hi Hive Team,
>>> >
>>> > I'm currently using the Hive 4.0.0 libraries and facing an issue with
>>> the
>>> > hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled
>>> > within it, preventing me from excluding it and using my existing
>>> Joda-Time
>>> > library. Could you please provide insight into why this bundling has
>>> been
>>> > implemented? Additionally, is there any plan to unbundle the Joda-Time
>>> > library in future releases?
>>> >
>>> > --
>>> >
>>> > Thanks & Regards,
>>> >
>>> >
>>> > 
>>> > Ravi Mergu
>>> > SMTS-2
>>> > o:  +91 40 64535355
>>> > m: +91 9959618687
>>> > w: www.gaiansolutions.com
>>> >
>>> > 
>>> > 
>>> > 
>>> >
>>> > *Please consider the environment before printing this email.* This
>>> message
>>> > contains confidential information and is intended only for the
>>> individual
>>> > named. If you are not the named addressee you should not disseminate,
>>> > distribute or copy this e-mail
>>> >
>>>
>>
>>
>> --
>>
>> Thanks & Regards,
>>
>>
>> 
>> Ravi Mergu
>> SMTS-2
>> o:  +91 40 64535355
>> m: +91 9959618687
>> w: www.gaiansolutions.com
>>
>> 
>> 
>> 
>>
>> *Please consider the environment before printing this email.* This
>> message contains confidential information and is intended only for the
>> individual named. If you are not the named addressee you should not
>> disseminate, distribute or copy this e-mail
>>
>>


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread László Bodor
isn't this as simple to solve as relocating joda (or what causes problems
in general)? I cannot recall when and why we removed the core jar, and I'm
not against it, but I feel that relocating something that is already shaded
in the uber jar is much easier

looks like we shade a lot:
https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1032
but relocate only a few:
https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1110

we already have a huge uber jar due to including everything, I feel
relocation doesn't make it any worse
relocation is only dangerous if the relocated classes are present in
hive-exec public method signatures (TODO check joda from this aspect)

Mergu Ravi  ezt írta (időpont:
2024. ápr. 16., K, 17:21):

> When can we expect the core jar for 4.0.0 version.
>
> On Tue, Apr 16, 2024 at 4:57 PM Denys Kuzmenko 
> wrote:
>
>> Hi Ravi,
>>
>> hive-exec is the uber jar, the same thing is done in Hive-3.x. We are
>> considering restoring the hive-core jar that only has classes from ql
>>
>> On 2024/04/16 06:24:20 Mergu Ravi wrote:
>> > Hi Hive Team,
>> >
>> > I'm currently using the Hive 4.0.0 libraries and facing an issue with
>> the
>> > hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled
>> > within it, preventing me from excluding it and using my existing
>> Joda-Time
>> > library. Could you please provide insight into why this bundling has
>> been
>> > implemented? Additionally, is there any plan to unbundle the Joda-Time
>> > library in future releases?
>> >
>> > --
>> >
>> > Thanks & Regards,
>> >
>> >
>> > 
>> > Ravi Mergu
>> > SMTS-2
>> > o:  +91 40 64535355
>> > m: +91 9959618687
>> > w: www.gaiansolutions.com
>> >
>> > 
>> > 
>> > 
>> >
>> > *Please consider the environment before printing this email.* This
>> message
>> > contains confidential information and is intended only for the
>> individual
>> > named. If you are not the named addressee you should not disseminate,
>> > distribute or copy this e-mail
>> >
>>
>
>
> --
>
> Thanks & Regards,
>
>
> 
> Ravi Mergu
> SMTS-2
> o:  +91 40 64535355
> m: +91 9959618687
> w: www.gaiansolutions.com
>
> 
> 
> 
>
> *Please consider the environment before printing this email.* This
> message contains confidential information and is intended only for the
> individual named. If you are not the named addressee you should not
> disseminate, distribute or copy this e-mail
>
>


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread Mergu Ravi
When can we expect the core jar for 4.0.0 version.

On Tue, Apr 16, 2024 at 4:57 PM Denys Kuzmenko  wrote:

> Hi Ravi,
>
> hive-exec is the uber jar, the same thing is done in Hive-3.x. We are
> considering restoring the hive-core jar that only has classes from ql
>
> On 2024/04/16 06:24:20 Mergu Ravi wrote:
> > Hi Hive Team,
> >
> > I'm currently using the Hive 4.0.0 libraries and facing an issue with the
> > hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled
> > within it, preventing me from excluding it and using my existing
> Joda-Time
> > library. Could you please provide insight into why this bundling has been
> > implemented? Additionally, is there any plan to unbundle the Joda-Time
> > library in future releases?
> >
> > --
> >
> > Thanks & Regards,
> >
> >
> > 
> > Ravi Mergu
> > SMTS-2
> > o:  +91 40 64535355
> > m: +91 9959618687
> > w: www.gaiansolutions.com
> >
> > 
> > 
> > 
> >
> > *Please consider the environment before printing this email.* This
> message
> > contains confidential information and is intended only for the individual
> > named. If you are not the named addressee you should not disseminate,
> > distribute or copy this e-mail
> >
>


-- 

Thanks & Regards,



Ravi Mergu
SMTS-2
o:  +91 40 64535355
m: +91 9959618687
w: www.gaiansolutions.com





*Please consider the environment before printing this email.* This message
contains confidential information and is intended only for the individual
named. If you are not the named addressee you should not disseminate,
distribute or copy this e-mail


Re: Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread Denys Kuzmenko
Hi Ravi,

hive-exec is the uber jar, the same thing is done in Hive-3.x. We are 
considering restoring the hive-core jar that only has classes from ql

On 2024/04/16 06:24:20 Mergu Ravi wrote:
> Hi Hive Team,
> 
> I'm currently using the Hive 4.0.0 libraries and facing an issue with the
> hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled
> within it, preventing me from excluding it and using my existing Joda-Time
> library. Could you please provide insight into why this bundling has been
> implemented? Additionally, is there any plan to unbundle the Joda-Time
> library in future releases?
> 
> -- 
> 
> Thanks & Regards,
> 
> 
> 
> Ravi Mergu
> SMTS-2
> o:  +91 40 64535355
> m: +91 9959618687
> w: www.gaiansolutions.com
> 
> 
> 
> 
> 
> *Please consider the environment before printing this email.* This message
> contains confidential information and is intended only for the individual
> named. If you are not the named addressee you should not disseminate,
> distribute or copy this e-mail
> 


Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread Mergu Ravi
Hi Hive Team,

I'm currently using the Hive 4.0.0 libraries and facing an issue with the
hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled
within it, preventing me from excluding it and using my existing Joda-Time
library. Could you please provide insight into why this bundling has been
implemented? Additionally, is there any plan to unbundle the Joda-Time
library in future releases?

Thank you.

-- 

Thanks & Regards,



Ravi Mergu
SMTS-2
o:  +91 40 64535355
m: +91 9959618687
w: www.gaiansolutions.com





*Please consider the environment before printing this email.* This message
contains confidential information and is intended only for the individual
named. If you are not the named addressee you should not disseminate,
distribute or copy this e-mail


Issue with joda-time library bundled in hive-exec:4.0.0

2024-04-16 Thread Mergu Ravi
Hi Hive Team,

I'm currently using the Hive 4.0.0 libraries and facing an issue with the
hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled
within it, preventing me from excluding it and using my existing Joda-Time
library. Could you please provide insight into why this bundling has been
implemented? Additionally, is there any plan to unbundle the Joda-Time
library in future releases?

-- 

Thanks & Regards,



Ravi Mergu
SMTS-2
o:  +91 40 64535355
m: +91 9959618687
w: www.gaiansolutions.com





*Please consider the environment before printing this email.* This message
contains confidential information and is intended only for the individual
named. If you are not the named addressee you should not disseminate,
distribute or copy this e-mail


[ANNOUNCE] Hive 1.x EOL

2024-04-11 Thread Ayush Saxena
Hi All,
The Apache Hive Community has voted to declare the 1.x release line as End of 
Life (EOL). This means no further updates or releases will be made for this 
series.

We urge all Hive 1.x users to upgrade to the latest versions promptly to 
benefit from new features and ongoing support.

-Ayush Saxena
(On Behalf of Apache Hive PMC)

Re: [DISCUS] Plan the next Hive release

2024-04-10 Thread Denys Kuzmenko
We might need it sooner as identified some critical issues in the recent code:
1. HIVE-28166: Truncate on Iceberg table disregards the branch name and 
operates on a main;
2. HIVE-28190: Materialized view rebuild lock heart-beating is broken;


Re: [DISCUS] Plan the next Hive release

2024-04-09 Thread Zhihua Deng


+1. Thank you Ayush, for pushing things forward!
I would like to volunteer for the 4.0.1 release.

Thanks,
Zhihua

On 2024/04/09 22:30:55 Ayush Saxena wrote:
> Hi All,
> As we all know Hive-4.0 is released. I think we should try to maintain a
> regular cadence for the 4.x release line.
> So, I propose having a 4.0.1 release in the next 3 months or so, with some
> critical bug fixes and improvements on top of our last 4.0.0 release.
> 
> We would need someone to volunteer as the Release Manager as well, if folks
> agree.
> 
> Thoughts?
> 
> -Ayush
> 


[DISCUS] Plan the next Hive release

2024-04-09 Thread Ayush Saxena
Hi All,
As we all know Hive-4.0 is released. I think we should try to maintain a
regular cadence for the 4.x release line.
So, I propose having a 4.0.1 release in the next 3 months or so, with some
critical bug fixes and improvements on top of our last 4.0.0 release.

We would need someone to volunteer as the Release Manager as well, if folks
agree.

Thoughts?

-Ayush


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-08 Thread Ayush Saxena
A reminder, I have addressed comments from everyone so far. I plan to send
this tomorrow. Do give a check guys. If anyone wants me to hold or see I
missed any of their comments, just let me know, it might have got skipped
unintentionally.

-Ayush

On Fri, 5 Apr 2024 at 22:08, Simhadri G  wrote:

> Looks great,  thanks Ayush! :)
>
> On Fri, Apr 5, 2024, 8:54 PM Butao Zhang  wrote:
>
>> Good job Ayush!
>> Hope this can make more people know that Apache Hive 4.0 is really ready
>> to be used!
>>
>>
>> Thanks,
>> Butao Zhang
>>  Replied Message 
>> From Ayush Saxena 
>> Date 4/5/2024 19:55
>> To dev 
>> Subject [Blog] Apache Hive 4.0 Release blog for ASF M & P
>> Hi All,
>>
>> Have been talking to the ASF M & P team and they recongonise the 4.0
>> release is a big milestone for our project.
>>
>> They are happy to have an entry for us in the their news column, ex:
>>
>> https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10
>>
>> So, I along with Denys, Simhadri & tons of help from ChatGpt have
>> prepared a draft to share with them.
>> The draft is here:
>>
>>
>> https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit
>>
>> If you have some feedback or concerns, please share with us.
>>
>> If you want some improvements or removals, let us know here & we will do
>> that, or if you need write access to this page, just let me know.
>>
>> If nobody objects, I plan to send this to the team by next week Tuesday
>>
>>
>> -Ayush
>>
>


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-05 Thread Simhadri G
Looks great,  thanks Ayush! :)

On Fri, Apr 5, 2024, 8:54 PM Butao Zhang  wrote:

> Good job Ayush!
> Hope this can make more people know that Apache Hive 4.0 is really ready
> to be used!
>
>
> Thanks,
> Butao Zhang
>  Replied Message 
> From Ayush Saxena 
> Date 4/5/2024 19:55
> To dev 
> Subject [Blog] Apache Hive 4.0 Release blog for ASF M & P
> Hi All,
>
> Have been talking to the ASF M & P team and they recongonise the 4.0
> release is a big milestone for our project.
>
> They are happy to have an entry for us in the their news column, ex:
>
> https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10
>
> So, I along with Denys, Simhadri & tons of help from ChatGpt have prepared
> a draft to share with them.
> The draft is here:
>
>
> https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit
>
> If you have some feedback or concerns, please share with us.
>
> If you want some improvements or removals, let us know here & we will do
> that, or if you need write access to this page, just let me know.
>
> If nobody objects, I plan to send this to the team by next week Tuesday
>
>
> -Ayush
>


Re: Next Jira Fix Version after 4.0.0

2024-04-05 Thread Ayush Saxena
Hi Laszlo,
The next version is 4.1.0 only. AFAIK the target fix version is by practice
the one defined in the pom.xml file.

https://github.com/apache/hive/blob/master/pom.xml#L24

-Ayush

On Fri, 5 Apr 2024 at 20:36, László Bodor  wrote:

> Now, as Apache Hive 4.0.0 has been released, it's time to find a new Fix
> Version to make devs able to pick a valid one when resolving new tickets.
> I'm proposing *4.1.0*, which can be bulk-changed later if we decide
> otherwise. Any opinions about this?
>
> Thanks,
> Laszlo Bodor
>
>


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-05 Thread Butao Zhang
Good job Ayush! 

Hope this can make more people know that Apache Hive 4.0 is really ready to be 
used!




Thanks,
Butao Zhang
 Replied Message 
| From | Ayush Saxena |
| Date | 4/5/2024 19:55 |
| To | dev |
| Subject | [Blog] Apache Hive 4.0 Release blog for ASF M & P |
Hi All,



Have been talking to the ASF M & P team and they recongonise the 4.0 release is 
a big milestone for our project.


They are happy to have an entry for us in the their news column, ex:
https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10



So, I along with Denys, Simhadri & tons of help from ChatGpt have prepared a 
draft to share with them.
The draft is here:


https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit



If you have some feedback or concerns, please share with us.


If you want some improvements or removals, let us know here & we will do that, 
or if you need write access to this page, just let me know.


If nobody objects, I plan to send this to the team by next week Tuesday




-Ayush

Next Jira Fix Version after 4.0.0

2024-04-05 Thread László Bodor
Now, as Apache Hive 4.0.0 has been released, it's time to find a new Fix
Version to make devs able to pick a valid one when resolving new tickets.
I'm proposing *4.1.0*, which can be bulk-changed later if we decide
otherwise. Any opinions about this?

Thanks,
Laszlo Bodor


Running multiple Qtest with Postgre/MSSQL/MYSQL

2024-04-05 Thread Zoltán Rátkai
Hi Everyone,

since this ticket is merged, it is possible to run not just one qtest with
a specified DB instead of Derby (default), but multiple one:
https://issues.apache.org/jira/browse/HIVE-28037

I would like to update this page:
https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-HowdoIruntheclientpositive/clientnegativeunittests
?

"To run test test with a specified DB it is possible by adding
"-Dtest.metastore.db" parameter like in the following commands:

mvn test -Pitests -pl itests/qtest -Dtest=TestCliDriver
-Dqfile=partition_params_postgres.q -Dtest.metastore.db=postgres
mvn test -Pitests -pl itests/qtest -Dtest=TestCliDriver
-Dqfile=partition_params_postgres.q -Dtest.metastore.db=mssql
mvn test -Pitests -pl itests/qtest -Dtest=TestCliDriver
-Dqfile=partition_params_postgres.q -Dtest.metastore.db=mysql
mvn test -Pitests -pl itests/qtest -Dtest=TestCliDriver
-Dqfile=partition_params_postgres.q -Dtest.metastore.db=oracle
-Ditest.jdbc.jars=/path/to/your/god/damn/oracle/jdbc/driver/ojdbc6.jar
"

I do not have permission to modify the page.

Could you please help, so I can add this?

Regards,

Zoltan Ratkai


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-05 Thread Denys Kuzmenko
Looks great, thanks Ayush!


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-05 Thread Ayush Saxena
Hi Stamatis,
I have changed the permissions to allow everyone with the link to have
comment access. I have additionally given you edit access as well.

Let me know if things don't work

-Ayush

On Fri, 5 Apr 2024 at 17:34, Stamatis Zampetakis  wrote:

> Great initiative and nice content. Overall, it looks great!
>
> I have some minor comments. Is it possible to change permissions allow
> comments from anyone or it has to be done on a per user basis?
>
> Best,
> Stamatis
>
> On Fri, Apr 5, 2024 at 1:54 PM Ayush Saxena  wrote:
> >
> > Hi All,
> >
> > Have been talking to the ASF M & P team and they recongonise the 4.0
> release is a big milestone for our project.
> >
> > They are happy to have an entry for us in the their news column, ex:
> >
> https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10
> >
> > So, I along with Denys, Simhadri & tons of help from ChatGpt have
> prepared a draft to share with them.
> > The draft is here:
> >
> >
> https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit
> >
> > If you have some feedback or concerns, please share with us.
> >
> > If you want some improvements or removals, let us know here & we will do
> that, or if you need write access to this page, just let me know.
> >
> > If nobody objects, I plan to send this to the team by next week Tuesday
> >
> >
> > -Ayush
>


Re: [Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-05 Thread Stamatis Zampetakis
Great initiative and nice content. Overall, it looks great!

I have some minor comments. Is it possible to change permissions allow
comments from anyone or it has to be done on a per user basis?

Best,
Stamatis

On Fri, Apr 5, 2024 at 1:54 PM Ayush Saxena  wrote:
>
> Hi All,
>
> Have been talking to the ASF M & P team and they recongonise the 4.0 release 
> is a big milestone for our project.
>
> They are happy to have an entry for us in the their news column, ex:
> https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10
>
> So, I along with Denys, Simhadri & tons of help from ChatGpt have prepared a 
> draft to share with them.
> The draft is here:
>
> https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit
>
> If you have some feedback or concerns, please share with us.
>
> If you want some improvements or removals, let us know here & we will do 
> that, or if you need write access to this page, just let me know.
>
> If nobody objects, I plan to send this to the team by next week Tuesday
>
>
> -Ayush


[Blog] Apache Hive 4.0 Release blog for ASF M & P

2024-04-05 Thread Ayush Saxena
Hi All,

Have been talking to the ASF M & P team and they recongonise the 4.0
release is a big milestone for our project.

They are happy to have an entry for us in the their news column, ex:
https://news.apache.org/foundation/entry/apache-software-foundation-announces-apache-wicket-v10

So, I along with Denys, Simhadri & tons of help from ChatGpt have prepared
a draft to share with them.
The draft is here:

https://docs.google.com/document/d/10Zu8pHvWNDRTqn7yvYqvU4-kw3Q1TXo7mGo5m5fUP2Y/edit

If you have some feedback or concerns, please share with us.

If you want some improvements or removals, let us know here & we will do
that, or if you need write access to this page, just let me know.

If nobody objects, I plan to send this to the team by next week Tuesday


-Ayush


Re: HIVE-28059: Iceberg REST Catalog

2024-04-05 Thread Denys Kuzmenko
Hi Henri,

The idea to provide a simple, open standard interface to enable integration of 
3rd party compute engines and tools is great, however, there are concerns about 
the suggested design.

-1 on the current implementation (+1 more Jetty server on HMS instance)

org.apache.iceberg.rest.HMSCatalogServer
Server httpServer = new Server(port)

* Iceberg provides a pluggable catalog interface on the client side to manage 
table metadata for creating, altering, and dropping tables, allowing seamless 
integration with existing data systems. 

* We should not embed or tight RestCatalog to the HMS. It should be an 
independent component with a pluggable design (work with different data 
catalogs, such as Hive, Snowflake, Glue, etc.)

* Breaking down complex systems into independently deployable services improves 
scalability, flexibility, and maintenance simplicity.

Regards,
Denys






Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-04 Thread Sungwoo Park
Congratulations and huge thanks to Apache Hive team and contributors for
releasing Hive 4. We have been watching the development of Hive 4 since the
release of Hive 3.1, and it's truly satisfying to witness the resolution of
all the critical issues at last after 5 years. Hive 4 comes with a lot of
new great features, and our initial performance benchmarking indicates that
it comes with a significant improvement over Hive 3 in terms of speed.

--- Sungwoo

On Wed, Apr 3, 2024 at 10:30 PM Okumin  wrote:

> I'm really excited to see the news! I can easily imagine the
> difficulty of testing and shipping Hive 4.0.0 with more than 5k
> commits. I'm proud to have witnessed this moment here.
>
> Thank you!
>
> On Wed, Apr 3, 2024 at 3:07 AM Naveen Gangam  wrote:
> >
> > Thank you for the tremendous amount of work put in by many many folks to
> make this release happen, including projects hive is dependent upon like
> tez.
> >
> > Thank you to all the PMC members, committers and contributors for all
> the work over the past 5+ years in shaping this release.
> >
> > THANK YOU!!!
> >
> > On Sun, Mar 31, 2024 at 8:54 AM Battula, Brahma Reddy 
> wrote:
> >>
> >> Thank you for your hard work and dedication in releasing Apache Hive
> version 4.0.0.
> >>
> >>
> >>
> >> Congratulations to the entire team on this achievement. Keep up the
> great work!
> >>
> >>
> >>
> >> Does this consider as GA.?
> >>
> >>
> >>
> >> And Looks we need to update in the following location also.?
> >>
> >> https://hive.apache.org/general/downloads/
> >>
> >>
> >>
> >>
> >>
> >> From: Denys Kuzmenko 
> >> Date: Saturday, March 30, 2024 at 00:07
> >> To: u...@hive.apache.org , dev@hive.apache.org <
> dev@hive.apache.org>
> >> Subject: [ANNOUNCE] Apache Hive 4.0.0 Released
> >>
> >> The Apache Hive team is proud to announce the release of Apache Hive
> >>
> >> version 4.0.0.
> >>
> >>
> >>
> >> The Apache Hive (TM) data warehouse software facilitates querying and
> >>
> >> managing large datasets residing in distributed storage. Built on top
> >>
> >> of Apache Hadoop (TM), it provides, among others:
> >>
> >>
> >>
> >> * Tools to enable easy data extract/transform/load (ETL)
> >>
> >>
> >>
> >> * A mechanism to impose structure on a variety of data formats
> >>
> >>
> >>
> >> * Access to files stored either directly in Apache HDFS (TM) or in other
> >>
> >>   data storage systems such as Apache HBase (TM)
> >>
> >>
> >>
> >> * Query execution via Apache Hadoop MapReduce, Apache Tez and Apache
> Spark frameworks. (MapReduce is deprecated, and Spark has been removed so
> the text needs to be modified depending on the release version)
> >>
> >>
> >>
> >> For Hive release details and downloads, please visit:
> >>
> >> https://hive.apache.org/downloads.html
> >>
> >>
> >>
> >> Hive 4.0.0 Release Notes are available here:
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843
> >>
> >>
> >>
> >> We would like to thank the many contributors who made this release
> >>
> >> possible.
> >>
> >>
> >>
> >> Regards,
> >>
> >>
> >>
> >> The Apache Hive Team
>


Community over Code EU 2024: Start planning your trip!

2024-04-03 Thread Ryan Skraba
[Note: You're receiving this email because you are subscribed to one
or more project dev@ mailing lists at the Apache Software Foundation.]

Dear community,

We hope you are doing great, are you ready for Community Over Code EU?
Check out the featured sessions, get your tickets with special
discounts and start planning your trip.

Save your spot! Take a look at our lineup of sessions, panelists and
featured speakers and make your final choice:

* EU policies and regulations affecting open source specialists working in OSPOs

The panel will discuss how EU legislation affects the daily work of
open source operations. Panelists will cover some recent policy
updates, the challenges of staying compliant when managing open source
contribution and usage within organizations, and their personal
experiences in adapting to the changing European regulatory
environment.

* Doing for sustainability, what open source did for software

In this keynote Asim Hussain will explain the history of Impact
Framework, a coalition of hundreds of software practitioners with
tangible solutions that directly foster meaningful change by measuring
the environmental impacts of a piece of software.

Don’t forget that we have special discounts for groups, students and
Apache committers. Visit the website to discover more about these
rates.[1]

It's time for you to start planning your trip. Remember that we have
prepared a “How to get there” guide that will be helpful to find out
the best transportation, either train, bus, flight or boat to
Bratislava from wherever you are coming from. Take a look at the
different options and please reach out to us if you have any
questions.

We have available rooms -with a special rate- at the Radisson Blu
Carlton Hotel, where the event will take place and at the Park Inn
Hotel which is only 5 minutes walking from the venue. [2] However, you
are free to choose any other accommodation options around the city.

See you in Bratislava,
Community Over Code EU Team

[1]: https://eu.communityovercode.org/tickets/ "Register"
[2]: https://eu.communityovercode.org/venue/ "Where to stay"


Participate in the ASF 25th Anniversary Campaign

2024-04-03 Thread Brian Proffitt
Hi everyone,

As part of The ASF’s 25th anniversary campaign[1], we will be celebrating
projects and communities in multiple ways.

We invite all projects and contributors to participate in the following
ways:

* Individuals - submit your first contribution:
https://news.apache.org/foundation/entry/the-asf-launches-firstasfcontribution-campaign
* Projects - share your public good story:
https://docs.google.com/forms/d/1vuN-tUnBwpTgOE5xj3Z5AG1hsOoDNLBmGIqQHwQT6k8/viewform?edit_requested=true
* Projects - submit a project spotlight for the blog:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=278466116
* Projects - contact the Voice of Apache podcast (formerly Feathercast) to
be featured: https://feathercast.apache.org/help/
*  Projects - use the 25th anniversary template and the #ASF25Years hashtag
on social media:
https://docs.google.com/presentation/d/1oDbMol3F_XQuCmttPYxBIOIjRuRBksUjDApjd8Ve3L8/edit#slide=id.g26b0919956e_0_13

If you have questions, email the Marketing & Publicity team at
mark...@apache.org.

Peace,
BKP

[1] https://apache.org/asf25years/

[NOTE: You are receiving this message because you are a contributor to an
Apache Software Foundation project. The ASF will very occasionally send out
messages relating to the Foundation to contributors and members, such as
this one.]

Brian Proffitt
VP, Marketing & Publicity
VP, Conferences


Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-03 Thread Okumin
I'm really excited to see the news! I can easily imagine the
difficulty of testing and shipping Hive 4.0.0 with more than 5k
commits. I'm proud to have witnessed this moment here.

Thank you!

On Wed, Apr 3, 2024 at 3:07 AM Naveen Gangam  wrote:
>
> Thank you for the tremendous amount of work put in by many many folks to make 
> this release happen, including projects hive is dependent upon like tez.
>
> Thank you to all the PMC members, committers and contributors for all the 
> work over the past 5+ years in shaping this release.
>
> THANK YOU!!!
>
> On Sun, Mar 31, 2024 at 8:54 AM Battula, Brahma Reddy  
> wrote:
>>
>> Thank you for your hard work and dedication in releasing Apache Hive version 
>> 4.0.0.
>>
>>
>>
>> Congratulations to the entire team on this achievement. Keep up the great 
>> work!
>>
>>
>>
>> Does this consider as GA.?
>>
>>
>>
>> And Looks we need to update in the following location also.?
>>
>> https://hive.apache.org/general/downloads/
>>
>>
>>
>>
>>
>> From: Denys Kuzmenko 
>> Date: Saturday, March 30, 2024 at 00:07
>> To: u...@hive.apache.org , dev@hive.apache.org 
>> 
>> Subject: [ANNOUNCE] Apache Hive 4.0.0 Released
>>
>> The Apache Hive team is proud to announce the release of Apache Hive
>>
>> version 4.0.0.
>>
>>
>>
>> The Apache Hive (TM) data warehouse software facilitates querying and
>>
>> managing large datasets residing in distributed storage. Built on top
>>
>> of Apache Hadoop (TM), it provides, among others:
>>
>>
>>
>> * Tools to enable easy data extract/transform/load (ETL)
>>
>>
>>
>> * A mechanism to impose structure on a variety of data formats
>>
>>
>>
>> * Access to files stored either directly in Apache HDFS (TM) or in other
>>
>>   data storage systems such as Apache HBase (TM)
>>
>>
>>
>> * Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark 
>> frameworks. (MapReduce is deprecated, and Spark has been removed so the text 
>> needs to be modified depending on the release version)
>>
>>
>>
>> For Hive release details and downloads, please visit:
>>
>> https://hive.apache.org/downloads.html
>>
>>
>>
>> Hive 4.0.0 Release Notes are available here:
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843
>>
>>
>>
>> We would like to thank the many contributors who made this release
>>
>> possible.
>>
>>
>>
>> Regards,
>>
>>
>>
>> The Apache Hive Team


Re: Hive jdbc connector

2024-04-02 Thread Naveen Gangam
Not sure if you got a response. But should be safe to run with JRE8.

On Thu, Feb 1, 2024 at 2:45 AM stephen vijay  wrote:

> Hi sir,
>
> Which Java version does hive jdbc connector supports?
>
> Thanks,
> Vijay S.
>


Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Naveen Gangam
Thank you for the tremendous amount of work put in by many many folks to
make this release happen, including projects hive is dependent upon like
tez.

Thank you to all the PMC members, committers and contributors for all the
work over the past 5+ years in shaping this release.

THANK YOU!!!

On Sun, Mar 31, 2024 at 8:54 AM Battula, Brahma Reddy 
wrote:

> Thank you for your hard work and dedication in releasing Apache Hive
> version 4.0.0.
>
>
>
> Congratulations to the entire team on this achievement. Keep up the great
> work!
>
>
>
> Does this consider as GA.?
>
>
>
> And Looks we need to update in the following location also.?
>
> https://hive.apache.org/general/downloads/
>
>
>
>
>
> *From: *Denys Kuzmenko 
> *Date: *Saturday, March 30, 2024 at 00:07
> *To: *u...@hive.apache.org , dev@hive.apache.org <
> dev@hive.apache.org>
> *Subject: *[ANNOUNCE] Apache Hive 4.0.0 Released
>
> The Apache Hive team is proud to announce the release of Apache Hive
>
> version 4.0.0.
>
>
>
> The Apache Hive (TM) data warehouse software facilitates querying and
>
> managing large datasets residing in distributed storage. Built on top
>
> of Apache Hadoop (TM), it provides, among others:
>
>
>
> * Tools to enable easy data extract/transform/load (ETL)
>
>
>
> * A mechanism to impose structure on a variety of data formats
>
>
>
> * Access to files stored either directly in Apache HDFS (TM) or in other
>
>   data storage systems such as Apache HBase (TM)
>
>
>
> * Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark 
> frameworks. (MapReduce is deprecated, and Spark has been removed so the text 
> needs to be modified depending on the release version)
>
>
>
> For Hive release details and downloads, please visit:
>
> https://hive.apache.org/downloads.html
>
>
>
> Hive 4.0.0 Release Notes are available here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843
>
>
>
> We would like to thank the many contributors who made this release
>
> possible.
>
>
>
> Regards,
>
>
>
> The Apache Hive Team
>
>


Re: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Pravin sinha
Thanks for the update and the hard work to get it released, Denys.
Amazing to see Apache 4.0.0 released version out. Kudos to all the Hive
community members who contributed directly/indirectly to make this happen.

Best regards,
Pravin

On Tue, Apr 2, 2024, 6:15 PM Sankar Hariappan
 wrote:

> Absolutely exciting news! Congrats to the entire Hive community for making
> this release happen!
>
> -Sankar
>
> From: Pau Tallada 
> Sent: Tuesday, April 2, 2024 2:31 PM
> To: u...@hive.apache.org
> Cc: dev@hive.apache.org
> Subject: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released
>
> You don't often get email from tall...@pic.es.
> Learn why this is important
> Congrats to all for the hard work
>
> Missatge de Butao Zhang mailto:butaozha...@163.com>>
> del dia dt., 2 d’abr. 2024 a les 10:58:
> I'm thrilled to see the official release of Apache Hive 4.0.0, marking
> another milestone in the development of the Hive community. I want to
> extend my gratitude to all the partners in the community for their hard
> work.
> Also special thanks to Denys for your diligent code reviews and efforts in
> completing the version release process, which I deeply admire.
>
> Wishing the Apache Hive community continued growth and success. Keep up
> the great work!
>
>
> Thanks,
> Butao Zhang
>
>
>  Replied Message 
> From
> Stamatis Zampetakis
> Date
> 4/2/2024 16:39
> To
> 
> Cc
> u...@hive.apache.org
> Subject
> Re: [ANNOUNCE] Apache Hive 4.0.0 Released
> The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
> Apache Hive 3.1.3) and it's probably the biggest release so far in the
> history of the project. The numbers clearly show that this is a
> collective effort that wouldn't be possible without a strong community
> and many volunteers along the years. Many thanks to everyone involved!
>
> A special mention to Denys who went above and beyond his role of
> release manager triaging release blockers, reviewing and fixing many
> of those tickets that were blocking us for the past few months.
>
> Best,
> Stamatis
>
> On Sun, Mar 31, 2024 at 2:54 PM Battula, Brahma Reddy
> mailto:bbatt...@visa.com.invalid>> wrote:
>
> Thank you for your hard work and dedication in releasing Apache Hive
> version 4.0.0.
>
> Congratulations to the entire team on this achievement. Keep up the great
> work!
>
> Does this consider as GA.?
>
> And Looks we need to update in the following location also.?
> https://hive.apache.org/general/downloads/
>
>
> From: Denys Kuzmenko mailto:dkuzme...@apache.org>>
> Date: Saturday, March 30, 2024 at 00:07
> To: u...@hive.apache.org <
> u...@hive.apache.org>, dev@hive.apache.org
>   dev@hive.apache.org>>
> Subject: [ANNOUNCE] Apache Hive 4.0.0 Released
>
> The Apache Hive team is proud to announce the release of Apache Hive
>
> version 4.0.0.
>
>
>
> The Apache Hive (TM) data warehouse software facilitates querying and
>
> managing large datasets residing in distributed storage. Built on top
>
> of Apache Hadoop (TM), it provides, among others:
>
>
>
> * Tools to enable easy data extract/transform/load (ETL)
>
>
>
> * A mechanism to impose structure on a variety of data formats
>
>
>
> * Access to files stored either directly in Apache HDFS (TM) or in other
>
> data storage systems such as Apache HBase (TM)
>
>
>
> * Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark
> frameworks. (MapReduce is deprecated, and Spark has been removed so the
> text needs to be modified depending on the release version)
>
>
>
> For Hive release details and downloads, please visit:
>
> https://hive.apache.org/downloads.html
>
>
>
> Hive 4.0.0 Release Notes are available here:
>
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843
>
>
>
> We would like to thank the many contributors who made this release
>
> possible.
>
>
>
> Regards,
>
>
>
> The Apache Hive Team
>
>
> --
> --
> Pau Tallada Crespí
> Departament de Serveis
> Port d'Informació Científica (PIC)
> Tel: +34 93 170 2729
> --
>
>


RE: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Sankar Hariappan
Absolutely exciting news! Congrats to the entire Hive community for making this 
release happen!

-Sankar

From: Pau Tallada 
Sent: Tuesday, April 2, 2024 2:31 PM
To: u...@hive.apache.org
Cc: dev@hive.apache.org
Subject: [EXTERNAL] Re: [ANNOUNCE] Apache Hive 4.0.0 Released

You don't often get email from tall...@pic.es. Learn why 
this is important
Congrats to all for the hard work

Missatge de Butao Zhang mailto:butaozha...@163.com>> del 
dia dt., 2 d’abr. 2024 a les 10:58:
I'm thrilled to see the official release of Apache Hive 4.0.0, marking another 
milestone in the development of the Hive community. I want to extend my 
gratitude to all the partners in the community for their hard work.
Also special thanks to Denys for your diligent code reviews and efforts in 
completing the version release process, which I deeply admire.

Wishing the Apache Hive community continued growth and success. Keep up the 
great work!


Thanks,
Butao Zhang


 Replied Message 
From
Stamatis Zampetakis
Date
4/2/2024 16:39
To

Cc
u...@hive.apache.org
Subject
Re: [ANNOUNCE] Apache Hive 4.0.0 Released
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort that wouldn't be possible without a strong community
and many volunteers along the years. Many thanks to everyone involved!

A special mention to Denys who went above and beyond his role of
release manager triaging release blockers, reviewing and fixing many
of those tickets that were blocking us for the past few months.

Best,
Stamatis

On Sun, Mar 31, 2024 at 2:54 PM Battula, Brahma Reddy
mailto:bbatt...@visa.com.invalid>> wrote:

Thank you for your hard work and dedication in releasing Apache Hive version 
4.0.0.

Congratulations to the entire team on this achievement. Keep up the great work!

Does this consider as GA.?

And Looks we need to update in the following location also.?
https://hive.apache.org/general/downloads/


From: Denys Kuzmenko mailto:dkuzme...@apache.org>>
Date: Saturday, March 30, 2024 at 00:07
To: u...@hive.apache.org 
mailto:u...@hive.apache.org>>, 
dev@hive.apache.org 
mailto:dev@hive.apache.org>>
Subject: [ANNOUNCE] Apache Hive 4.0.0 Released

The Apache Hive team is proud to announce the release of Apache Hive

version 4.0.0.



The Apache Hive (TM) data warehouse software facilitates querying and

managing large datasets residing in distributed storage. Built on top

of Apache Hadoop (TM), it provides, among others:



* Tools to enable easy data extract/transform/load (ETL)



* A mechanism to impose structure on a variety of data formats



* Access to files stored either directly in Apache HDFS (TM) or in other

data storage systems such as Apache HBase (TM)



* Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark 
frameworks. (MapReduce is deprecated, and Spark has been removed so the text 
needs to be modified depending on the release version)



For Hive release details and downloads, please visit:

https://hive.apache.org/downloads.html



Hive 4.0.0 Release Notes are available here:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843



We would like to thank the many contributors who made this release

possible.



Regards,



The Apache Hive Team


--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--



Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Pau Tallada
Congrats to all for the hard work

Missatge de Butao Zhang  del dia dt., 2 d’abr. 2024 a
les 10:58:

> I'm thrilled to see the official release of Apache Hive 4.0.0, marking
> another milestone in the development of the Hive community. I want to
> extend my gratitude to all the partners in the community for their hard
> work.
> Also special thanks to Denys for your diligent code reviews and efforts in
> completing the version release process, which I deeply admire.
>
> Wishing the Apache Hive community continued growth and success. Keep up
> the great work!
>
>
> Thanks,
> Butao Zhang
>
>
>  Replied Message 
> From Stamatis Zampetakis 
> Date 4/2/2024 16:39
> To  
> Cc u...@hive.apache.org 
> Subject Re: [ANNOUNCE] Apache Hive 4.0.0 Released
> The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
> Apache Hive 3.1.3) and it's probably the biggest release so far in the
> history of the project. The numbers clearly show that this is a
> collective effort that wouldn't be possible without a strong community
> and many volunteers along the years. Many thanks to everyone involved!
>
> A special mention to Denys who went above and beyond his role of
> release manager triaging release blockers, reviewing and fixing many
> of those tickets that were blocking us for the past few months.
>
> Best,
> Stamatis
>
> On Sun, Mar 31, 2024 at 2:54 PM Battula, Brahma Reddy
>  wrote:
>
>
> Thank you for your hard work and dedication in releasing Apache Hive
> version 4.0.0.
>
> Congratulations to the entire team on this achievement. Keep up the great
> work!
>
> Does this consider as GA.?
>
> And Looks we need to update in the following location also.?
> https://hive.apache.org/general/downloads/
>
>
> From: Denys Kuzmenko 
> Date: Saturday, March 30, 2024 at 00:07
> To: u...@hive.apache.org , dev@hive.apache.org <
> dev@hive.apache.org>
> Subject: [ANNOUNCE] Apache Hive 4.0.0 Released
>
> The Apache Hive team is proud to announce the release of Apache Hive
>
> version 4.0.0.
>
>
>
> The Apache Hive (TM) data warehouse software facilitates querying and
>
> managing large datasets residing in distributed storage. Built on top
>
> of Apache Hadoop (TM), it provides, among others:
>
>
>
> * Tools to enable easy data extract/transform/load (ETL)
>
>
>
> * A mechanism to impose structure on a variety of data formats
>
>
>
> * Access to files stored either directly in Apache HDFS (TM) or in other
>
> data storage systems such as Apache HBase (TM)
>
>
>
> * Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark
> frameworks. (MapReduce is deprecated, and Spark has been removed so the
> text needs to be modified depending on the release version)
>
>
>
> For Hive release details and downloads, please visit:
>
> https://hive.apache.org/downloads.html
>
>
>
> Hive 4.0.0 Release Notes are available here:
>
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843
>
>
>
> We would like to thank the many contributors who made this release
>
> possible.
>
>
>
> Regards,
>
>
>
> The Apache Hive Team
>
>

-- 
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--


Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Butao Zhang
I'm thrilled to see the official release of Apache Hive 4.0.0, marking another 
milestone in the development of the Hive community. I want to extend my 
gratitude to all the partners in the community for their hard work. 

Also special thanks to Denys for your diligent code reviews and efforts in 
completing the version release process, which I deeply admire.


Wishing the Apache Hive community continued growth and success. Keep up the 
great work!




Thanks,
Butao Zhang




 Replied Message 
| From | Stamatis Zampetakis |
| Date | 4/2/2024 16:39 |
| To |  |
| Cc | u...@hive.apache.org |
| Subject | Re: [ANNOUNCE] Apache Hive 4.0.0 Released |
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort that wouldn't be possible without a strong community
and many volunteers along the years. Many thanks to everyone involved!

A special mention to Denys who went above and beyond his role of
release manager triaging release blockers, reviewing and fixing many
of those tickets that were blocking us for the past few months.

Best,
Stamatis

On Sun, Mar 31, 2024 at 2:54 PM Battula, Brahma Reddy
 wrote:

Thank you for your hard work and dedication in releasing Apache Hive version 
4.0.0.

Congratulations to the entire team on this achievement. Keep up the great work!

Does this consider as GA.?

And Looks we need to update in the following location also.?
https://hive.apache.org/general/downloads/


From: Denys Kuzmenko 
Date: Saturday, March 30, 2024 at 00:07
To: u...@hive.apache.org , dev@hive.apache.org 

Subject: [ANNOUNCE] Apache Hive 4.0.0 Released

The Apache Hive team is proud to announce the release of Apache Hive

version 4.0.0.



The Apache Hive (TM) data warehouse software facilitates querying and

managing large datasets residing in distributed storage. Built on top

of Apache Hadoop (TM), it provides, among others:



* Tools to enable easy data extract/transform/load (ETL)



* A mechanism to impose structure on a variety of data formats



* Access to files stored either directly in Apache HDFS (TM) or in other

data storage systems such as Apache HBase (TM)



* Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark 
frameworks. (MapReduce is deprecated, and Spark has been removed so the text 
needs to be modified depending on the release version)



For Hive release details and downloads, please visit:

https://hive.apache.org/downloads.html



Hive 4.0.0 Release Notes are available here:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843



We would like to thank the many contributors who made this release

possible.



Regards,



The Apache Hive Team


Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-04-02 Thread Stamatis Zampetakis
The new Apache Hive 4.0.0 release brings roughly 5K new commits (since
Apache Hive 3.1.3) and it's probably the biggest release so far in the
history of the project. The numbers clearly show that this is a
collective effort that wouldn't be possible without a strong community
and many volunteers along the years. Many thanks to everyone involved!

A special mention to Denys who went above and beyond his role of
release manager triaging release blockers, reviewing and fixing many
of those tickets that were blocking us for the past few months.

Best,
Stamatis

On Sun, Mar 31, 2024 at 2:54 PM Battula, Brahma Reddy
 wrote:
>
> Thank you for your hard work and dedication in releasing Apache Hive version 
> 4.0.0.
>
> Congratulations to the entire team on this achievement. Keep up the great 
> work!
>
> Does this consider as GA.?
>
> And Looks we need to update in the following location also.?
> https://hive.apache.org/general/downloads/
>
>
> From: Denys Kuzmenko 
> Date: Saturday, March 30, 2024 at 00:07
> To: u...@hive.apache.org , dev@hive.apache.org 
> 
> Subject: [ANNOUNCE] Apache Hive 4.0.0 Released
>
> The Apache Hive team is proud to announce the release of Apache Hive
>
> version 4.0.0.
>
>
>
> The Apache Hive (TM) data warehouse software facilitates querying and
>
> managing large datasets residing in distributed storage. Built on top
>
> of Apache Hadoop (TM), it provides, among others:
>
>
>
> * Tools to enable easy data extract/transform/load (ETL)
>
>
>
> * A mechanism to impose structure on a variety of data formats
>
>
>
> * Access to files stored either directly in Apache HDFS (TM) or in other
>
>   data storage systems such as Apache HBase (TM)
>
>
>
> * Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark 
> frameworks. (MapReduce is deprecated, and Spark has been removed so the text 
> needs to be modified depending on the release version)
>
>
>
> For Hive release details and downloads, please visit:
>
> https://hive.apache.org/downloads.html
>
>
>
> Hive 4.0.0 Release Notes are available here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843
>
>
>
> We would like to thank the many contributors who made this release
>
> possible.
>
>
>
> Regards,
>
>
>
> The Apache Hive Team


Re: [ANNOUNCE] Apache Hive 4.0.0 Released

2024-03-31 Thread Battula, Brahma Reddy
Thank you for your hard work and dedication in releasing Apache Hive version 
4.0.0.

Congratulations to the entire team on this achievement. Keep up the great work!

Does this consider as GA.?

And Looks we need to update in the following location also.?
https://hive.apache.org/general/downloads/


From: Denys Kuzmenko 
Date: Saturday, March 30, 2024 at 00:07
To: u...@hive.apache.org , dev@hive.apache.org 

Subject: [ANNOUNCE] Apache Hive 4.0.0 Released

The Apache Hive team is proud to announce the release of Apache Hive

version 4.0.0.



The Apache Hive (TM) data warehouse software facilitates querying and

managing large datasets residing in distributed storage. Built on top

of Apache Hadoop (TM), it provides, among others:



* Tools to enable easy data extract/transform/load (ETL)



* A mechanism to impose structure on a variety of data formats



* Access to files stored either directly in Apache HDFS (TM) or in other

  data storage systems such as Apache HBase (TM)



* Query execution via Apache Hadoop MapReduce, Apache Tez and Apache Spark 
frameworks. (MapReduce is deprecated, and Spark has been removed so the text 
needs to be modified depending on the release version)



For Hive release details and downloads, please visit:

https://hive.apache.org/downloads.html



Hive 4.0.0 Release Notes are available here:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843



We would like to thank the many contributors who made this release

possible.



Regards,



The Apache Hive Team


[ANNOUNCE] Apache Hive 4.0.0 Released

2024-03-29 Thread Denys Kuzmenko
The Apache Hive team is proud to announce the release of Apache Hive
version 4.0.0.

The Apache Hive (TM) data warehouse software facilitates querying and
managing large datasets residing in distributed storage. Built on top
of Apache Hadoop (TM), it provides, among others:

* Tools to enable easy data extract/transform/load (ETL)

* A mechanism to impose structure on a variety of data formats

* Access to files stored either directly in Apache HDFS (TM) or in other
  data storage systems such as Apache HBase (TM)

* Query execution via Apache Hadoop MapReduce, Apache Tez and Apache
Spark frameworks. (MapReduce is deprecated, and Spark has been removed
so the text needs to be modified depending on the release version)

For Hive release details and downloads, please
visit:https://hive.apache.org/downloads.html

Hive 4.0.0 Release Notes are available here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343=Text=12310843

We would like to thank the many contributors who made this release
possible.

Regards,

The Apache Hive Team


Help requested: Hive security triage and followup

2024-03-29 Thread Apache Security Team
Dear Hive Developers,

As you know, the Apache Software Foundation takes our users' security
seriously, and defines sensible release and security processes to make sure
potential security issues are dealt with responsibly. These indirectly also
protect our committers, shielding individuals from personal liability. Some
of this process is necessarily done in private; as we practice responsible
disclosure.

We are seeing potential security issues are reported privately to the Hive
PMC, but the PMC currently does not appear to have the bandwidth to triage
(and, if necessary, fix and disclose) them.

On behalf of the PMC: would anyone be interested in helping out here? If
so, please contact priv...@hive.apache.org with secur...@apache.org in Cc.


Kind regards,

The ASF Security Team


[RESULT][VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-29 Thread Denys Kuzmenko
Thanks to everyone who verified the release candidate and gave their
comments and votes.


Voting has closed and the results are as follows:


4 binding +1s:

* Ayush Saxena

* Denys Kuzmenko

* Marta Kuczora

* Krisztian Kasa

1 +0

* Stamatis Zampetakis


7 non-binding +1s:

* Butao Zhang

* Kirti Ruge

* Kokila Narayanan

* Simhadri Govindappa

* Sourabh Badhya

* Zhihua Deng

* Zoltán Rátkai

No -1s.


Therefore, I am delighted to announce that the proposal to release Apache
Hive 4.0.0 has passed.


I'll proceed with the next steps of the release and post an announcement
once the release becomes publicly available


Regards,

Denys


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-29 Thread Denys Kuzmenko
+1 (binding) 

* Executed functional test suite against Postgres DB


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-28 Thread Stamatis Zampetakis
-0 (binding)

Ubuntu 20.04.6 LTS, java version "1.8.0_261", Apache Maven 3.6.3

* Verified signatures and checksums OK
* Checked diff between git repo and release sources (diff -qr hive-git
hive-src) KO (4 empty directories in apache-hive-4.0.0-src)
Only in apache-hive-4.0.0-src/hcatalog: streaming
Only in apache-hive-4.0.0-src/itests: qtest-spark
Only in apache-hive-4.0.0-src/packaging/src/docker: ${project.basedir}
Only in apache-hive-4.0.0-src/shims: scheduler
* Checked LICENSE, source headers, and copyright notices KO (Logged
HIVE-28155, HIVE-28156, HIVE-28157, HIVE-28158, HIVE-28159,
HIVE-28160, for minor issues and improvements)
* Checked NOTICE, and README.md file OK
* Built from release sources and create binaries (mvn clean install
-DskipTests -Pitests,iceberg,dist) OK
* Spot check maven artifacts for general structure, LICENSE, NOTICE,
META-INF content KO (HIVE-28161)

Lots of small issues that would be nice to fix before releasing. I
didn't perform more release checks/tests cause I exceeded my quota
trying to address the logged issues.

Best,
Stamatis

On Thu, Mar 28, 2024 at 3:15 PM Krisztian Kasa
 wrote:
>
> +1 (binding)
>
> * Verified the checksum and signature [OK]
>
> * Built Hive 4.0.0 from source [OK]
>
> * Started Hiveserver2 with Hadoop 3.3.6 and Tez 0.10.3 and Postgres [OK]
>
> * Ran some simple Hive statements: create acid/iceberg tables, create
> materialized views having join of two tables and aggregates in the
> definition [OK]
>
> Thanks Denys for driving the release!
>
> Regards,
> Krisztian
>
>
> On Thu, Mar 28, 2024 at 12:04 PM Kirti Ruge  wrote:
>
> > +1 (non-binding)
> >
> >
> > I have done below steps on Mac m1
> >
> >  Built from HIVE 4.0.0 from source successfully.
> >  Verified checksums and signatures.
> >  Initialized metastore with postgresql.
> >  Started metastore and hiveserver .
> >  Ran some simple Hive queries via beeline and  checked same on webui (
> > http://localhost:10002/).
> >  Built docker image and started hive services with docker.
> >
> > Regards,
> > Kirti
> >
> > > On 28-Mar-2024, at 3:41 PM, Zoltán Rátkai 
> > wrote:
> > >
> > > +1 (non-binding)
> > >
> > > Performed on Mac M1:
> > >
> > > - Verified checksums
> > > - Verified signature
> > > - Built from source
> > > - Build docker image (HADOOP_VERSION=3.3.6, TEZ_VERSION=0.10.3)
> > > - Started docker image
> > > - Checked web GUI is working (http://localhost:10002/)
> > > - Created a table and ran CRUD operations on Hive ACID table successfully
> > > on the Docker environment
> > > - Checked the executed queries via web GUI Regards,
> > >
> > > Zoltan Ratkai
> > >
> > > On Thu, Mar 28, 2024 at 8:41 AM kokila narayanan <
> > > kokilanarayana...@gmail.com> wrote:
> > >
> > >> +1 (non-binding)
> > >>
> > >> 1. Verified checksums
> > >> 2. Verified signatures
> > >> 3. Built from source successfully
> > >> 4. Deployed and started binary tar with Hadoop 3.3.6 and Tez 0.10.3.
> > >> 5. Executed basic operations on ACID and external tables.
> > >>
> > >> Regards,
> > >> Kokila
> > >>
> > >> On Thu, Mar 28, 2024 at 12:30 PM Sourabh Badhya
> > >>  wrote:
> > >>
> > >>> +1 (non-binding)
> > >>>
> > >>> [1] Built from source successfully.
> > >>> [2] Verified checksums and signatures.
> > >>> [3] Built docker image with Apache Hadoop 3.3.6 and Apache Tez 0.10.3
> > and
> > >>> metastore using Postgres successfully.
> > >>> [4] Ran CRUD operations on Hive ACID, Iceberg tables and basic
> > operations
> > >>> on Hive external tables successfully on the Docker environment.
> > >>> [5] Browsed the same executed queries via Hiveserver2 UI.
> > >>>
> > >>> Thanks Denys for driving the release.
> > >>>
> > >>> Regards,
> > >>> Sourabh Badhya
> > >>>
> > >>> On Wed, Mar 27, 2024 at 10:38 PM Ayush Saxena 
> > >> wrote:
> > >>>
> >  +1 (Binding)
> > 
> >  * Built from source
> >  * Verified checksums
> >  * Verified signature
> >  * Verified all code files have ASF Header
> >  * Validated the Notice & License files
> >  * No code diff b/w git tag & src tar
> >  * Ran some basic operations on Iceberg, ACID & External Tables (Hive
> > on
> >  Tez)
> >  * Browsed through HS2 UI
> >  * Built Docker image from source & tried some basic commands on the
> > >>> docker
> >  environment.
> >  * Skimmed over the contents of maven repo.
> > 
> >  Thanx Denys for driving the release. Good Luck!!!
> > 
> >  -Ayush
> > 
> >  On Wed, 27 Mar 2024 at 21:05, Marta Kuczora
> > >>>  > >
> >  wrote:
> > 
> > > +1 (binding)
> > >
> > > Thanks a lot Denys for driving the release!
> > >
> > > * Verified the checksum and signature [OK]
> > >
> > > * Built Hive 4.0.0 from source [OK]
> > >
> > > * Initialized metastore with MySQL [OK]
> > >
> > > * Built package and ran metastore and hiveserver [OK]
> > >
> > > * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3
> > >>> [OK]
> > 

Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-28 Thread Krisztian Kasa
+1 (binding)

* Verified the checksum and signature [OK]

* Built Hive 4.0.0 from source [OK]

* Started Hiveserver2 with Hadoop 3.3.6 and Tez 0.10.3 and Postgres [OK]

* Ran some simple Hive statements: create acid/iceberg tables, create
materialized views having join of two tables and aggregates in the
definition [OK]

Thanks Denys for driving the release!

Regards,
Krisztian


On Thu, Mar 28, 2024 at 12:04 PM Kirti Ruge  wrote:

> +1 (non-binding)
>
>
> I have done below steps on Mac m1
>
>  Built from HIVE 4.0.0 from source successfully.
>  Verified checksums and signatures.
>  Initialized metastore with postgresql.
>  Started metastore and hiveserver .
>  Ran some simple Hive queries via beeline and  checked same on webui (
> http://localhost:10002/).
>  Built docker image and started hive services with docker.
>
> Regards,
> Kirti
>
> > On 28-Mar-2024, at 3:41 PM, Zoltán Rátkai 
> wrote:
> >
> > +1 (non-binding)
> >
> > Performed on Mac M1:
> >
> > - Verified checksums
> > - Verified signature
> > - Built from source
> > - Build docker image (HADOOP_VERSION=3.3.6, TEZ_VERSION=0.10.3)
> > - Started docker image
> > - Checked web GUI is working (http://localhost:10002/)
> > - Created a table and ran CRUD operations on Hive ACID table successfully
> > on the Docker environment
> > - Checked the executed queries via web GUI Regards,
> >
> > Zoltan Ratkai
> >
> > On Thu, Mar 28, 2024 at 8:41 AM kokila narayanan <
> > kokilanarayana...@gmail.com> wrote:
> >
> >> +1 (non-binding)
> >>
> >> 1. Verified checksums
> >> 2. Verified signatures
> >> 3. Built from source successfully
> >> 4. Deployed and started binary tar with Hadoop 3.3.6 and Tez 0.10.3.
> >> 5. Executed basic operations on ACID and external tables.
> >>
> >> Regards,
> >> Kokila
> >>
> >> On Thu, Mar 28, 2024 at 12:30 PM Sourabh Badhya
> >>  wrote:
> >>
> >>> +1 (non-binding)
> >>>
> >>> [1] Built from source successfully.
> >>> [2] Verified checksums and signatures.
> >>> [3] Built docker image with Apache Hadoop 3.3.6 and Apache Tez 0.10.3
> and
> >>> metastore using Postgres successfully.
> >>> [4] Ran CRUD operations on Hive ACID, Iceberg tables and basic
> operations
> >>> on Hive external tables successfully on the Docker environment.
> >>> [5] Browsed the same executed queries via Hiveserver2 UI.
> >>>
> >>> Thanks Denys for driving the release.
> >>>
> >>> Regards,
> >>> Sourabh Badhya
> >>>
> >>> On Wed, Mar 27, 2024 at 10:38 PM Ayush Saxena 
> >> wrote:
> >>>
>  +1 (Binding)
> 
>  * Built from source
>  * Verified checksums
>  * Verified signature
>  * Verified all code files have ASF Header
>  * Validated the Notice & License files
>  * No code diff b/w git tag & src tar
>  * Ran some basic operations on Iceberg, ACID & External Tables (Hive
> on
>  Tez)
>  * Browsed through HS2 UI
>  * Built Docker image from source & tried some basic commands on the
> >>> docker
>  environment.
>  * Skimmed over the contents of maven repo.
> 
>  Thanx Denys for driving the release. Good Luck!!!
> 
>  -Ayush
> 
>  On Wed, 27 Mar 2024 at 21:05, Marta Kuczora
> >>>  >
>  wrote:
> 
> > +1 (binding)
> >
> > Thanks a lot Denys for driving the release!
> >
> > * Verified the checksum and signature [OK]
> >
> > * Built Hive 4.0.0 from source [OK]
> >
> > * Initialized metastore with MySQL [OK]
> >
> > * Built package and ran metastore and hiveserver [OK]
> >
> > * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3
> >>> [OK]
> >
> > * Ran some simple Hive queries with external/acid/iceberg tables [OK]
> >
> >
> > Regards,
> >
> > Marta
> >
> > On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko  >>>
> > wrote:
> >
> >> Hi Everyone,
> >>
> >> We would like to thank everyone who has contributed to the project
> >>> and
> >> request
> >> the Hive PMC members to review and vote on this new release
> >>> candidate.
> >>
> >> Apache Hive 4.0.0 RC-0 artifacts are available here:*
> >> https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
> >>
> >>
> >> The checksums are as follows:
> >> - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> >> apache-hive-4.0.0-bin.tar.gz
> >> - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> >> apache-hive-4.0.0-src.tar.gz
> >>
> >>
> >> You can find the KEYS file here:
> >>
> >> * https://downloads.apache.org/hive/KEYS
> >>
> >>
> >> A staged Maven repository URL is:*
> >>
> >>> https://repository.apache.org/content/repositories/orgapachehive-1127/
> >>
> >> The git commit hash is:*
> >>
> >>
> >
> 
> >>>
> >>
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
> >>
> >>
> >> This corresponds to the tag: release-4.0.0-rc0
> >> * 

Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-28 Thread Kirti Ruge
+1 (non-binding)


I have done below steps on Mac m1

 Built from HIVE 4.0.0 from source successfully.
 Verified checksums and signatures.
 Initialized metastore with postgresql.
 Started metastore and hiveserver . 
 Ran some simple Hive queries via beeline and  checked same on webui 
(http://localhost:10002/).
 Built docker image and started hive services with docker. 

Regards,
Kirti

> On 28-Mar-2024, at 3:41 PM, Zoltán Rátkai  
> wrote:
> 
> +1 (non-binding)
> 
> Performed on Mac M1:
> 
> - Verified checksums
> - Verified signature
> - Built from source
> - Build docker image (HADOOP_VERSION=3.3.6, TEZ_VERSION=0.10.3)
> - Started docker image
> - Checked web GUI is working (http://localhost:10002/)
> - Created a table and ran CRUD operations on Hive ACID table successfully
> on the Docker environment
> - Checked the executed queries via web GUI Regards,
> 
> Zoltan Ratkai
> 
> On Thu, Mar 28, 2024 at 8:41 AM kokila narayanan <
> kokilanarayana...@gmail.com> wrote:
> 
>> +1 (non-binding)
>> 
>> 1. Verified checksums
>> 2. Verified signatures
>> 3. Built from source successfully
>> 4. Deployed and started binary tar with Hadoop 3.3.6 and Tez 0.10.3.
>> 5. Executed basic operations on ACID and external tables.
>> 
>> Regards,
>> Kokila
>> 
>> On Thu, Mar 28, 2024 at 12:30 PM Sourabh Badhya
>>  wrote:
>> 
>>> +1 (non-binding)
>>> 
>>> [1] Built from source successfully.
>>> [2] Verified checksums and signatures.
>>> [3] Built docker image with Apache Hadoop 3.3.6 and Apache Tez 0.10.3 and
>>> metastore using Postgres successfully.
>>> [4] Ran CRUD operations on Hive ACID, Iceberg tables and basic operations
>>> on Hive external tables successfully on the Docker environment.
>>> [5] Browsed the same executed queries via Hiveserver2 UI.
>>> 
>>> Thanks Denys for driving the release.
>>> 
>>> Regards,
>>> Sourabh Badhya
>>> 
>>> On Wed, Mar 27, 2024 at 10:38 PM Ayush Saxena 
>> wrote:
>>> 
 +1 (Binding)
 
 * Built from source
 * Verified checksums
 * Verified signature
 * Verified all code files have ASF Header
 * Validated the Notice & License files
 * No code diff b/w git tag & src tar
 * Ran some basic operations on Iceberg, ACID & External Tables (Hive on
 Tez)
 * Browsed through HS2 UI
 * Built Docker image from source & tried some basic commands on the
>>> docker
 environment.
 * Skimmed over the contents of maven repo.
 
 Thanx Denys for driving the release. Good Luck!!!
 
 -Ayush
 
 On Wed, 27 Mar 2024 at 21:05, Marta Kuczora
>>>  
 wrote:
 
> +1 (binding)
> 
> Thanks a lot Denys for driving the release!
> 
> * Verified the checksum and signature [OK]
> 
> * Built Hive 4.0.0 from source [OK]
> 
> * Initialized metastore with MySQL [OK]
> 
> * Built package and ran metastore and hiveserver [OK]
> 
> * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3
>>> [OK]
> 
> * Ran some simple Hive queries with external/acid/iceberg tables [OK]
> 
> 
> Regards,
> 
> Marta
> 
> On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko >> 
> wrote:
> 
>> Hi Everyone,
>> 
>> We would like to thank everyone who has contributed to the project
>>> and
>> request
>> the Hive PMC members to review and vote on this new release
>>> candidate.
>> 
>> Apache Hive 4.0.0 RC-0 artifacts are available here:*
>> https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
>> 
>> 
>> The checksums are as follows:
>> - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
>> apache-hive-4.0.0-bin.tar.gz
>> - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
>> apache-hive-4.0.0-src.tar.gz
>> 
>> 
>> You can find the KEYS file here:
>> 
>> * https://downloads.apache.org/hive/KEYS
>> 
>> 
>> A staged Maven repository URL is:*
>> 
>>> https://repository.apache.org/content/repositories/orgapachehive-1127/
>> 
>> The git commit hash is:*
>> 
>> 
> 
 
>>> 
>> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
>> 
>> 
>> This corresponds to the tag: release-4.0.0-rc0
>> * https://github.com/apache/hive/tree/release-4.0.0-rc0
>> 
>> The vote is open for the next 72 hours and passes if a majority of
>> at
> least
>> three +1 PMC votes are cast.
>> 
>> (Only PMC members have binding votes, however, other community
>>> members
>> are encouraged to cast non-binding votes.)
>> 
>> 
>> [ ] +1 Release this package as Apache Hive 4.0.0
>> [ ] +0
>> [ ] -1 Do not release this because...
>> 
>> 
>> Please download, verify, and test.
>> 
>> 
>> Regards,
>> 
>> Denys
>> 
> 
 
>>> 
>> 



Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-28 Thread Zoltán Rátkai
+1 (non-binding)

Performed on Mac M1:

- Verified checksums
- Verified signature
- Built from source
- Build docker image (HADOOP_VERSION=3.3.6, TEZ_VERSION=0.10.3)
- Started docker image
- Checked web GUI is working (http://localhost:10002/)
- Created a table and ran CRUD operations on Hive ACID table successfully
on the Docker environment
- Checked the executed queries via web GUI Regards,

Zoltan Ratkai

On Thu, Mar 28, 2024 at 8:41 AM kokila narayanan <
kokilanarayana...@gmail.com> wrote:

> +1 (non-binding)
>
> 1. Verified checksums
> 2. Verified signatures
> 3. Built from source successfully
> 4. Deployed and started binary tar with Hadoop 3.3.6 and Tez 0.10.3.
> 5. Executed basic operations on ACID and external tables.
>
> Regards,
> Kokila
>
> On Thu, Mar 28, 2024 at 12:30 PM Sourabh Badhya
>  wrote:
>
> > +1 (non-binding)
> >
> > [1] Built from source successfully.
> > [2] Verified checksums and signatures.
> > [3] Built docker image with Apache Hadoop 3.3.6 and Apache Tez 0.10.3 and
> > metastore using Postgres successfully.
> > [4] Ran CRUD operations on Hive ACID, Iceberg tables and basic operations
> > on Hive external tables successfully on the Docker environment.
> > [5] Browsed the same executed queries via Hiveserver2 UI.
> >
> > Thanks Denys for driving the release.
> >
> > Regards,
> > Sourabh Badhya
> >
> > On Wed, Mar 27, 2024 at 10:38 PM Ayush Saxena 
> wrote:
> >
> > > +1 (Binding)
> > >
> > > * Built from source
> > > * Verified checksums
> > > * Verified signature
> > > * Verified all code files have ASF Header
> > > * Validated the Notice & License files
> > > * No code diff b/w git tag & src tar
> > > * Ran some basic operations on Iceberg, ACID & External Tables (Hive on
> > > Tez)
> > > * Browsed through HS2 UI
> > > * Built Docker image from source & tried some basic commands on the
> > docker
> > > environment.
> > > * Skimmed over the contents of maven repo.
> > >
> > > Thanx Denys for driving the release. Good Luck!!!
> > >
> > > -Ayush
> > >
> > > On Wed, 27 Mar 2024 at 21:05, Marta Kuczora
> >  > > >
> > > wrote:
> > >
> > > > +1 (binding)
> > > >
> > > > Thanks a lot Denys for driving the release!
> > > >
> > > > * Verified the checksum and signature [OK]
> > > >
> > > > * Built Hive 4.0.0 from source [OK]
> > > >
> > > > * Initialized metastore with MySQL [OK]
> > > >
> > > > * Built package and ran metastore and hiveserver [OK]
> > > >
> > > > * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3
> > [OK]
> > > >
> > > > * Ran some simple Hive queries with external/acid/iceberg tables [OK]
> > > >
> > > >
> > > > Regards,
> > > >
> > > > Marta
> > > >
> > > > On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko  >
> > > > wrote:
> > > >
> > > > > Hi Everyone,
> > > > >
> > > > > We would like to thank everyone who has contributed to the project
> > and
> > > > > request
> > > > > the Hive PMC members to review and vote on this new release
> > candidate.
> > > > >
> > > > > Apache Hive 4.0.0 RC-0 artifacts are available here:*
> > > > > https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
> > > > >
> > > > >
> > > > > The checksums are as follows:
> > > > > - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> > > > > apache-hive-4.0.0-bin.tar.gz
> > > > > - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> > > > > apache-hive-4.0.0-src.tar.gz
> > > > >
> > > > >
> > > > > You can find the KEYS file here:
> > > > >
> > > > > * https://downloads.apache.org/hive/KEYS
> > > > >
> > > > >
> > > > > A staged Maven repository URL is:*
> > > > >
> > https://repository.apache.org/content/repositories/orgapachehive-1127/
> > > > >
> > > > > The git commit hash is:*
> > > > >
> > > > >
> > > >
> > >
> >
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
> > > > >
> > > > >
> > > > > This corresponds to the tag: release-4.0.0-rc0
> > > > > * https://github.com/apache/hive/tree/release-4.0.0-rc0
> > > > >
> > > > > The vote is open for the next 72 hours and passes if a majority of
> at
> > > > least
> > > > > three +1 PMC votes are cast.
> > > > >
> > > > > (Only PMC members have binding votes, however, other community
> > members
> > > > > are encouraged to cast non-binding votes.)
> > > > >
> > > > >
> > > > > [ ] +1 Release this package as Apache Hive 4.0.0
> > > > > [ ] +0
> > > > > [ ] -1 Do not release this because...
> > > > >
> > > > >
> > > > > Please download, verify, and test.
> > > > >
> > > > >
> > > > > Regards,
> > > > >
> > > > > Denys
> > > > >
> > > >
> > >
> >
>


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-28 Thread kokila narayanan
+1 (non-binding)

1. Verified checksums
2. Verified signatures
3. Built from source successfully
4. Deployed and started binary tar with Hadoop 3.3.6 and Tez 0.10.3.
5. Executed basic operations on ACID and external tables.

Regards,
Kokila

On Thu, Mar 28, 2024 at 12:30 PM Sourabh Badhya
 wrote:

> +1 (non-binding)
>
> [1] Built from source successfully.
> [2] Verified checksums and signatures.
> [3] Built docker image with Apache Hadoop 3.3.6 and Apache Tez 0.10.3 and
> metastore using Postgres successfully.
> [4] Ran CRUD operations on Hive ACID, Iceberg tables and basic operations
> on Hive external tables successfully on the Docker environment.
> [5] Browsed the same executed queries via Hiveserver2 UI.
>
> Thanks Denys for driving the release.
>
> Regards,
> Sourabh Badhya
>
> On Wed, Mar 27, 2024 at 10:38 PM Ayush Saxena  wrote:
>
> > +1 (Binding)
> >
> > * Built from source
> > * Verified checksums
> > * Verified signature
> > * Verified all code files have ASF Header
> > * Validated the Notice & License files
> > * No code diff b/w git tag & src tar
> > * Ran some basic operations on Iceberg, ACID & External Tables (Hive on
> > Tez)
> > * Browsed through HS2 UI
> > * Built Docker image from source & tried some basic commands on the
> docker
> > environment.
> > * Skimmed over the contents of maven repo.
> >
> > Thanx Denys for driving the release. Good Luck!!!
> >
> > -Ayush
> >
> > On Wed, 27 Mar 2024 at 21:05, Marta Kuczora
>  > >
> > wrote:
> >
> > > +1 (binding)
> > >
> > > Thanks a lot Denys for driving the release!
> > >
> > > * Verified the checksum and signature [OK]
> > >
> > > * Built Hive 4.0.0 from source [OK]
> > >
> > > * Initialized metastore with MySQL [OK]
> > >
> > > * Built package and ran metastore and hiveserver [OK]
> > >
> > > * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3
> [OK]
> > >
> > > * Ran some simple Hive queries with external/acid/iceberg tables [OK]
> > >
> > >
> > > Regards,
> > >
> > > Marta
> > >
> > > On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko 
> > > wrote:
> > >
> > > > Hi Everyone,
> > > >
> > > > We would like to thank everyone who has contributed to the project
> and
> > > > request
> > > > the Hive PMC members to review and vote on this new release
> candidate.
> > > >
> > > > Apache Hive 4.0.0 RC-0 artifacts are available here:*
> > > > https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
> > > >
> > > >
> > > > The checksums are as follows:
> > > > - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> > > > apache-hive-4.0.0-bin.tar.gz
> > > > - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> > > > apache-hive-4.0.0-src.tar.gz
> > > >
> > > >
> > > > You can find the KEYS file here:
> > > >
> > > > * https://downloads.apache.org/hive/KEYS
> > > >
> > > >
> > > > A staged Maven repository URL is:*
> > > >
> https://repository.apache.org/content/repositories/orgapachehive-1127/
> > > >
> > > > The git commit hash is:*
> > > >
> > > >
> > >
> >
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
> > > >
> > > >
> > > > This corresponds to the tag: release-4.0.0-rc0
> > > > * https://github.com/apache/hive/tree/release-4.0.0-rc0
> > > >
> > > > The vote is open for the next 72 hours and passes if a majority of at
> > > least
> > > > three +1 PMC votes are cast.
> > > >
> > > > (Only PMC members have binding votes, however, other community
> members
> > > > are encouraged to cast non-binding votes.)
> > > >
> > > >
> > > > [ ] +1 Release this package as Apache Hive 4.0.0
> > > > [ ] +0
> > > > [ ] -1 Do not release this because...
> > > >
> > > >
> > > > Please download, verify, and test.
> > > >
> > > >
> > > > Regards,
> > > >
> > > > Denys
> > > >
> > >
> >
>


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-28 Thread Sourabh Badhya
+1 (non-binding)

[1] Built from source successfully.
[2] Verified checksums and signatures.
[3] Built docker image with Apache Hadoop 3.3.6 and Apache Tez 0.10.3 and
metastore using Postgres successfully.
[4] Ran CRUD operations on Hive ACID, Iceberg tables and basic operations
on Hive external tables successfully on the Docker environment.
[5] Browsed the same executed queries via Hiveserver2 UI.

Thanks Denys for driving the release.

Regards,
Sourabh Badhya

On Wed, Mar 27, 2024 at 10:38 PM Ayush Saxena  wrote:

> +1 (Binding)
>
> * Built from source
> * Verified checksums
> * Verified signature
> * Verified all code files have ASF Header
> * Validated the Notice & License files
> * No code diff b/w git tag & src tar
> * Ran some basic operations on Iceberg, ACID & External Tables (Hive on
> Tez)
> * Browsed through HS2 UI
> * Built Docker image from source & tried some basic commands on the docker
> environment.
> * Skimmed over the contents of maven repo.
>
> Thanx Denys for driving the release. Good Luck!!!
>
> -Ayush
>
> On Wed, 27 Mar 2024 at 21:05, Marta Kuczora  >
> wrote:
>
> > +1 (binding)
> >
> > Thanks a lot Denys for driving the release!
> >
> > * Verified the checksum and signature [OK]
> >
> > * Built Hive 4.0.0 from source [OK]
> >
> > * Initialized metastore with MySQL [OK]
> >
> > * Built package and ran metastore and hiveserver [OK]
> >
> > * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3 [OK]
> >
> > * Ran some simple Hive queries with external/acid/iceberg tables [OK]
> >
> >
> > Regards,
> >
> > Marta
> >
> > On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko 
> > wrote:
> >
> > > Hi Everyone,
> > >
> > > We would like to thank everyone who has contributed to the project and
> > > request
> > > the Hive PMC members to review and vote on this new release candidate.
> > >
> > > Apache Hive 4.0.0 RC-0 artifacts are available here:*
> > > https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
> > >
> > >
> > > The checksums are as follows:
> > > - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> > > apache-hive-4.0.0-bin.tar.gz
> > > - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> > > apache-hive-4.0.0-src.tar.gz
> > >
> > >
> > > You can find the KEYS file here:
> > >
> > > * https://downloads.apache.org/hive/KEYS
> > >
> > >
> > > A staged Maven repository URL is:*
> > > https://repository.apache.org/content/repositories/orgapachehive-1127/
> > >
> > > The git commit hash is:*
> > >
> > >
> >
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
> > >
> > >
> > > This corresponds to the tag: release-4.0.0-rc0
> > > * https://github.com/apache/hive/tree/release-4.0.0-rc0
> > >
> > > The vote is open for the next 72 hours and passes if a majority of at
> > least
> > > three +1 PMC votes are cast.
> > >
> > > (Only PMC members have binding votes, however, other community members
> > > are encouraged to cast non-binding votes.)
> > >
> > >
> > > [ ] +1 Release this package as Apache Hive 4.0.0
> > > [ ] +0
> > > [ ] -1 Do not release this because...
> > >
> > >
> > > Please download, verify, and test.
> > >
> > >
> > > Regards,
> > >
> > > Denys
> > >
> >
>


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-27 Thread Ayush Saxena
+1 (Binding)

* Built from source
* Verified checksums
* Verified signature
* Verified all code files have ASF Header
* Validated the Notice & License files
* No code diff b/w git tag & src tar
* Ran some basic operations on Iceberg, ACID & External Tables (Hive on Tez)
* Browsed through HS2 UI
* Built Docker image from source & tried some basic commands on the docker
environment.
* Skimmed over the contents of maven repo.

Thanx Denys for driving the release. Good Luck!!!

-Ayush

On Wed, 27 Mar 2024 at 21:05, Marta Kuczora 
wrote:

> +1 (binding)
>
> Thanks a lot Denys for driving the release!
>
> * Verified the checksum and signature [OK]
>
> * Built Hive 4.0.0 from source [OK]
>
> * Initialized metastore with MySQL [OK]
>
> * Built package and ran metastore and hiveserver [OK]
>
> * Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3 [OK]
>
> * Ran some simple Hive queries with external/acid/iceberg tables [OK]
>
>
> Regards,
>
> Marta
>
> On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko 
> wrote:
>
> > Hi Everyone,
> >
> > We would like to thank everyone who has contributed to the project and
> > request
> > the Hive PMC members to review and vote on this new release candidate.
> >
> > Apache Hive 4.0.0 RC-0 artifacts are available here:*
> > https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
> >
> >
> > The checksums are as follows:
> > - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> > apache-hive-4.0.0-bin.tar.gz
> > - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> > apache-hive-4.0.0-src.tar.gz
> >
> >
> > You can find the KEYS file here:
> >
> > * https://downloads.apache.org/hive/KEYS
> >
> >
> > A staged Maven repository URL is:*
> > https://repository.apache.org/content/repositories/orgapachehive-1127/
> >
> > The git commit hash is:*
> >
> >
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
> >
> >
> > This corresponds to the tag: release-4.0.0-rc0
> > * https://github.com/apache/hive/tree/release-4.0.0-rc0
> >
> > The vote is open for the next 72 hours and passes if a majority of at
> least
> > three +1 PMC votes are cast.
> >
> > (Only PMC members have binding votes, however, other community members
> > are encouraged to cast non-binding votes.)
> >
> >
> > [ ] +1 Release this package as Apache Hive 4.0.0
> > [ ] +0
> > [ ] -1 Do not release this because...
> >
> >
> > Please download, verify, and test.
> >
> >
> > Regards,
> >
> > Denys
> >
>


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-27 Thread Marta Kuczora
+1 (binding)

Thanks a lot Denys for driving the release!

* Verified the checksum and signature [OK]

* Built Hive 4.0.0 from source [OK]

* Initialized metastore with MySQL [OK]

* Built package and ran metastore and hiveserver [OK]

* Deployed and start the binary tar with Hadoop 3.3.6 and Tez 0.10.3 [OK]

* Ran some simple Hive queries with external/acid/iceberg tables [OK]


Regards,

Marta

On Tue, Mar 26, 2024 at 8:26 AM Denys Kuzmenko  wrote:

> Hi Everyone,
>
> We would like to thank everyone who has contributed to the project and
> request
> the Hive PMC members to review and vote on this new release candidate.
>
> Apache Hive 4.0.0 RC-0 artifacts are available here:*
> https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
>
>
> The checksums are as follows:
> - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> apache-hive-4.0.0-bin.tar.gz
> - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> apache-hive-4.0.0-src.tar.gz
>
>
> You can find the KEYS file here:
>
> * https://downloads.apache.org/hive/KEYS
>
>
> A staged Maven repository URL is:*
> https://repository.apache.org/content/repositories/orgapachehive-1127/
>
> The git commit hash is:*
>
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
>
>
> This corresponds to the tag: release-4.0.0-rc0
> * https://github.com/apache/hive/tree/release-4.0.0-rc0
>
> The vote is open for the next 72 hours and passes if a majority of at least
> three +1 PMC votes are cast.
>
> (Only PMC members have binding votes, however, other community members
> are encouraged to cast non-binding votes.)
>
>
> [ ] +1 Release this package as Apache Hive 4.0.0
> [ ] +0
> [ ] -1 Do not release this because...
>
>
> Please download, verify, and test.
>
>
> Regards,
>
> Denys
>


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-27 Thread Zhihua Deng
+1 (non-binding)

Thanks Denys for driving the release!

1. Verified the checksum and signature: OK
2. Good rat check, build from source, take a quick over the files: OK
3. Upgrade the PostgreSQL HMS schema from 2.3.0/3.1.0 to 4.0.0: OK
4. Build an image using this tarball, Hadoop 3.3.6 and Tez 0.10.3, start HMS 
and HS2 from this image: OK
5. Run some simple Hive queries: OK

Regards,
Zhihua

On 2024/03/27 01:41:30 Butao Zhang wrote:
> +1 (non-binding)
> 
> 
> I checked:
> [x] Build the 4.0.0 source code successfully: mvn clean package -DskipTests 
> -Pdist -Piceberg -Pitests
> [x] Deploy and start the binary tar against Hadoop3.3.6 & Tez0.10.3  
> successfully. 
> [x] Run some test SQLs, such as create acid table/ iceberg table, and do some 
> basic/acid operations (insert/delete/update) 
> [x] Enable Ranger authorization plugin, do some db/tbl permission check.
> 
> 
> Thanks Denys for driving the release. I'm excited to see the official 
> upcoming release of version Hive 4.0.0!
>  Replied Message 
> | From | Denys Kuzmenko |
> | Date | 3/26/2024 15:26 |
> | To |  |
> | Subject | [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0) |
> Hi Everyone,
> 
> We would like to thank everyone who has contributed to the project and request
> the Hive PMC members to review and vote on this new release candidate.
> 
> Apache Hive 4.0.0 RC-0 artifacts are available here:*
> https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
> 
> 
> The checksums are as follows:
> - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> apache-hive-4.0.0-bin.tar.gz
> - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> apache-hive-4.0.0-src.tar.gz
> 
> 
> You can find the KEYS file here:
> 
> * https://downloads.apache.org/hive/KEYS
> 
> 
> A staged Maven repository URL is:*
> https://repository.apache.org/content/repositories/orgapachehive-1127/
> 
> The git commit hash is:*
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
> 
> 
> This corresponds to the tag: release-4.0.0-rc0
> * https://github.com/apache/hive/tree/release-4.0.0-rc0
> 
> The vote is open for the next 72 hours and passes if a majority of at least
> three +1 PMC votes are cast.
> 
> (Only PMC members have binding votes, however, other community members
> are encouraged to cast non-binding votes.)
> 
> 
> [ ] +1 Release this package as Apache Hive 4.0.0
> [ ] +0
> [ ] -1 Do not release this because...
> 
> 
> Please download, verify, and test.
> 
> 
> Regards,
> 
> Denys
> 


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-27 Thread Simhadri G
Hi Everyone,

Thanks, Denys for driving the release.

+1 (non-binding)

I Verified the following:

* Downloaded the source tarball, signature (.asc), and checksum: ✓ OK
*Imported GPG keys and verified the signature: ✓ OK

   1. Download KEYS and run gpg --import /path/to/downloaded/KEYS
   2. Verify the signature by running: gpg --verify
   ./apache-hive-4.0.0-src.tar.gz.asc ./apache-hive-4.0.0-src.tar.gz and gpg
   --verify ./apache-hive-4.0.0-bin.tar.gz.asc  ./apache-hive-4.0.0-bin.tar.gz

* Validated checksum and signature for the artifacts: ✓ OK
* Successfully built from source: ✓ OK
* Initialized meta scripts against MySQL: ✓ OK
* Confirmed successful standalone metastore setup with MySQL: ✓ OK
* Deployed and started HiveServer2 and Metastore with Hadoop 3.3.6 and Tez
0.10.3: ✓ OK
* Ran TPCDS queries on Hive external tables with Tez and also executed a
few hive Iceberg queries : ✓ OK

Thanks!
Simhadri G

On Wed, Mar 27, 2024 at 7:12 AM Butao Zhang  wrote:

> +1 (non-binding)
>
>
> I checked:
> [x] Build the 4.0.0 source code successfully: mvn clean package
> -DskipTests -Pdist -Piceberg -Pitests
> [x] Deploy and start the binary tar against Hadoop3.3.6 & Tez0.10.3
> successfully.
> [x] Run some test SQLs, such as create acid table/ iceberg table, and do
> some basic/acid operations (insert/delete/update)
> [x] Enable Ranger authorization plugin, do some db/tbl permission check.
>
>
> Thanks Denys for driving the release. I'm excited to see the official
> upcoming release of version Hive 4.0.0!
>  Replied Message 
> | From | Denys Kuzmenko |
> | Date | 3/26/2024 15:26 |
> | To |  |
> | Subject | [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0) |
> Hi Everyone,
>
> We would like to thank everyone who has contributed to the project and
> request
> the Hive PMC members to review and vote on this new release candidate.
>
> Apache Hive 4.0.0 RC-0 artifacts are available here:*
> https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/
>
>
> The checksums are as follows:
> - 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
> apache-hive-4.0.0-bin.tar.gz
> - 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
> apache-hive-4.0.0-src.tar.gz
>
>
> You can find the KEYS file here:
>
> * https://downloads.apache.org/hive/KEYS
>
>
> A staged Maven repository URL is:*
> https://repository.apache.org/content/repositories/orgapachehive-1127/
>
> The git commit hash is:*
>
> https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c
>
>
> This corresponds to the tag: release-4.0.0-rc0
> * https://github.com/apache/hive/tree/release-4.0.0-rc0
>
> The vote is open for the next 72 hours and passes if a majority of at least
> three +1 PMC votes are cast.
>
> (Only PMC members have binding votes, however, other community members
> are encouraged to cast non-binding votes.)
>
>
> [ ] +1 Release this package as Apache Hive 4.0.0
> [ ] +0
> [ ] -1 Do not release this because...
>
>
> Please download, verify, and test.
>
>
> Regards,
>
> Denys
>


Community Over Code NA 2024 Travel Assistance Applications now open!

2024-03-27 Thread Gavin McDonald
Hello to all users, contributors and Committers!

[ You are receiving this email as a subscriber to one or more ASF project
dev or user
  mailing lists and is not being sent to you directly. It is important that
we reach all of our
  users and contributors/committers so that they may get a chance to
benefit from this.
  We apologise in advance if this doesn't interest you but it is on topic
for the mailing
  lists of the Apache Software Foundation; and it is important please that
you do not
  mark this as spam in your email client. Thank You! ]

The Travel Assistance Committee (TAC) are pleased to announce that
travel assistance applications for Community over Code NA 2024 are now
open!

We will be supporting Community over Code NA, Denver Colorado in
October 7th to the 10th 2024.

TAC exists to help those that would like to attend Community over Code
events, but are unable to do so for financial reasons. For more info
on this years applications and qualifying criteria, please visit the
TAC website at < https://tac.apache.org/ >. Applications are already
open on https://tac-apply.apache.org/, so don't delay!

The Apache Travel Assistance Committee will only be accepting
applications from those people that are able to attend the full event.

Important: Applications close on Monday 6th May, 2024.

Applicants have until the the closing date above to submit their
applications (which should contain as much supporting material as
required to efficiently and accurately process their request), this
will enable TAC to announce successful applications shortly
afterwards.

As usual, TAC expects to deal with a range of applications from a
diverse range of backgrounds; therefore, we encourage (as always)
anyone thinking about sending in an application to do so ASAP.

For those that will need a Visa to enter the Country - we advise you apply
now so that you have enough time in case of interview delays. So do not
wait until you know if you have been accepted or not.

We look forward to greeting many of you in Denver, Colorado , October 2024!

Kind Regards,

Gavin

(On behalf of the Travel Assistance Committee)


Re: [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-26 Thread Butao Zhang
+1 (non-binding)


I checked:
[x] Build the 4.0.0 source code successfully: mvn clean package -DskipTests 
-Pdist -Piceberg -Pitests
[x] Deploy and start the binary tar against Hadoop3.3.6 & Tez0.10.3  
successfully. 
[x] Run some test SQLs, such as create acid table/ iceberg table, and do some 
basic/acid operations (insert/delete/update) 
[x] Enable Ranger authorization plugin, do some db/tbl permission check.


Thanks Denys for driving the release. I'm excited to see the official upcoming 
release of version Hive 4.0.0!
 Replied Message 
| From | Denys Kuzmenko |
| Date | 3/26/2024 15:26 |
| To |  |
| Subject | [VOTE] Release Apache Hive 4.0.0 (Release Candidate 0) |
Hi Everyone,

We would like to thank everyone who has contributed to the project and request
the Hive PMC members to review and vote on this new release candidate.

Apache Hive 4.0.0 RC-0 artifacts are available here:*
https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/


The checksums are as follows:
- 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
apache-hive-4.0.0-bin.tar.gz
- 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
apache-hive-4.0.0-src.tar.gz


You can find the KEYS file here:

* https://downloads.apache.org/hive/KEYS


A staged Maven repository URL is:*
https://repository.apache.org/content/repositories/orgapachehive-1127/

The git commit hash is:*
https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c


This corresponds to the tag: release-4.0.0-rc0
* https://github.com/apache/hive/tree/release-4.0.0-rc0

The vote is open for the next 72 hours and passes if a majority of at least
three +1 PMC votes are cast.

(Only PMC members have binding votes, however, other community members
are encouraged to cast non-binding votes.)


[ ] +1 Release this package as Apache Hive 4.0.0
[ ] +0
[ ] -1 Do not release this because...


Please download, verify, and test.


Regards,

Denys


[VOTE] Release Apache Hive 4.0.0 (Release Candidate 0)

2024-03-26 Thread Denys Kuzmenko
Hi Everyone,

We would like to thank everyone who has contributed to the project and request
the Hive PMC members to review and vote on this new release candidate.

Apache Hive 4.0.0 RC-0 artifacts are available here:*
https://people.apache.org/~dkuzmenko/apache-hive-4.0.0-rc0/


The checksums are as follows:
- 83eb88549ae88d3df6a86bb3e2526c7f4a0f21acafe21452c18071cee058c666
apache-hive-4.0.0-bin.tar.gz
- 4dbc9321d245e7fd26198e5d3dff95e5f7d0673d54d0727787d72956a1bca4f5
apache-hive-4.0.0-src.tar.gz


You can find the KEYS file here:

* https://downloads.apache.org/hive/KEYS


A staged Maven repository URL is:*
https://repository.apache.org/content/repositories/orgapachehive-1127/

The git commit hash is:*
https://github.com/apache/hive/commit/183f8cb41d3dbed961ffd27999876468ff06690c


This corresponds to the tag: release-4.0.0-rc0
* https://github.com/apache/hive/tree/release-4.0.0-rc0

The vote is open for the next 72 hours and passes if a majority of at least
three +1 PMC votes are cast.

(Only PMC members have binding votes, however, other community members
are encouraged to cast non-binding votes.)


[ ] +1 Release this package as Apache Hive 4.0.0
[ ] +0
[ ] -1 Do not release this because...


Please download, verify, and test.


Regards,

Denys


HIVE-28059: Iceberg REST Catalog

2024-03-22 Thread Henri Biestro (Apache)
Hi Everyone;

There were some discussions about the Iceberg Catalog REST API recently. On
that subject, there is now a PR (5145
) as a proposal for such a
service that can live embedded within HMS.
For users having Hive deployed, making this service hosted by the HMS
process seems like an easy way to expose the feature. This reduces the
burden of having another service to deploy and maintain at the reduced cost
of starting a Jetty within HMS. Furthermore, since this is embedded, it
does not require being a thrift-client of HMS which may further reduce the
runtime footprint.
The code also easily allows starting it as a separate service reusing the
original thrift-client based implementation code. The initial code-base for
the service and servlet are boroughed from the Iceberg test classes.

Hopefully, this can be useful.
Thoughts ?
Cheers
Henri


Re: Retire https://apache.github.io sites

2024-03-22 Thread Stamatis Zampetakis
The work on HIVE-27953 is now completed so the github.io sites are
officially down and the obsolete content is removed from the various
repos.

Many thanks Simhadri for leading all these efforts in modernising the
Hive website and dealing with the legacy sites.

Best,
Stamatis

On Wed, Mar 13, 2024 at 4:22 PM Simhadri G  wrote:
>
> Hi Everyone,
>
> The revamped hive website has been hosted at https://hive.apache.org/  for
> more than a year now.
>
> As a result , we would like to retire and disable old Apache Hive website
> hosted via github pages in the following sites:
>
>- https://apache.github.io/hive/
>- https://apache.github.io/hive-site/
>
> The work for the same is tracked in
> https://issues.apache.org/jira/browse/HIVE-27953 .
>
> Kindly let us know if there are any questions regarding this.
>
> Thanks!
> Simhadri G


Re: Release of Hive 4 and TPC-DS benchmark

2024-03-19 Thread Denys Kuzmenko
Hi Pravin,

TPC-DS tracking Jira: HIVE-27929.

The functional test run is completed, waiting for the TPC-DS execution. There 
were some glitches with the infra last week, expecting results in the next 2-3 
days. After that, we should be ready with RC. 

Regards,
Denys


Re: Release of Hive 4 and TPC-DS benchmark

2024-03-19 Thread Pravin sinha
Thanks for the update on this, Denys. Do we have any tracking jira for the
plan on performance test on the branch-4 build and is that the only
activity pending for releasing Hive-4.0.0?

Regards,
Pravin

On Fri, Mar 1, 2024 at 7:03 PM Denys Kuzmenko
 wrote:

> Hi All,
>
> Some updates on Hive-4.0 status:
>
> All known 4.0 release blockers were addressed and merged to the master.
> Thanks to everyone involved!!!
> We've raised a new PR to rebase branch-4.0. After that, we'll accept only
> bug fixes or some major improvements.
>
> Feel free to check and test branch-4.0 in a couple of days. We'll continue
> running number of functional & performance tests before the RC.
>
> Regards,
> Denys
>
> On Tue, Jan 30, 2024 at 6:40 AM Okumin  wrote:
>
> > Hi,
> >
> > We deployed a test version of Hive 4 in our production. It is mostly
> > working well. I appreciate the community's effort.
> >
> > Let me bump this thread so that community members can share the latest
> > situation, and we can contribute to the remaining problems.
> >
> > Currently, we list the following tickets labeled with hive-4.0.0-must[1].
> > - HIVE-27858: OOM happens when selecting many columns and JOIN
> > - HIVE-26654: Test with the TPC-DS benchmark
> > - HIVE-24167: No.14 (Postponed until 4.1.0)
> > - HIVE-26986: No.71 (No labels)
> >
> > We have already applied a workaround[2] for HIVE-24167. Also, Denys
> > says HIVE-26986 is not a blocker of Hive 4.0.0. So, I expect
> > HIVE-27858 to be the only blocker.
> >
> > I have some proposals about the next action.
> > - Can we take over HIVE-27858? We are the reporter of the ticket. It
> > would be reasonable If Naveen is not working on it yet
> > - We may review HIVE-27984[3]. As I mentioned in another thread[4], it
> > would have a fairly big impact on the Hive ecosystem
> >
> > And I would like someone to take a look at the following PR for
> > HIVE-24167. It is not a blocker thanks to
> > `hive.optimize.cte.materialize.threshold=-1`. However, we plan to use
> > Hive 4 with CTE materialization.
> > https://github.com/apache/hive/pull/5037
> >
> > Thanks!
> >
> > - [1]
> >
> https://issues.apache.org/jira/issues/?jql=labels%20%3D%20hive-4.0.0-must
> > - [2] https://github.com/apache/hive/pull/4858
> > - [3] https://github.com/apache/hive/pull/4984
> > - [4] https://www.mail-archive.com/dev@hive.apache.org/msg144280.html
> >
> > Regards,
> > Okumin
> >
> > On Thu, Nov 23, 2023 at 11:42 PM Butao Zhang 
> wrote:
> > >
> > > Cool! Thank you Denys for driving this!
> > >
> > >
> > > Thanks,
> > > Butao Zhang
> > >  Replied Message 
> > > | From | Attila Turoczy |
> > > | Date | 11/23/2023 22:29 |
> > > | To |  |
> > > | Subject | Re: Release of Hive 4 and TPC-DS benchmark |
> > > Excellent new Denys! Hive 4 is here! Can't wait :)
> > >
> > > -Attila
> > >
> > >
> > > On Thu, Nov 23, 2023 at 3:20 PM Denys Kuzmenko 
> > wrote:
> > >
> > > Update:
> > > 1. Query 2, 71: Resolved in HIVE-27006 [1];
> > >
> > > 2. Query 97: Under review in HIVE-27269 [2];
> > > Thanks, Seonggon for providing a reproduce qfile.
> > >
> > > 3. Query 14: Reported in HIVE-24167 [3];
> > > set hive.optimize.cte.materialize.threshold to -1 by default in Hive 4
> > and
> > > fix it in the next versions
> > >
> > > 4. HIVE-26986 [4] is a performance improvement that is nice to have,
> but
> > > not a blocker for the release.
> > >
> > > Be advised, next week we plan to cut 4.0.0 release branch from master
> and
> > > start testing.
> > >
> > > Thanks, Denys
> > >
> > > [1] https://issues.apache.org/jira/browse/HIVE-27006
> > > [2] https://issues.apache.org/jira/browse/HIVE-27269
> > > [3] https://issues.apache.org/jira/browse/HIVE-24167
> > > [4] https://issues.apache.org/jira/browse/HIVE-26986
> > >
> > >
> >
>


Retire https://apache.github.io sites

2024-03-13 Thread Simhadri G
Hi Everyone,

The revamped hive website has been hosted at https://hive.apache.org/  for
more than a year now.

As a result , we would like to retire and disable old Apache Hive website
hosted via github pages in the following sites:

   - https://apache.github.io/hive/
   - https://apache.github.io/hive-site/

The work for the same is tracked in
https://issues.apache.org/jira/browse/HIVE-27953 .

Kindly let us know if there are any questions regarding this.

Thanks!
Simhadri G


HIVE-25799: Add java rule #2866

2024-03-08 Thread Josh Soref
The bot told me to send an email about https://github.com/apache/hive/pull/2866


Re: Release of Hive 4 and TPC-DS benchmark

2024-03-01 Thread Denys Kuzmenko
Hi All,

Some updates on Hive-4.0 status:

All known 4.0 release blockers were addressed and merged to the master.
Thanks to everyone involved!!!
We've raised a new PR to rebase branch-4.0. After that, we'll accept only
bug fixes or some major improvements.

Feel free to check and test branch-4.0 in a couple of days. We'll continue
running number of functional & performance tests before the RC.

Regards,
Denys

On Tue, Jan 30, 2024 at 6:40 AM Okumin  wrote:

> Hi,
>
> We deployed a test version of Hive 4 in our production. It is mostly
> working well. I appreciate the community's effort.
>
> Let me bump this thread so that community members can share the latest
> situation, and we can contribute to the remaining problems.
>
> Currently, we list the following tickets labeled with hive-4.0.0-must[1].
> - HIVE-27858: OOM happens when selecting many columns and JOIN
> - HIVE-26654: Test with the TPC-DS benchmark
> - HIVE-24167: No.14 (Postponed until 4.1.0)
> - HIVE-26986: No.71 (No labels)
>
> We have already applied a workaround[2] for HIVE-24167. Also, Denys
> says HIVE-26986 is not a blocker of Hive 4.0.0. So, I expect
> HIVE-27858 to be the only blocker.
>
> I have some proposals about the next action.
> - Can we take over HIVE-27858? We are the reporter of the ticket. It
> would be reasonable If Naveen is not working on it yet
> - We may review HIVE-27984[3]. As I mentioned in another thread[4], it
> would have a fairly big impact on the Hive ecosystem
>
> And I would like someone to take a look at the following PR for
> HIVE-24167. It is not a blocker thanks to
> `hive.optimize.cte.materialize.threshold=-1`. However, we plan to use
> Hive 4 with CTE materialization.
> https://github.com/apache/hive/pull/5037
>
> Thanks!
>
> - [1]
> https://issues.apache.org/jira/issues/?jql=labels%20%3D%20hive-4.0.0-must
> - [2] https://github.com/apache/hive/pull/4858
> - [3] https://github.com/apache/hive/pull/4984
> - [4] https://www.mail-archive.com/dev@hive.apache.org/msg144280.html
>
> Regards,
> Okumin
>
> On Thu, Nov 23, 2023 at 11:42 PM Butao Zhang  wrote:
> >
> > Cool! Thank you Denys for driving this!
> >
> >
> > Thanks,
> > Butao Zhang
> >  Replied Message 
> > | From | Attila Turoczy |
> > | Date | 11/23/2023 22:29 |
> > | To |  |
> > | Subject | Re: Release of Hive 4 and TPC-DS benchmark |
> > Excellent new Denys! Hive 4 is here! Can't wait :)
> >
> > -Attila
> >
> >
> > On Thu, Nov 23, 2023 at 3:20 PM Denys Kuzmenko 
> wrote:
> >
> > Update:
> > 1. Query 2, 71: Resolved in HIVE-27006 [1];
> >
> > 2. Query 97: Under review in HIVE-27269 [2];
> > Thanks, Seonggon for providing a reproduce qfile.
> >
> > 3. Query 14: Reported in HIVE-24167 [3];
> > set hive.optimize.cte.materialize.threshold to -1 by default in Hive 4
> and
> > fix it in the next versions
> >
> > 4. HIVE-26986 [4] is a performance improvement that is nice to have, but
> > not a blocker for the release.
> >
> > Be advised, next week we plan to cut 4.0.0 release branch from master and
> > start testing.
> >
> > Thanks, Denys
> >
> > [1] https://issues.apache.org/jira/browse/HIVE-27006
> > [2] https://issues.apache.org/jira/browse/HIVE-27269
> > [3] https://issues.apache.org/jira/browse/HIVE-24167
> > [4] https://issues.apache.org/jira/browse/HIVE-26986
> >
> >
>


Re: Inquiry about Stable Release Timeline for Hive-Serde 4.X

2024-02-20 Thread Denys Kuzmenko
Hi Ravi,

ATM we have 3 items to resolve before the release [1]. 
1. HIVE-27924 will be merged in a couple of days;
2. HIVE-27775 is under review; 
3. HIVE-27858 is under investigation, however, we might exclude it from 4.0 
release;

In parallel, we are running TPC-DS benchmarks. 

Optimistically, we'll release 4.0 sometime next month.

Best,
Denys

[1] 
https://issues.apache.org/jira/issues/?jql=project%20%3D%20HIVE%20AND%20priority%20in%20(Critical%2C%20Blocker)%20AND%20type%20%3D%20Bug%20AND%20resolution%20%3D%20Unresolved%20AND%20(affectedVersion%20in%20(4.0.0-alpha-1%2C%204.0.0-alpha-2%2C%204.0.0-beta-1%2C%204.0.0)%20%20and%20not%20affectedVersion%20in%20(3.1.0%2C%203.1.1%2C%203.1.2%2C%203.1.3)%20or%20affectedVersion%20%3D%20EMPTY)%20and%20created%20%3E%3D%20-52w%20ORDER%20BY%20created%20DESC


Re: Inquiry about Stable Release Timeline for Hive-Serde 4.X

2024-02-20 Thread Mergu Ravi
Hi Hive Team,

I'm writing to follow up on the GA release for Hive Serde 4.x, which was
mentioned in an email sent on September 21st, 2023. The email stated that
the release will take a minimum of 3 months.

I understand that unforeseen circumstances can sometimes impact release
timelines. I'm simply writing to see if you could share any updates on the
current estimated release date or if there are any additional details you
can provide about the release plan.

Thank you for your time and consideration.


On Thu, Sep 21, 2023 at 5:54 PM Ayush Saxena  wrote:

> Hi,
>
> The GA release is in planning stage. We have some blockers, once we
> get them sorted, we will be pushing for a new release.
>
> At best it would take a minimum of 3 months, though that ain't a
> strict timeline...
>
> Thanx
>
> -Ayush
>
> On Thu, 21 Sept 2023 at 17:39, Mergu Ravi
>  wrote:
> >
> > I'm currently using the hive-serde and its dependent libraries in my
> > project. I'm interested in utilizing the feature introduced in version
> > 4.0.0-beta1, specifically, the feature where INT64 Parquet timestamp maps
> > to numeric types.
> >
> > In our project, we typically rely on stable versions of libraries. Do you
> > have any information on when this feature might be released in a stable
> 4.x
> > version?
> >
> >
> > --
> >
> > Thanks & Regards,
> >
> >
> > 
> > Ravi Mergu
> > SMTS-2
> > o:  +91 40 64535355
> > m: +91 9959618687
> > w: www.gaiansolutions.com
> >
> > 
> > 
> > 
> >
> > *Please consider the environment before printing this email.* This
> message
> > contains confidential information and is intended only for the individual
> > named. If you are not the named addressee you should not disseminate,
> > distribute or copy this e-mail
>


-- 

Thanks & Regards,



Ravi Mergu
SMTS-2
o:  +91 40 64535355
m: +91 9959618687
w: www.gaiansolutions.com





*Please consider the environment before printing this email.* This message
contains confidential information and is intended only for the individual
named. If you are not the named addressee you should not disseminate,
distribute or copy this e-mail


Re: "\n" in HiveConf

2024-02-20 Thread Stamatis Zampetakis
Hello,

Indeed they have an impact on the readability and maintenance of the
class so I would be in favor of dropping them.
Checking the calls to HiveConf.ConfVars#getDescription [1] it seems
that line breaks are somewhat relevant for generating the
hive-default.xml.template and SHOW CONF command but definitely not a
reason for keeping them. In fact, I get the impression that by
removing the line breaks we could also remove the respective
normalization code.

Best,
Stamatis

https://github.com/apache/hive/blob/5b76949da6fe65364a4e3766680871167131157f/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L5899

On Sun, Feb 11, 2024 at 9:10 AM László Bodor  wrote:
>
> Hey All!
>
> Maybe I'm missing some history here: does anyone know why and for what we
> use line break characters in the descriptions in HiveConf
> ?
> (1046 occurrences as we speak)
> As far as I can tell according to its current state, we *don't* generate
> this page from the class:
> https://cwiki.apache.org/confluence/display/hive/configuration+properties
>
> Motivation: the pain when I rephrase a config description and not only I
> have to break long lines (which is fine for code style) but I have to
> change (add/remove) line breaks too.
>
> Regards,
> Laszlo Bodor


  1   2   3   4   5   6   7   8   9   10   >