Re: [EXTERNAL] Re: Any plan for new hive 3 or 4 release?
"My hope has been that Hive 4.x would be built on Java 11. However, I've hit many stumbling blocks over the past year towards this goal." There is not much value in holding back a release. Funny life story, I work at a bank and there are some people still on Java7 which wasend of life in 2015. I can't let the "lowest common denominator" be a blocker for everything. You want to support java 7, well you have to use a log4j from 7 years ago and a mockito from 8. You have to make weird interfaces and shims for everything you want to be newer. I made a costly mistake because the Java doc for something was backwards with the return type because I made the mistake of reading javadoc from 6 years ago. For something like Druid or hive on spark that is aging. Move it to contrib, give folks some time to fix it, if no one upkeeps it toss it. First, the number of people using Druid cant be that much. I see a lot of debates like this, hive-on-spark, druid whatever. Latest News - Spark 3.1.1 released <http://spark.apache.org/news/spark-3-1-1-released.html> (Mar 02, 2021) - Spark 3.0.2 released <http://spark.apache.org/news/spark-3-0-2-released.html> (Feb 19, 2021) - Next official release: Spark 3.1.1 <http://spark.apache.org/news/next-official-release-spark-3.1.1.html> (Jan 07, 2021) - Spark 2.4.7 released <http://spark.apache.org/news/spark-2-4-7-released.html> (Sep 12, 2020) News¶ <http://hive.apache.org/downloads.html#news>17 January 2021: release 2.3.8 available <http://hive.apache.org/downloads.html#17-january-2021-release-238-available> This release works with Hadoop 2.x.y You can look at the complete JIRA change log for this release <https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12349428=Text=12310843> . 18 April 2020: release 2.3.7 available <http://hive.apache.org/downloads.html#18-april-2020-release-237-available> This release works with Hadoop 2.x.y You can look at the complete JIRA change log for this release <https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346056=Text=12310843> . 26 August 2019: release 3.1.2 available <http://hive.apache.org/downloads.html#26-august-2019-release-312-available> This release works with Hadoop 3.x.y. You can look at the complete JIRA change log for this release <https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12344397=Html=12310843> . 23 August 2019: release 2.3.6 available <http://hive.apache.org/downloads.html#23-august-2019-release-236-available> This release works with Hadoop 2.x.y. You can look at the complete JIRA change log for this release <https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345603=Text=12310843> . 14 May 2019: release 2.3.5 available <http://hive.apache.org/downloads.html#14-may-2019-release-235-available> This release works with Hadoop 2.x.y. You can look at the complete JIRA change log for this release <https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12345394=Text=12310843> . 7 November 2018: release 2.3.4 available On Sat, Feb 27, 2021 at 10:02 PM David wrote: > Hello, > > My hope has been that Hive 4.x would be built on Java 11. However, I've > hit many stumbling blocks over the past year towards this goal. I've been > able to make some progress, but several things are still stuck. It mostly > stems from the fact that hive has many big-ticket dependencies like HDFS, > Kafka, Druid, HBase and those are in different degrees of Java 11 > readiness. I got close, but druid has some very outdated dependencies that > clash with Hive and I got into a game of updating a dependency broke one > project, downgrading it broke a different project. > > https://github.com/apache/druid/pull/10683 > > HDFS-15790 > > On Sat, Feb 27, 2021, 7:31 PM Matt McCline > wrote: > >> Yes to Hive 4 release. Plenty of changes (1,500+). >> Yes to regular release cadence (e.g. 3 month). >> >> -Original Message----- >> From: Edward Capriolo >> Sent: Saturday, February 27, 2021 12:16 PM >> To: Michel Sumbul >> Cc: d...@hive.apache.org; user@hive.apache.org >> Subject: [EXTERNAL] Re: Any plan for new hive 3 or 4 release? >> >> The challenge is the venders. They almost always want to tie a release to >> some offering of there's. >> >> Healthy software is released all the time. Just ship it. >> >> Call a vote and propose a release. I'll +1 it if the tests pass! >> >> >> On Friday, February 26, 2021, Michel Sumbul >> wrote: >> >> > It will be amazing if the community could produce a release every >> > quarter/6months. :-) >> > >> > Le ven. 26 févr. 2021 à 14:30, Edward Capriolo >> > a écrit : >> &
Re: [EXTERNAL] Re: Any plan for new hive 3 or 4 release?
Hello, My hope has been that Hive 4.x would be built on Java 11. However, I've hit many stumbling blocks over the past year towards this goal. I've been able to make some progress, but several things are still stuck. It mostly stems from the fact that hive has many big-ticket dependencies like HDFS, Kafka, Druid, HBase and those are in different degrees of Java 11 readiness. I got close, but druid has some very outdated dependencies that clash with Hive and I got into a game of updating a dependency broke one project, downgrading it broke a different project. https://github.com/apache/druid/pull/10683 HDFS-15790 On Sat, Feb 27, 2021, 7:31 PM Matt McCline wrote: > Yes to Hive 4 release. Plenty of changes (1,500+). > Yes to regular release cadence (e.g. 3 month). > > -Original Message- > From: Edward Capriolo > Sent: Saturday, February 27, 2021 12:16 PM > To: Michel Sumbul > Cc: d...@hive.apache.org; user@hive.apache.org > Subject: [EXTERNAL] Re: Any plan for new hive 3 or 4 release? > > The challenge is the venders. They almost always want to tie a release to > some offering of there's. > > Healthy software is released all the time. Just ship it. > > Call a vote and propose a release. I'll +1 it if the tests pass! > > > On Friday, February 26, 2021, Michel Sumbul > wrote: > > > It will be amazing if the community could produce a release every > > quarter/6months. :-) > > > > Le ven. 26 févr. 2021 à 14:30, Edward Capriolo > > a écrit : > > > >> Hive was releasable trunk for the longest time. Facebook days. Then > >> the big data vendors got more involved. Then it became a pissing > >> match about features. This vendor likes tez this vendor dont, this > >> vendor likes hive on spark this one dont. > >> > >> Then this vendor wants to tell everyone hive stinks use impala. Then > >> this vendor aquired that vendor.. > >> > >> The best thing for hive is to have one branch master and do quarterly > >> releases. > >> > >> > >> > >> On Friday, February 26, 2021, Peter Vary > >> wrote: > >> > >>> Hi Lee, > >>> > >>> When I started to work on Hive around 4 years ago, MR was already > >>> set as deprecated. So you definitely should scan even older archives. > >>> > >>> For Iceberg integration, it would be good to have more frequent > >>> releases for Hive as well. > >>> > >>> Thanks, Peter > >>> > >>> > >>> > >>> Lee Ming-Ta ezt írta (időpont: 2021. febr. > >>> 24., Sze > >>> 4:34): > >>> > >>> > Dear all, > >>> > > >>> > I probably didn't follow that much and would like to ask if anyone > >>> > can point me to some resources about the reason to remove MR? > >>> > Or what kine of keyword to search on Google? > >>> > > >>> > Thank you very much! Wish everyone a happy Lunar New Year. > >>> > > >>> > -- > >>> > *寄件者:* Mass Dosage > >>> > *寄件日期:* 2021年2月23日 下午 09:49 > >>> > *收件者:* d...@hive.apache.org > >>> > *副本:* Michel Sumbul ; user@hive.apache.org > >>> > < user@hive.apache.org> > >>> > *主旨:* Re: Any plan for new hive 3 or 4 release? > >>> > > >>> > I would love to see a HIve 3.1 release which is capable of being > >>> > used > >>> on > >>> > Java 11 like Hive 2 is. > >>> > > >>> > What is the main difference going to be between Hive 3 and 4? The > >>> removal > >>> > of MR? > >>> > > >>> > On Mon, 22 Feb 2021 at 16:46, Zoltan Haindrich wrote: > >>> > > >>> > Hey Michel! > >>> > > >>> > Yes it was a long time ago we had a release; we have quite a few > >>> > new features in master. > >>> > I think we are scaring people for some time now that we will be > >>> dropping > >>> > MR support...I think we should do that. > >>> > > >>> > I would really like to see a new Hive release in the near future > >>> > as > >>> well - > >>> > there is no way for users to even try out new features. > >>> > I was planning to add nightly builds to package the latest > >>> > master's > >>> state > >>> > into a deployable artifact - I think a service like may help > >>> > pretest > >>> our > >>> > next release; I think it > >>> > won't take much to do it so I'll probably throw it together in the > >>> > next couple days! > >>> > > >>> > cheers, > >>> > Zoltan > >>> > > >>> > On 2/21/21 2:27 PM, Michel Sumbul wrote: > >>> > > Hi Guys, > >>> > > > >>> > > If I'm not wrong, the last release of Hive 3.x is 18 months old. > >>> > > I wanted to ask if you had any roadmap / plan to release a new > >>> version of > >>> > > Hive 3.x or Hive 4? > >>> > > > >>> > > Thanks, > >>> > > Michel > >>> > > > >>> > > >>> > > >>> > >> > >> > >> -- > >> Sorry this was sent from mobile. Will do less grammar and spell check > >> than usual. > >> > > > > -- > Sorry this was sent from mobile. Will do less grammar and spell check than > usual. >
Re: Any plan for new hive 3 or 4 release?
The challenge is the venders. They almost always want to tie a release to some offering of there's. Healthy software is released all the time. Just ship it. Call a vote and propose a release. I'll +1 it if the tests pass! On Friday, February 26, 2021, Michel Sumbul wrote: > It will be amazing if the community could produce a release every > quarter/6months. :-) > > Le ven. 26 févr. 2021 à 14:30, Edward Capriolo a > écrit : > >> Hive was releasable trunk for the longest time. Facebook days. Then the >> big data vendors got more involved. Then it became a pissing match about >> features. This vendor likes tez this vendor dont, this vendor likes hive on >> spark this one dont. >> >> Then this vendor wants to tell everyone hive stinks use impala. Then this >> vendor aquired that vendor.. >> >> The best thing for hive is to have one branch master and do quarterly >> releases. >> >> >> >> On Friday, February 26, 2021, Peter Vary >> wrote: >> >>> Hi Lee, >>> >>> When I started to work on Hive around 4 years ago, MR was already set as >>> deprecated. So you definitely should scan even older archives. >>> >>> For Iceberg integration, it would be good to have more frequent releases >>> for Hive as well. >>> >>> Thanks, Peter >>> >>> >>> >>> Lee Ming-Ta ezt írta (időpont: 2021. febr. 24., >>> Sze >>> 4:34): >>> >>> > Dear all, >>> > >>> > I probably didn't follow that much and would like to ask if anyone can >>> > point me to some resources about the reason to remove MR? >>> > Or what kine of keyword to search on Google? >>> > >>> > Thank you very much! Wish everyone a happy Lunar New Year. >>> > >>> > -- >>> > *寄件者:* Mass Dosage >>> > *寄件日期:* 2021年2月23日 下午 09:49 >>> > *收件者:* d...@hive.apache.org >>> > *副本:* Michel Sumbul ; user@hive.apache.org < >>> > user@hive.apache.org> >>> > *主旨:* Re: Any plan for new hive 3 or 4 release? >>> > >>> > I would love to see a HIve 3.1 release which is capable of being used >>> on >>> > Java 11 like Hive 2 is. >>> > >>> > What is the main difference going to be between Hive 3 and 4? The >>> removal >>> > of MR? >>> > >>> > On Mon, 22 Feb 2021 at 16:46, Zoltan Haindrich wrote: >>> > >>> > Hey Michel! >>> > >>> > Yes it was a long time ago we had a release; we have quite a few new >>> > features in master. >>> > I think we are scaring people for some time now that we will be >>> dropping >>> > MR support...I think we should do that. >>> > >>> > I would really like to see a new Hive release in the near future as >>> well - >>> > there is no way for users to even try out new features. >>> > I was planning to add nightly builds to package the latest master's >>> state >>> > into a deployable artifact - I think a service like may help pretest >>> our >>> > next release; I think it >>> > won't take much to do it so I'll probably throw it together in the next >>> > couple days! >>> > >>> > cheers, >>> > Zoltan >>> > >>> > On 2/21/21 2:27 PM, Michel Sumbul wrote: >>> > > Hi Guys, >>> > > >>> > > If I'm not wrong, the last release of Hive 3.x is 18 months old. >>> > > I wanted to ask if you had any roadmap / plan to release a new >>> version of >>> > > Hive 3.x or Hive 4? >>> > > >>> > > Thanks, >>> > > Michel >>> > > >>> > >>> > >>> >> >> >> -- >> Sorry this was sent from mobile. Will do less grammar and spell check >> than usual. >> > -- Sorry this was sent from mobile. Will do less grammar and spell check than usual.
Re: Any plan for new hive 3 or 4 release?
It will be amazing if the community could produce a release every quarter/6months. :-) Le ven. 26 févr. 2021 à 14:30, Edward Capriolo a écrit : > Hive was releasable trunk for the longest time. Facebook days. Then the > big data vendors got more involved. Then it became a pissing match about > features. This vendor likes tez this vendor dont, this vendor likes hive on > spark this one dont. > > Then this vendor wants to tell everyone hive stinks use impala. Then this > vendor aquired that vendor.. > > The best thing for hive is to have one branch master and do quarterly > releases. > > > > On Friday, February 26, 2021, Peter Vary > wrote: > >> Hi Lee, >> >> When I started to work on Hive around 4 years ago, MR was already set as >> deprecated. So you definitely should scan even older archives. >> >> For Iceberg integration, it would be good to have more frequent releases >> for Hive as well. >> >> Thanks, Peter >> >> >> >> Lee Ming-Ta ezt írta (időpont: 2021. febr. 24., >> Sze >> 4:34): >> >> > Dear all, >> > >> > I probably didn't follow that much and would like to ask if anyone can >> > point me to some resources about the reason to remove MR? >> > Or what kine of keyword to search on Google? >> > >> > Thank you very much! Wish everyone a happy Lunar New Year. >> > >> > -------------- >> > *寄件者:* Mass Dosage >> > *寄件日期:* 2021年2月23日 下午 09:49 >> > *收件者:* d...@hive.apache.org >> > *副本:* Michel Sumbul ; user@hive.apache.org < >> > user@hive.apache.org> >> > *主旨:* Re: Any plan for new hive 3 or 4 release? >> > >> > I would love to see a HIve 3.1 release which is capable of being used on >> > Java 11 like Hive 2 is. >> > >> > What is the main difference going to be between Hive 3 and 4? The >> removal >> > of MR? >> > >> > On Mon, 22 Feb 2021 at 16:46, Zoltan Haindrich wrote: >> > >> > Hey Michel! >> > >> > Yes it was a long time ago we had a release; we have quite a few new >> > features in master. >> > I think we are scaring people for some time now that we will be dropping >> > MR support...I think we should do that. >> > >> > I would really like to see a new Hive release in the near future as >> well - >> > there is no way for users to even try out new features. >> > I was planning to add nightly builds to package the latest master's >> state >> > into a deployable artifact - I think a service like may help pretest our >> > next release; I think it >> > won't take much to do it so I'll probably throw it together in the next >> > couple days! >> > >> > cheers, >> > Zoltan >> > >> > On 2/21/21 2:27 PM, Michel Sumbul wrote: >> > > Hi Guys, >> > > >> > > If I'm not wrong, the last release of Hive 3.x is 18 months old. >> > > I wanted to ask if you had any roadmap / plan to release a new >> version of >> > > Hive 3.x or Hive 4? >> > > >> > > Thanks, >> > > Michel >> > > >> > >> > >> > > > -- > Sorry this was sent from mobile. Will do less grammar and spell check than > usual. >
Re: Any plan for new hive 3 or 4 release?
Hive was releasable trunk for the longest time. Facebook days. Then the big data vendors got more involved. Then it became a pissing match about features. This vendor likes tez this vendor dont, this vendor likes hive on spark this one dont. Then this vendor wants to tell everyone hive stinks use impala. Then this vendor aquired that vendor.. The best thing for hive is to have one branch master and do quarterly releases. On Friday, February 26, 2021, Peter Vary wrote: > Hi Lee, > > When I started to work on Hive around 4 years ago, MR was already set as > deprecated. So you definitely should scan even older archives. > > For Iceberg integration, it would be good to have more frequent releases > for Hive as well. > > Thanks, Peter > > > > Lee Ming-Ta ezt írta (időpont: 2021. febr. 24., Sze > 4:34): > > > Dear all, > > > > I probably didn't follow that much and would like to ask if anyone can > > point me to some resources about the reason to remove MR? > > Or what kine of keyword to search on Google? > > > > Thank you very much! Wish everyone a happy Lunar New Year. > > > > -- > > *寄件者:* Mass Dosage > > *寄件日期:* 2021年2月23日 下午 09:49 > > *收件者:* d...@hive.apache.org > > *副本:* Michel Sumbul ; user@hive.apache.org < > > user@hive.apache.org> > > *主旨:* Re: Any plan for new hive 3 or 4 release? > > > > I would love to see a HIve 3.1 release which is capable of being used on > > Java 11 like Hive 2 is. > > > > What is the main difference going to be between Hive 3 and 4? The removal > > of MR? > > > > On Mon, 22 Feb 2021 at 16:46, Zoltan Haindrich wrote: > > > > Hey Michel! > > > > Yes it was a long time ago we had a release; we have quite a few new > > features in master. > > I think we are scaring people for some time now that we will be dropping > > MR support...I think we should do that. > > > > I would really like to see a new Hive release in the near future as well > - > > there is no way for users to even try out new features. > > I was planning to add nightly builds to package the latest master's state > > into a deployable artifact - I think a service like may help pretest our > > next release; I think it > > won't take much to do it so I'll probably throw it together in the next > > couple days! > > > > cheers, > > Zoltan > > > > On 2/21/21 2:27 PM, Michel Sumbul wrote: > > > Hi Guys, > > > > > > If I'm not wrong, the last release of Hive 3.x is 18 months old. > > > I wanted to ask if you had any roadmap / plan to release a new version > of > > > Hive 3.x or Hive 4? > > > > > > Thanks, > > > Michel > > > > > > > > -- Sorry this was sent from mobile. Will do less grammar and spell check than usual.
Re: Any plan for new hive 3 or 4 release?
I would frankly feel relieved if hive v3 or v4 have none of the developers that developed and maintained v2. Several wasted hours of my life lead me to this conclusion. That’s all Hernán Sent from Yahoo Mail for iPad On Monday, February 22, 2021, 8:46 AM, Zoltan Haindrich wrote: Hey Michel! Yes it was a long time ago we had a release; we have quite a few new features in master. I think we are scaring people for some time now that we will be dropping MR support...I think we should do that. I would really like to see a new Hive release in the near future as well - there is no way for users to even try out new features. I was planning to add nightly builds to package the latest master's state into a deployable artifact - I think a service like may help pretest our next release; I think it won't take much to do it so I'll probably throw it together in the next couple days! cheers, Zoltan On 2/21/21 2:27 PM, Michel Sumbul wrote: > Hi Guys, > > If I'm not wrong, the last release of Hive 3.x is 18 months old. > I wanted to ask if you had any roadmap / plan to release a new version of > Hive 3.x or Hive 4? > > Thanks, > Michel >
Re: Any plan for new hive 3 or 4 release?
Hi Lee, When I started to work on Hive around 4 years ago, MR was already set as deprecated. So you definitely should scan even older archives. For Iceberg integration, it would be good to have more frequent releases for Hive as well. Thanks, Peter Lee Ming-Ta ezt írta (időpont: 2021. febr. 24., Sze 4:34): > Dear all, > > I probably didn't follow that much and would like to ask if anyone can > point me to some resources about the reason to remove MR? > Or what kine of keyword to search on Google? > > Thank you very much! Wish everyone a happy Lunar New Year. > > -- > *寄件者:* Mass Dosage > *寄件日期:* 2021年2月23日 下午 09:49 > *收件者:* d...@hive.apache.org > *副本:* Michel Sumbul ; user@hive.apache.org < > user@hive.apache.org> > *主旨:* Re: Any plan for new hive 3 or 4 release? > > I would love to see a HIve 3.1 release which is capable of being used on > Java 11 like Hive 2 is. > > What is the main difference going to be between Hive 3 and 4? The removal > of MR? > > On Mon, 22 Feb 2021 at 16:46, Zoltan Haindrich wrote: > > Hey Michel! > > Yes it was a long time ago we had a release; we have quite a few new > features in master. > I think we are scaring people for some time now that we will be dropping > MR support...I think we should do that. > > I would really like to see a new Hive release in the near future as well - > there is no way for users to even try out new features. > I was planning to add nightly builds to package the latest master's state > into a deployable artifact - I think a service like may help pretest our > next release; I think it > won't take much to do it so I'll probably throw it together in the next > couple days! > > cheers, > Zoltan > > On 2/21/21 2:27 PM, Michel Sumbul wrote: > > Hi Guys, > > > > If I'm not wrong, the last release of Hive 3.x is 18 months old. > > I wanted to ask if you had any roadmap / plan to release a new version of > > Hive 3.x or Hive 4? > > > > Thanks, > > Michel > > > >
Re: Any plan for new hive 3 or 4 release?
I would love to see a HIve 3.1 release which is capable of being used on Java 11 like Hive 2 is. What is the main difference going to be between Hive 3 and 4? The removal of MR? On Mon, 22 Feb 2021 at 16:46, Zoltan Haindrich wrote: > Hey Michel! > > Yes it was a long time ago we had a release; we have quite a few new > features in master. > I think we are scaring people for some time now that we will be dropping > MR support...I think we should do that. > > I would really like to see a new Hive release in the near future as well - > there is no way for users to even try out new features. > I was planning to add nightly builds to package the latest master's state > into a deployable artifact - I think a service like may help pretest our > next release; I think it > won't take much to do it so I'll probably throw it together in the next > couple days! > > cheers, > Zoltan > > On 2/21/21 2:27 PM, Michel Sumbul wrote: > > Hi Guys, > > > > If I'm not wrong, the last release of Hive 3.x is 18 months old. > > I wanted to ask if you had any roadmap / plan to release a new version of > > Hive 3.x or Hive 4? > > > > Thanks, > > Michel > > >
Re: Any plan for new hive 3 or 4 release?
Hey Michel! Yes it was a long time ago we had a release; we have quite a few new features in master. I think we are scaring people for some time now that we will be dropping MR support...I think we should do that. I would really like to see a new Hive release in the near future as well - there is no way for users to even try out new features. I was planning to add nightly builds to package the latest master's state into a deployable artifact - I think a service like may help pretest our next release; I think it won't take much to do it so I'll probably throw it together in the next couple days! cheers, Zoltan On 2/21/21 2:27 PM, Michel Sumbul wrote: Hi Guys, If I'm not wrong, the last release of Hive 3.x is 18 months old. I wanted to ask if you had any roadmap / plan to release a new version of Hive 3.x or Hive 4? Thanks, Michel
