Re: [VOTE] Should we release Hive Storage API 2.7.2-rc0?

[Jesus Camacho Rodriguez]

> The release -1 votes aren't vetos. You just need more +1's than -1's.
Thanks, I had not checked the bylaws and remembered this incorrectly :(

-Jesús



On Tue, Apr 7, 2020 at 1:42 PM Owen O'Malley  wrote:

> Sorry Jesus for not getting back to you sooner. I started diving into
> ORC-577, but didn't finish.
>
> The release -1 votes aren't vetos. You just need more +1's than -1's.
> https://cwiki.apache.org/confluence/display/Hive/Bylaws#Bylaws-Voting
>
> That said, I'd ask for a different approach. Maybe we could pull the common
> fields out to a new class and make VectorizedRowBatch and the LLAP class
> inherit from it?
>
> This patch adds a bunch of stuff into storage-api that feels like it should
> be in LLAP instead of in storage-api.
>
> .. Owen
>
> On Tue, Apr 7, 2020 at 1:05 AM Jesus Camacho Rodriguez <
> jcama...@apache.org>
> wrote:
>
> > @Owen, will you be able to provide feedback on HIVE-22959 / ORC-577
> > shortly?
> > The -1 constitutes a veto to the release, but it has been a week since we
> > received that vote and we are still awaiting feedback.
> > Currently the storage-api release and rest of Panos contribution are on
> > hold because of this.
> >
> > -Jesús
> >
> >
> > On Mon, Apr 6, 2020 at 10:31 PM Ashutosh Chauhan 
> > wrote:
> >
> > > +1
> > > built and ran few tests locally.
> > >
> > > On Mon, Mar 30, 2020 at 2:21 PM Owen O'Malley 
> > > wrote:
> > >
> > > > In evaluating this RC, I discovered HIVE-22959, which is the only
> patch
> > > in
> > > > this RC.
> > > >
> > > > I'm uncomfortable with the API added by HIVE-22959, because it is
> > > > duplicating a lot of the functionality from VectorizedRowBatch. I'll
> > look
> > > > at the motivating ORC-577 tomorrow, but for now I'm -1 on releasing
> it.
> > > >
> > > > .. Owen
> > > >
> > > > On Mon, Mar 30, 2020 at 1:18 PM Vineet G 
> > wrote:
> > > >
> > > > > +1. Verified the signature, checksum and build.
> > > > >
> > > > > Vineet
> > > > >
> > > > > > On Mar 30, 2020, at 1:20 AM, Zoltan Haindrich 
> wrote:
> > > > > >
> > > > > > +1
> > > > > >
> > > > > > * verified checksum/etc
> > > > > > * built and run tests locally
> > > > > > * built orc/master against it
> > > > > > * there doesn't seem to be a staged nexus repo for this - but it
> > > seems
> > > > > like earlier releases also doesn't had that; meanwhile
> > > > >
> > > >
> > >
> >
> https://repo.maven.apache.org/maven2/org/apache/hive/hive-storage-api/2.7.1/
> > > > > seems to have them ; I assume it will be also uploaded there along
> > with
> > > > > sources/etc
> > > > > >
> > > > > >
> > > > > > On 3/24/20 9:33 PM, Jesus Camacho Rodriguez wrote:
> > > > > >> All,
> > > > > >> I'd like to make a storage-api release with HIVE-22959
> > > > > >>  in it.
> > > > > >> Should we release the following artifacts as Hive Storage API
> > 2.7.2?
> > > > > >> tar: http://home.apache.org/~jcamacho/hive-storage-2.7.2/
> > > > > >> tag:
> > > > >
> > https://github.com/apache/hive/releases/tag/storage-release-2.7.2-rc0
> > > > > >> jiras:
> > > https://issues.apache.org/jira/projects/HIVE/versions/12347828
> > > > > >> Thanks!
> > > > > >> -Jesús
> > > > >
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] Apache Hive 2.3.7 Release Candidate 0

[Hyukjin Kwon]

Thank you so much Alan for doing this.

2020년 4월 8일 (수) 오전 9:26, Alan Gates 님이 작성:

> Apache Hive 2.3.7 Release Candidate 0 is available here:
> https://people.apache.org/~gates/apache-hive-2.3.7-rc0/
>
> Maven artifacts are available here:
> https://repository.apache.org/content/repositories/orgapachehive-1100/
>
> The tag release-2.3.7-rc0 has been applied to the source for this
> release in github, you can see it
> athttps://github.com/apache/hive/tree/release-2.3.7-rc0
>
> Voting will conclude in 72 hours (or whenever I scrounge together enough
> votes).
>
> Hive PMC Members: Please test and vote.
>
> Thanks.
>
>
> Alan.
>

Re: [DISCUSS] I propose a Hive 2.3.7 release

[Hyukjin Kwon]

Thank you, Alan. +1!

2020년 4월 8일 (수) 오전 3:41, Alan Gates 님이 작성:

> I've seen no replies on this, so I'll assume people are ok with me going
> ahead with the release.
>
> Alan.
>
> On Tue, Mar 31, 2020 at 6:20 PM Alan Gates  wrote:
>
> > Hope everyone is well.
> >
> > There have been several requests on the Hive mailing list for a 2.3.7
> > release[1]  I've been working with Adrian Woodhead (aka Mass Dosage) on
> > testing the 2.3 branch.  We found two test failures there, which I've
> > posted a patch for at HIVE-23086 [2] (thanks Jésus for the review).
> >
> > If everyone is agreeable I'll commit the changes to HIVE-23086 and put up
> > a release candidate for Hive 2.3.7.
> >
> > Alan.
> >
> > 1.
> >
> https://lists.apache.org/thread.html/r1b5040489451e668275b94f2d2f67fca9050f83e94907674d19f864f%40%3Cdev.hive.apache.org%3E
> >  ,
> >
> >
> https://lists.apache.org/thread.html/8473e04420b70d90502e221e663b341c877224cbc617515e40e8e787%40%3Cdev.hive.apache.org%3E
> >
> > 2. https://issues.apache.org/jira/browse/HIVE-23086
> >
>

[VOTE] Apache Hive 2.3.7 Release Candidate 0

[Alan Gates]

Apache Hive 2.3.7 Release Candidate 0 is available here:
https://people.apache.org/~gates/apache-hive-2.3.7-rc0/

Maven artifacts are available here:
https://repository.apache.org/content/repositories/orgapachehive-1100/

The tag release-2.3.7-rc0 has been applied to the source for this
release in github, you can see it
athttps://github.com/apache/hive/tree/release-2.3.7-rc0

Voting will conclude in 72 hours (or whenever I scrounge together enough votes).

Hive PMC Members: Please test and vote.

Thanks.


Alan.

[jira] [Created] (HIVE-23153) deregister from zookeeper is not properly worked on kerberized environment

[Eugene Chung (Jira)]

Eugene Chung created HIVE-23153:
---

 Summary: deregister from zookeeper is not properly worked on 
kerberized environment
 Key: HIVE-23153
 URL: https://issues.apache.org/jira/browse/HIVE-23153
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Reporter: Eugene Chung
Assignee: Eugene Chung
 Attachments: Screen Shot 2020-04-08 at 5.00.40.png

Deregistering from Zookeeper, initiated by the command 'hive --service 
hiveserver2 -deregister ', is not properly worked when HiveServer2 
and Zookeeper are kerberized. Even though hive-site.xml has configuration for 
Zookeeper Kerberos login (hive.server2.authentication.kerberos.principal and 
keytab), it isn't used. I know that before executing the command, kinit with 
hiveserver2 keytab would work. But as I said, hive-site.xml already has.

 

 
{code:java}
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: 
-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-azure-datalake-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-hdfs-client-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-common-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-mapreduce-client-core-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.1.1.3.1.0.0-78.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.1.0.0-78/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.1.0.0-78/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.1.0.0-78/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.1.0.0-78/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.1.0.0-78/tez/conf
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:java.library.path=:
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:java.io.tmpdir=/tmp
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:java.compiler=
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:os.name=Linux
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:os.arch=amd64
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:os.version=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:user.name=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:user.home=...
2020-04-08 04:45:44,698 INFO [main] zookeeper.ZooKeeper: Client 
environment:user.dir=...
2020-04-08 04:45:44,699 INFO [main] zookeeper.ZooKeeper: Initiating client 
connection, connectString=... sessionTimeout=6 
watcher=org.apache.curator.ConnectionState@706eab5d
2020-04-08 04:45:44,725 INFO [main-SendThread(...)] zookeeper.ClientCnxn: 
Opening socket connection to server ...:2181. Will not attempt to authenticate 
using SASL (unknown error)
2020-04-08 04:45:44,731 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn: 
Socket connection established to ...:2181, initiating session
2020-04-08 04:45:44,743 INFO [main-SendThread(...:2181)] zookeeper.ClientCnxn: 
Session establishment complete on server ...:2181, sessionid = 
0x27148fd2ab1002e, negotiated timeout = 6
2020-04-08 04:45:44,751 INFO [main-EventThread] state.ConnectionStateManager: 
State change: CONNECTED
2020-04-08 04:45:44,760 WARN [main] server.HiveServer2: Will attempt to remove 
the znode: /hiveserver2/serverUri=...;version=3.1.2;sequence=49 from 
ZooKeeper
Will attempt to remove the znode: 
/hiveserver2/serverUri=...;version=3.1.2;sequence=49 from ZooKeeper
2020-04-08 04:45:44,768 INFO [Curator-Framework-0] imps.CuratorFrameworkImpl: 
backgroundOperationsLoop exiting
2020-04-08 04:45:44,771 INFO [main] zookeeper.ZooKeeper: Session: 
0x27148fd2ab1002e closed
2020-04-08 04:45:44,771 INFO [main-EventThread] zookeeper.ClientCnxn: 
EventThread shut down
2020-04-08 04:45:44,794 INFO [shutdown-hook-0] server.HiveServer2: SHUTDOWN_MSG:
/
SHUTDOWN_MSG: Shutting down HiveServer2 at ...
/{code}
 

Plus, the result code of CuratorEvent from DeleteCallback is not checked. In 
the case that kerberos login is not done, the code is -102 
([KeeperException.Code.NoAuth|[https://zookeeper.apache.org/doc/r3.4.6/api/org/apache/zookeeper/KeeperException.Code.html#NOAUTH]]).

!Screen Shot 2020-04-08 at 5.00.40.png|width=742,height=201!

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] Should we release Hive Storage API 2.7.2-rc0?

[Owen O'Malley]

Sorry Jesus for not getting back to you sooner. I started diving into
ORC-577, but didn't finish.

The release -1 votes aren't vetos. You just need more +1's than -1's.
https://cwiki.apache.org/confluence/display/Hive/Bylaws#Bylaws-Voting

That said, I'd ask for a different approach. Maybe we could pull the common
fields out to a new class and make VectorizedRowBatch and the LLAP class
inherit from it?

This patch adds a bunch of stuff into storage-api that feels like it should
be in LLAP instead of in storage-api.

.. Owen

On Tue, Apr 7, 2020 at 1:05 AM Jesus Camacho Rodriguez 
wrote:

> @Owen, will you be able to provide feedback on HIVE-22959 / ORC-577
> shortly?
> The -1 constitutes a veto to the release, but it has been a week since we
> received that vote and we are still awaiting feedback.
> Currently the storage-api release and rest of Panos contribution are on
> hold because of this.
>
> -Jesús
>
>
> On Mon, Apr 6, 2020 at 10:31 PM Ashutosh Chauhan 
> wrote:
>
> > +1
> > built and ran few tests locally.
> >
> > On Mon, Mar 30, 2020 at 2:21 PM Owen O'Malley 
> > wrote:
> >
> > > In evaluating this RC, I discovered HIVE-22959, which is the only patch
> > in
> > > this RC.
> > >
> > > I'm uncomfortable with the API added by HIVE-22959, because it is
> > > duplicating a lot of the functionality from VectorizedRowBatch. I'll
> look
> > > at the motivating ORC-577 tomorrow, but for now I'm -1 on releasing it.
> > >
> > > .. Owen
> > >
> > > On Mon, Mar 30, 2020 at 1:18 PM Vineet G 
> wrote:
> > >
> > > > +1. Verified the signature, checksum and build.
> > > >
> > > > Vineet
> > > >
> > > > > On Mar 30, 2020, at 1:20 AM, Zoltan Haindrich  wrote:
> > > > >
> > > > > +1
> > > > >
> > > > > * verified checksum/etc
> > > > > * built and run tests locally
> > > > > * built orc/master against it
> > > > > * there doesn't seem to be a staged nexus repo for this - but it
> > seems
> > > > like earlier releases also doesn't had that; meanwhile
> > > >
> > >
> >
> https://repo.maven.apache.org/maven2/org/apache/hive/hive-storage-api/2.7.1/
> > > > seems to have them ; I assume it will be also uploaded there along
> with
> > > > sources/etc
> > > > >
> > > > >
> > > > > On 3/24/20 9:33 PM, Jesus Camacho Rodriguez wrote:
> > > > >> All,
> > > > >> I'd like to make a storage-api release with HIVE-22959
> > > > >>  in it.
> > > > >> Should we release the following artifacts as Hive Storage API
> 2.7.2?
> > > > >> tar: http://home.apache.org/~jcamacho/hive-storage-2.7.2/
> > > > >> tag:
> > > >
> https://github.com/apache/hive/releases/tag/storage-release-2.7.2-rc0
> > > > >> jiras:
> > https://issues.apache.org/jira/projects/HIVE/versions/12347828
> > > > >> Thanks!
> > > > >> -Jesús
> > > >
> > > >
> > >
> >
>

[jira] [Created] (HIVE-23152) Support CachedStore with get_partitions_with_specs

[Vineet Garg (Jira)]

Vineet Garg created HIVE-23152:
--

 Summary: Support CachedStore with get_partitions_with_specs
 Key: HIVE-23152
 URL: https://issues.apache.org/jira/browse/HIVE-23152
 Project: Hive
  Issue Type: Sub-task
  Components: Metastore
Reporter: Vineet Garg






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: HIVE-21508 and Hive 2.3.7 question

[David Mollitor]

Cool.  Thanks for the consideration.

On Tue, Apr 7, 2020 at 2:41 PM Alan Gates  wrote:

> I agree with Adrian that HIVE-21469 is beyond the scope of 2.3.7 for now.
> If you want to backport it to the 2 branch I think it makes sense to put it
> there in anticipation of a 2.4 release.
>
> Alan.
>
> On Wed, Apr 1, 2020 at 4:40 AM Mass Dosage  wrote:
>
> > I think, given that we're so close to potentially cutting a 2.3.7 release
> > (see Alan's separate post to the mailing list) that we shouldn't add
> > anything else at this this stage. This could potentially be of interest
> for
> > a 2.3.8 or 2.4.0 release if the rest of the Hive community agrees.
> >
> > Thanks,
> >
> > Adrian
> >
> > On Tue, 31 Mar 2020 at 13:24, David Mollitor  wrote:
> >
> >> Hello Team,
> >>
> >> Just to throw one more thing in there, awhile ago I put a good chunk of
> >> time into shoring up the ZK Lock Manager because I worked with a lot of
> >> folks on locking issues. HDP/CLDR moved away from ZK and is using a
> RDBMS
> >> and therefore never paid it much mind. Any interest in rolling it into
> >> Hive
> >> 2?
> >>
> >> HIVE-21469
> >>
> >> On Tue, Mar 31, 2020, 5:20 AM Mass Dosage  wrote:
> >>
> >> > Hey all,
> >> >
> >> > We've made some progress on this and are getting closer to a 2.3.7
> >> release.
> >> > Alan has identified 2 tests failing on the 2.3 branch that are fixed
> in
> >> > newer versions of Hive so he is proposing to backport the fixes for
> >> them.
> >> > The ticket for that is
> https://issues.apache.org/jira/browse/HIVE-23086
> >> if
> >> > you want to watch it and vote it up. Hopefully we can get that merged
> >> soon
> >> > and then we'll be good to go.
> >> >
> >> > Thanks,
> >> >
> >> > Adrian
> >> >
> >> > On Sun, 8 Mar 2020 at 02:41, Hyukjin Kwon 
> wrote:
> >> >
> >> > > Thank you so much, Alan and all.
> >> > >
> >> > > 2020년 3월 8일 (일) 오전 10:36, Yuming Wang 님이 작성:
> >> > >
> >> > >> Great, thank you Alan and Adrian.
> >> > >>
> >> > >> On Sun, Mar 8, 2020 at 8:13 AM Alan Gates 
> >> wrote:
> >> > >>
> >> > >>> I'm working with Adrian on getting a 2.3.7 release out.  That will
> >> pick
> >> > >>> up everything that is already on the 2.3 branch.
> >> > >>>
> >> > >>> Alan.
> >> > >>>
> >> > >>> On Sat, Mar 7, 2020 at 6:02 AM Yuming Wang 
> >> wrote:
> >> > >>>
> >> >  Hi Alan and Owen,
> >> > 
> >> >  Is there any plans to release Hive 2.3.7 or Hive 2.4.0? It may be
> >> the
> >> >  only one that supports Java 11. Hive 3.x can not support it
> >> because of
> >> >  HIVE-22097 .
> >> > 
> >> >  On Tue, Feb 11, 2020 at 7:32 PM Mass Dosage <
> massdos...@gmail.com>
> >> >  wrote:
> >> > 
> >> > > +1.
> >> > >
> >> > > At Expedia Group  we are big users of Hive and are also
> >> experiencing
> >> > > issues with not being able to use Hive 2.3.x on Java >8 which is
> >> > starting
> >> > > to seriously impact some of our applications which require Java
> >> 11.
> >> > We
> >> > > worked on HIVE-21508 in order to get it merged into the various
> >> > branches
> >> > > and have been asking for a Hive 2.3.7 release for months with no
> >> > replies to
> >> > > our questions on this mailing list.
> >> > >
> >> > > Could someone from the Hive community please answer and let us
> >> know
> >> > if
> >> > > there is the possibility of a Hive 2.3.7 release? I've seen at
> >> least
> >> > two
> >> > > other requests for this on the list over the past few months.
> >> > >
> >> > > If not we will be forced to fork the current 2.3 branch and
> >> release
> >> > > our own version of Hive 2.3.7 to Maven Central (with a different
> >> > group id)
> >> > > so that we can use it (it sounds like this would be useful to
> >> others
> >> > out
> >> > > there too). We'd really rather not do this but I don't see any
> >> other
> >> > > solutions.
> >> > >
> >> > > Thanks,
> >> > >
> >> > > Adrian
> >> > > --
> >> > > Adrian Woodhead
> >> > > Principal Engineer
> >> > > Expedia Group - 407 St John Street, London, EC1V 4EX
> >> > >
> >> > >
> >> > > On Thu, 30 Jan 2020 at 07:34, Hyukjin Kwon  >
> >> > > wrote:
> >> > >
> >> > >> Hi Hive dev team,
> >> > >>
> >> > >> As informed earlier, I, Yuming and many people from spark dev
> >> have
> >> > >> made
> >> > >> huge efforts
> >> > >> to let Spark use official Hive release. Thanks Alan and all
> Hive
> >> dev
> >> > >> for
> >> > >> all the efforts for Hive 2.3.6 to make Spark support JDK 11.
> >> > >>
> >> > >> Few months ago, an unexpected problem was found. Spark throws
> >> > >> ClassCastException when
> >> > >> initializing HiveMetaStoreClient.
> >> > >> Please see SPARK-29245 <
> >> > >> https://issues.apache.org/jira/browse/SPARK-29245> for
> >> > >> more details. This has fixed by HIVE-21508
> >> > >> 

Re: HIVE-21508 and Hive 2.3.7 question

[Alan Gates]

I agree with Adrian that HIVE-21469 is beyond the scope of 2.3.7 for now.
If you want to backport it to the 2 branch I think it makes sense to put it
there in anticipation of a 2.4 release.

Alan.

On Wed, Apr 1, 2020 at 4:40 AM Mass Dosage  wrote:

> I think, given that we're so close to potentially cutting a 2.3.7 release
> (see Alan's separate post to the mailing list) that we shouldn't add
> anything else at this this stage. This could potentially be of interest for
> a 2.3.8 or 2.4.0 release if the rest of the Hive community agrees.
>
> Thanks,
>
> Adrian
>
> On Tue, 31 Mar 2020 at 13:24, David Mollitor  wrote:
>
>> Hello Team,
>>
>> Just to throw one more thing in there, awhile ago I put a good chunk of
>> time into shoring up the ZK Lock Manager because I worked with a lot of
>> folks on locking issues. HDP/CLDR moved away from ZK and is using a RDBMS
>> and therefore never paid it much mind. Any interest in rolling it into
>> Hive
>> 2?
>>
>> HIVE-21469
>>
>> On Tue, Mar 31, 2020, 5:20 AM Mass Dosage  wrote:
>>
>> > Hey all,
>> >
>> > We've made some progress on this and are getting closer to a 2.3.7
>> release.
>> > Alan has identified 2 tests failing on the 2.3 branch that are fixed in
>> > newer versions of Hive so he is proposing to backport the fixes for
>> them.
>> > The ticket for that is https://issues.apache.org/jira/browse/HIVE-23086
>> if
>> > you want to watch it and vote it up. Hopefully we can get that merged
>> soon
>> > and then we'll be good to go.
>> >
>> > Thanks,
>> >
>> > Adrian
>> >
>> > On Sun, 8 Mar 2020 at 02:41, Hyukjin Kwon  wrote:
>> >
>> > > Thank you so much, Alan and all.
>> > >
>> > > 2020년 3월 8일 (일) 오전 10:36, Yuming Wang 님이 작성:
>> > >
>> > >> Great, thank you Alan and Adrian.
>> > >>
>> > >> On Sun, Mar 8, 2020 at 8:13 AM Alan Gates 
>> wrote:
>> > >>
>> > >>> I'm working with Adrian on getting a 2.3.7 release out.  That will
>> pick
>> > >>> up everything that is already on the 2.3 branch.
>> > >>>
>> > >>> Alan.
>> > >>>
>> > >>> On Sat, Mar 7, 2020 at 6:02 AM Yuming Wang 
>> wrote:
>> > >>>
>> >  Hi Alan and Owen,
>> > 
>> >  Is there any plans to release Hive 2.3.7 or Hive 2.4.0? It may be
>> the
>> >  only one that supports Java 11. Hive 3.x can not support it
>> because of
>> >  HIVE-22097 .
>> > 
>> >  On Tue, Feb 11, 2020 at 7:32 PM Mass Dosage 
>> >  wrote:
>> > 
>> > > +1.
>> > >
>> > > At Expedia Group  we are big users of Hive and are also
>> experiencing
>> > > issues with not being able to use Hive 2.3.x on Java >8 which is
>> > starting
>> > > to seriously impact some of our applications which require Java
>> 11.
>> > We
>> > > worked on HIVE-21508 in order to get it merged into the various
>> > branches
>> > > and have been asking for a Hive 2.3.7 release for months with no
>> > replies to
>> > > our questions on this mailing list.
>> > >
>> > > Could someone from the Hive community please answer and let us
>> know
>> > if
>> > > there is the possibility of a Hive 2.3.7 release? I've seen at
>> least
>> > two
>> > > other requests for this on the list over the past few months.
>> > >
>> > > If not we will be forced to fork the current 2.3 branch and
>> release
>> > > our own version of Hive 2.3.7 to Maven Central (with a different
>> > group id)
>> > > so that we can use it (it sounds like this would be useful to
>> others
>> > out
>> > > there too). We'd really rather not do this but I don't see any
>> other
>> > > solutions.
>> > >
>> > > Thanks,
>> > >
>> > > Adrian
>> > > --
>> > > Adrian Woodhead
>> > > Principal Engineer
>> > > Expedia Group - 407 St John Street, London, EC1V 4EX
>> > >
>> > >
>> > > On Thu, 30 Jan 2020 at 07:34, Hyukjin Kwon 
>> > > wrote:
>> > >
>> > >> Hi Hive dev team,
>> > >>
>> > >> As informed earlier, I, Yuming and many people from spark dev
>> have
>> > >> made
>> > >> huge efforts
>> > >> to let Spark use official Hive release. Thanks Alan and all Hive
>> dev
>> > >> for
>> > >> all the efforts for Hive 2.3.6 to make Spark support JDK 11.
>> > >>
>> > >> Few months ago, an unexpected problem was found. Spark throws
>> > >> ClassCastException when
>> > >> initializing HiveMetaStoreClient.
>> > >> Please see SPARK-29245 <
>> > >> https://issues.apache.org/jira/browse/SPARK-29245> for
>> > >> more details. This has fixed by HIVE-21508
>> > >> .
>> > >> We postponed the Hive release request to Spark code freeze
>> schedule
>> > to
>> > >> avoid multiple requests.
>> > >>
>> > >> Spark is going to freeze code 31st January (tomorrow), and I
>> > currently
>> > >> foresee the RC starts around March. So, this will be hopefully
>> the
>> > >> last
>> > >> request for Hive release 

Re: [DISCUSS] I propose a Hive 2.3.7 release

[Alan Gates]

I've seen no replies on this, so I'll assume people are ok with me going
ahead with the release.

Alan.

On Tue, Mar 31, 2020 at 6:20 PM Alan Gates  wrote:

> Hope everyone is well.
>
> There have been several requests on the Hive mailing list for a 2.3.7
> release[1]  I've been working with Adrian Woodhead (aka Mass Dosage) on
> testing the 2.3 branch.  We found two test failures there, which I've
> posted a patch for at HIVE-23086 [2] (thanks Jésus for the review).
>
> If everyone is agreeable I'll commit the changes to HIVE-23086 and put up
> a release candidate for Hive 2.3.7.
>
> Alan.
>
> 1.
> https://lists.apache.org/thread.html/r1b5040489451e668275b94f2d2f67fca9050f83e94907674d19f864f%40%3Cdev.hive.apache.org%3E
>  ,
>
> https://lists.apache.org/thread.html/8473e04420b70d90502e221e663b341c877224cbc617515e40e8e787%40%3Cdev.hive.apache.org%3E
>
> 2. https://issues.apache.org/jira/browse/HIVE-23086
>

[jira] [Created] (HIVE-23151) LLAP: default hive.llap.file.cleanup.delay.seconds=0s

[Jira]

László Bodor created HIVE-23151:
---

 Summary: LLAP: default hive.llap.file.cleanup.delay.seconds=0s
 Key: HIVE-23151
 URL: https://issues.apache.org/jira/browse/HIVE-23151
 Project: Hive
  Issue Type: Bug
Reporter: László Bodor






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 72324: HIVE-22750: Consolidate LockType naming

[Denys Kuzmenko via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72324/#review220239
---



LGTM, some comments


hcatalog/streaming/src/java/org/apache/hive/hcatalog/streaming/HiveEndPoint.java
Line 1017 (original), 1017 (patched)


Insert & Select both acquire same type of the lock  - Shared. SharedRead 
for Insert sounds odd, isn't it? That's minor, just to consider.



standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/LockType.java
Lines 18 (patched)


Exclusive is more restrictive than EXCL_WRITE. We have lock comparator that 
relies on id.


- Denys Kuzmenko


On April 6, 2020, 1:58 p.m., Marton Bod wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72324/
> ---
> 
> (Updated April 6, 2020, 1:58 p.m.)
> 
> 
> Review request for hive, Denys Kuzmenko, Peter Vary, and Zoltan Chovan.
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-22750: Consolidate LockType naming
> 
> 
> Diffs
> -
> 
>   
> hcatalog/streaming/src/java/org/apache/hive/hcatalog/streaming/HiveEndPoint.java
>  e249b7775e 
>   
> hcatalog/streaming/src/java/org/apache/hive/hcatalog/streaming/mutate/client/lock/Lock.java
>  52eb6133e7 
>   metastore/scripts/upgrade/hive/hive-schema-4.0.0.hive.sql 03540bba4d 
>   metastore/scripts/upgrade/hive/upgrade-3.1.0-to-4.0.0.hive.sql fa518747de 
>   ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java 17e6cdf162 
>   ql/src/test/org/apache/hadoop/hive/metastore/txn/TestTxnHandler.java 
> 72f095d264 
>   ql/src/test/org/apache/hadoop/hive/ql/lockmgr/TestDbTxnManager2.java 
> 80fb1aff78 
>   
> standalone-metastore/metastore-common/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/LockType.java
>  8ae4351129 
>   
> standalone-metastore/metastore-common/src/gen/thrift/gen-php/metastore/Types.php
>  db4cfb996a 
>   
> standalone-metastore/metastore-common/src/gen/thrift/gen-py/hive_metastore/ttypes.py
>  cf3137928f 
>   
> standalone-metastore/metastore-common/src/gen/thrift/gen-rb/hive_metastore_types.rb
>  849970eb56 
>   
> standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/LockComponentBuilder.java
>  c739d4d196 
>   standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift 
> 098ddec5dc 
>   
> standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java
>  e8a988cca8 
>   
> standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/txn/TxnUtils.java
>  da38a6bbd3 
>   
> standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/utils/LockTypeUtil.java
>  PRE-CREATION 
>   
> standalone-metastore/metastore-server/src/test/java/org/apache/hadoop/hive/metastore/TestHiveMetaStoreTxns.java
>  1dfc105958 
>   
> standalone-metastore/metastore-server/src/test/java/org/apache/hadoop/hive/metastore/utils/LockTypeUtilTest.java
>  PRE-CREATION 
>   streaming/src/java/org/apache/hive/streaming/TransactionBatch.java 
> d44065018f 
> 
> 
> Diff: https://reviews.apache.org/r/72324/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Marton Bod
> 
>

Re: [VOTE] Should we release Hive Storage API 2.7.2-rc0?

[Jesus Camacho Rodriguez]

@Owen, will you be able to provide feedback on HIVE-22959 / ORC-577 shortly?
The -1 constitutes a veto to the release, but it has been a week since we
received that vote and we are still awaiting feedback.
Currently the storage-api release and rest of Panos contribution are on
hold because of this.

-Jesús


On Mon, Apr 6, 2020 at 10:31 PM Ashutosh Chauhan 
wrote:

> +1
> built and ran few tests locally.
>
> On Mon, Mar 30, 2020 at 2:21 PM Owen O'Malley 
> wrote:
>
> > In evaluating this RC, I discovered HIVE-22959, which is the only patch
> in
> > this RC.
> >
> > I'm uncomfortable with the API added by HIVE-22959, because it is
> > duplicating a lot of the functionality from VectorizedRowBatch. I'll look
> > at the motivating ORC-577 tomorrow, but for now I'm -1 on releasing it.
> >
> > .. Owen
> >
> > On Mon, Mar 30, 2020 at 1:18 PM Vineet G  wrote:
> >
> > > +1. Verified the signature, checksum and build.
> > >
> > > Vineet
> > >
> > > > On Mar 30, 2020, at 1:20 AM, Zoltan Haindrich  wrote:
> > > >
> > > > +1
> > > >
> > > > * verified checksum/etc
> > > > * built and run tests locally
> > > > * built orc/master against it
> > > > * there doesn't seem to be a staged nexus repo for this - but it
> seems
> > > like earlier releases also doesn't had that; meanwhile
> > >
> >
> https://repo.maven.apache.org/maven2/org/apache/hive/hive-storage-api/2.7.1/
> > > seems to have them ; I assume it will be also uploaded there along with
> > > sources/etc
> > > >
> > > >
> > > > On 3/24/20 9:33 PM, Jesus Camacho Rodriguez wrote:
> > > >> All,
> > > >> I'd like to make a storage-api release with HIVE-22959
> > > >>  in it.
> > > >> Should we release the following artifacts as Hive Storage API 2.7.2?
> > > >> tar: http://home.apache.org/~jcamacho/hive-storage-2.7.2/
> > > >> tag:
> > > https://github.com/apache/hive/releases/tag/storage-release-2.7.2-rc0
> > > >> jiras:
> https://issues.apache.org/jira/projects/HIVE/versions/12347828
> > > >> Thanks!
> > > >> -Jesús
> > >
> > >
> >
>