Re: Tez query failed with OutOfMemoryError: Java heap space

Hi Xin, Can you provide these: 1. Output of explain plan 2. Output of set –v (this will list the configs, so you might want to anonymize these) In addition to that, it looks like vertex vertex_1495595408051_21107_2_03 failed with OOM. Using Tez counters you can find out the amount of dat

Re: Jimmy Xiang now a Hive PMC member

Congrats Jimmy! ‹Vaibhav On 5/25/17, 10:48 AM, "Vineet Garg" wrote: >Congrats Jimmy! > >> On May 24, 2017, at 9:16 PM, Xuefu Zhang wrote: >> >> Hi all, >> >> It's an honer to announce that Apache Hive PMC has recently voted to >>invite Jimmy Xiang as a new Hive PMC member. Please join me in

CVE-2016-3083: Apache Hive SSL vulnerability bug disclosure

Severity: Important Vendor: The Apache Software Foundation Versions Affected: Apache Hive 0.13.x Apache Hive 0.14.x Apache Hive 1.0.0 - 1.0.1 Apache Hive 1.1.0 - 1.1.1 Apache Hive 1.2.0 - 1.2.1 Apache Hive 2.0.0 Description: Apache Hive (JDBC + HiveServer2) implements SSL for plain TCP and HTTP

[ANNOUNCE] Apache Hive 1.2.2 Released

The Apache Hive team is proud to announce the release of Apache Hive version 1.2.2. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides, among others: * Tools to enable easy

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

Congrats Rajesh! ‹Vaibhav On 12/15/16, 3:55 AM, "Peter Vary" wrote: >Congratulations Rajesh! > >> On Dec 15, 2016, at 6:40 AM, Rui Li wrote: >> >> Congratulations :) >> >> On Thu, Dec 15, 2016 at 6:50 AM, Gunther Hagleitner < >> ghagleit...@hortonworks.com> wrote: >> >>> Congrats Rajesh! >>

Re: [ANNOUNCE] New PMC Member : Jesus

Congrats Jesüs! --Vaibhav From: Vineet Garg Sent: Monday, July 18, 2016 6:51 PM To: d...@hive.apache.org; user@hive.apache.org Subject: Re: [ANNOUNCE] New PMC Member : Jesus Congrats Jesus ! On 7/18/16, 10:27 AM, "Jesus Camacho Rodriguez" wrote: >T

Re: [ANNOUNCE] New PMC Member : Pengcheng

Congrats Pengcheng! From: Prasanth Jayachandran Sent: Monday, July 18, 2016 10:21 AM To: user@hive.apache.org Cc: d...@hive.apache.org Subject: Re: [ANNOUNCE] New PMC Member : Pengcheng Congratulations Pengcheng! > On Jul 18, 2016, at 10:10 AM, Jimmy Xian

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats Ashutosh! -Vaibhav From: Prasanth Jayachandran mailto:pjayachand...@hortonworks.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Wednesday, September 16, 2015 at 12:50 PM To: "d...@hive.apache.org" mai

Re: Empty Table in MR with "union all" (created in Tez)

Might be related to: https://issues.apache.org/jira/browse/HIVE-10929 Thanks, -Vaibhav From: Gufran Mohammed Pathan mailto:gufran.path...@mu-sigma.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Wednesday, June 10, 2015 at 10:18 AM To: "us

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats Mithun. -Vaibhav From: venkatanathen kannan mailto:venkatanat...@yahoo.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>>, venkatanathen kannan mailto:venkatanat...@yahoo.com>> Date: Wednesday, April 15, 2015 at 11:40 AM To: "user@hive.ap

Re: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and Sergio Pena

Congrats to all. From: Sergey Shelukhin mailto:ser...@hortonworks.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Monday, March 23, 2015 at 12:52 PM To: "user@hive.apache.org" mailto:user@hive.apache.org>>, "d.

Re: Connecting to hiveserver via beeline is established but I never get beeline prompt

Looks like you are trying to connect to HiveServer v1. Beeline is the CLI client that is supported to work with HiveServer2. You can start HiveServer2 like this: hive --service hiveserver2 and then connect to it using beeline. Thanks, —Vaibhav From: Mich Talebzadeh mailto:m...@peridale.co.uk>>

Re: ERROR OutOfMemoryError: Java heap space

Hi, auth=nosasl should be only provided in JDBC url if "hive.server2.authentication” is explicitly set to NOSASL in your hive-site. Otherwise, the jdbc client tries to open a plain socket while the the server is expecting a sasl negotiation to happen. Due to an issue with thrift, this results

Re: GSS initiate failed exception

Looks like your Kerberos authentication failed. Did you renew the ticket? Typical expiry is 24 hours. From: , Chandra Reddy mailto:chandra.bog...@gs.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Wednesday, February 25, 2015 at 3:42 AM To

Re: [ANNOUNCE] New Hive PMC Member - Sergey Shelukhin

Congrats Sergey! On 2/25/15, 9:06 AM, "Vikram Dixit" wrote: >Congrats Sergey! > >On 2/25/15, 8:43 AM, "Carl Steinbach" wrote: > >>I am pleased to announce that Sergey Shelukhin has been elected to the >>Hive >>Project Management Committee. Please join me in congratulating Sergey! >> >>Thanks. >

Re: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui Li

Congratulations to all. ‹Vaibhav On 2/9/15, 2:06 PM, "Prasanth Jayachandran" wrote: >Congratulations! > >> On Feb 9, 2015, at 1:57 PM, Na Yang wrote: >> >> Congratulations! >> >> On Mon, Feb 9, 2015 at 1:06 PM, Vikram Dixit K >> wrote: >> >>> Congrats guys! >>> >>> On Mon, Feb 9, 2015 at

Re: Hiveserver2 memory / thread leak v 0.13.1 (hdp-2.1.5)

Alexander, Can you share the jmap histo (or even better, a heapdump)? What are the top consumers? What are the heap+permgen sizes that the JVM is configured to use? FYI, we fixed this memory leak in Hive-14: https://issues.apache.org/jira/browse/HIVE-7353. Thanks, -Vaibhav From: Alexander Pi

Re: HiveServer2 multiple instances

Arali, You can use this feature from Hive 14 onwards for your use case: https://issues.apache.org/jira/browse/HIVE-8376 Thanks, -Vaibhav From: arali tech mailto:aralitec...@gmail.com>> Reply-To: user mailto:user@hive.apache.org>> Date: Monday, December 15, 2014 at 1:35 AM To: user mailto:user@h

Re: tfetchresultsresp row returns zero

Hi George, This was done as part of https://issues.apache.org/jira/browse/HIVE-3746. The reason was that the previous serialization design (row major) was very inefficient and resulted in a lot of unnecessary network traffic. The current design (column major) addresses some of those issues. Th

Re: how to set dynamic service discovery for HiveServer2

Hi, You can follow the document posted on this jira: https://issues.apache.org/jira/browse/HIVE-8376 Basically, in your JDBC url, you will have to refer to the ZooKeeper ensemble instead of a particular HiveServer2 instance. The JDBC driver will select one HiveServer2 instance from ZooKeeper a

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

Congratulations e’one! —Vaibhav On Jan 28, 2015, at 1:20 PM, Xuefu Zhang mailto:xzh...@cloudera.com>> wrote: Congratulations to all! --Xuefu On Wed, Jan 28, 2015 at 1:15 PM, Carl Steinbach mailto:c...@apache.org>> wrote: I am pleased to announce that Szehon Ho, Vikram Dixit, Jason Dere, Owen

Re: Remote Beeline with kerberos issue.

Are you doing a kinit before launching beeline shell? Also what Hive version are you on? You need to do a kinit before you start using the beeline shell in a kerberized cluster setup. Kinit will essentially log the end user to Kerberos KDC, and set up the Kerberos TGT in the local system cache. T

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

Congratulations Alan! On Mon, Oct 27, 2014 at 3:54 PM, Chris Drome wrote: > Congratulations Alan! > > From: Carl Steinbach > Reply-To: "user@hive.apache.org" > Date: Monday, October 27, 2014 at 3:38 PM > To: "d...@hive.apache.org" , "user@hive.apache.org" < > user@hive.apache.org>, "ga...@a

Re: Java api for connecting to hiveserver2

Hanish, I agree with Suhas and would strongly encourage you to use the JDBC API for HiveServer2. HiveServer2 has a thrift api for the client-server RPC, but that is *not* intended for end user consumption and could end up breaking your current code in future. Is there any specific feature you are

Re: Getting access to hadoop output from Hive JDBC session

Alex, This is probably what you are looking for: Beeline should have an option for user to see the query progress ( https://issues.apache.org/jira/browse/HIVE-7615). Thanks, --Vaibhav On Mon, Aug 11, 2014 at 11:34 PM, Alexander Kolbasov wrote: > Hello, > > I am switching from Hive 0.9 to Hiv

Re: trouble starting hiveserver2

Hi Praveen, hive.server2.servermode is not a valid hive config. Please use hive.server2.transport.mode to specify which transport mode you'd like to use for sending thrift messages between the client and the server. Can you turn the debug logging on to see if you get any more info? Thanks, --Vaib

Re: Hiveserver2 crash with RStudio (using RJDBC)

Nathalie, Can you grab a heapdump at the time the server crashes (export this to your environment: HADOOP_CLIENT_OPTS="-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath= $HADOOP_CLIENT_OPTS".)? What type of metastore are you using with HiveServer2 - embedded (if you specify -hiveconf hive.metastore

Re: HiveServer2 Availability

Check this: https://issues.apache.org/jira/browse/HIVE-7935 This enables dynamic service discovery, but in future the plan is to use this feature to achieve HA. Thanks, --Vaibhav On Fri, Jul 25, 2014 at 7:32 PM, Edward Capriolo wrote: > I have put stAndard load balancers infront before and wro

Re: [ANNOUNCE] New Hive Committer - Eugene Koifman

Congrats Eugene! On Fri, Sep 12, 2014 at 3:35 PM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Eugene Koifman a committer on the > Apache Hive Project. > > Please join me in congratulating Eugene! > > Thanks. > > - Carl > > -- CONFIDENTIALITY NOTICE NOTICE: This message is int

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congrats Gopal and Szehon! --Vaibhav On Mon, Jun 23, 2014 at 8:48 AM, Szehon Ho wrote: > Thank you all very much, and congrats Gopal! > Szehon > > > On Sun, Jun 22, 2014 at 8:42 PM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted to make Gopal Vijayaraghavan and Szehon Ho > > commit

Re: Hive 0.13 Metastore => MySQL BoneCP issue

Soam, What version of BoneCP are you using? Thanks, --Vaibhav On Tue, Jun 10, 2014 at 12:41 PM, Soam Acharya wrote: > Hi folks, > > we're seeing an intermittent issue between our Hive 0.13 metastore and > mysql instance. After being idle for about 5 minutes or so, any > transactions involving

Re: [ANNOUNCE] New Hive Committers - Prasanth J and Vaibhav Gumashta

; >> >>>>> >> >>>>> On Fri, Apr 25, 2014 at 10:33 AM, Carl Steinbach < >> >>> cwsteinb...@gmail.com >> >>>>> wrote: >> >>>>> >> >>>>>> + Prasanth's correct ema

Re: [ANNOUNCE] New Hive Committers - Alan Gates, Daniel Dai, and Sushanth Sowmyan

Congratulations to all! Thanks, --Vaibhav On Mon, Apr 14, 2014 at 10:55 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Congratulations everyone!! > > Thanks > Prasanth Jayachandran > > On Apr 14, 2014, at 10:51 AM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted

Re: HiveServer2 http mode?

Adam, It is doing the latter for now - encapsulating thrift payloads inside http calls. Thanks, --Vaibhav On Thu, Apr 10, 2014 at 1:33 PM, Adam Faris wrote: > The "Setting Up HiveServer2" wiki page mentions that HiveServer2 is > providing a "http mode" in 0.13. Is "http mode" going to be a r

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote: >Congratulations Xuefu !! > > thanks > Prasad > > > > On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach wrote: > > > I am pleased to announce that Xuefu Zhang has been elected to the Hive > > Project Management Committee.

Re: Hive JDBC + Jetty

Hi Jone, What version of jetty are you using? It is possible that you have multiple versions in your classpath. Thanks, --Vaibhav On Fri, Feb 21, 2014 at 5:31 AM, Jone Lura wrote: > Hi, > > I have encountered a problem when I try to deploy my application on Jetty. > > In my Junit test environ

Re: [ANNOUNCE] New Hive Committers - Sergey Shelukhin and Jason Dere

Congrats Sergey and Jason! --Vaibhav On Mon, Jan 27, 2014 at 10:47 AM, Vikram Dixit wrote: > Congrats Sergey and Jason! > > Thanks > Vikram. > > On Jan 27, 2014, at 8:36 AM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted to make Sergey Shelukhin and Jason Dere > > committers on the A

Re: [ANNOUNCE] New Hive Committer - Vikram Dixit

Congrats Vikram!!! On Mon, Jan 6, 2014 at 11:24 AM, Jason Dere wrote: > Congrats Vikram! > > On Jan 6, 2014, at 11:10 AM, Prasanth Jayachandran < > pjayachand...@hortonworks.com> wrote: > > > Congratulations Vikram!! > > > > Thanks > > Prasanth Jayachandran > > > > On Jan 6, 2014, at 11:50 PM,

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

Congrats guys! On Fri, Nov 22, 2013 at 11:54 PM, Vikram Dixit wrote: > Congrats to both of you! > > > On Fri, Nov 22, 2013 at 9:34 AM, Jason Dere wrote: > > > Congrats! > > > > On Nov 22, 2013, at 2:25 AM, Biswajit Nayak > > wrote: > > > > > Congrats to both of you.. > > > > > > > > > On Fri,

Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

Awesome! Congrats Lefty! On Sun, Nov 17, 2013 at 12:06 AM, Thejas Nair wrote: > Congrats Lefty! > > > On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach wrote: > > The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC > > member on the Apache Hive Project. > > > > Please join me

Re: [ANNOUNCE] New Hive PMC Member - Harish Butani

Congrats Harish! --Vaibhav On Thu, Nov 14, 2013 at 5:18 PM, Clark Yang (杨卓荦) wrote: > Congrats, Harish! > > Cheers, > Zhuoluo (Clark) Yang > > > 2013/11/15 Carl Steinbach > > > I am pleased to announce that Harish Butani has been elected to the Hive > > Project Management Committee. Please joi

Re: [ANNOUNCE] New Hive Committer - Prasad Mujumdar

Congrats Prasad! On Sun, Nov 10, 2013 at 8:17 PM, Lefty Leverenz wrote: > Congratulations Prasad! > > -- Lefty > > > On Sun, Nov 10, 2013 at 11:04 PM, Brock Noland wrote: > > > Congratulations!! > > > > On Sunday, November 10, 2013, Thejas Nair wrote: > > > > > Congrats Prasad! > > > > > > On S

Re: exception when build Hive from source then start Hive CLI

Zhang, You can find instructions to build the tarball here: https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-Howtogeneratetarball%3F --Vaibhav On Wed, Nov 6, 2013 at 5:45 PM, 金杰 wrote: > You can go to this page > https://cwiki.apache.org/confluence/display/Hi

Re: Stopping hive metastore

Thanks for pointing it out Nitin. I've created a JIRA here: https://issues.apache.org/jira/browse/HIVE-5764 --Vaibhav On Wed, Nov 6, 2013 at 5:24 AM, Nitin Pawar wrote: > there is no other way as long as I know if you are using standalone hive > > > On Wed, Nov 6, 2013 at 5:11 PM, Garg, Rinku

Re: [ANNOUNCE] New Hive Committer - Xuefu Zhang

Congrats Xuefu! On Mon, Nov 4, 2013 at 9:17 AM, Prasad Mujumdar wrote: >Congratulations Xuefu! > > thanks > Prasad > > > > On Sun, Nov 3, 2013 at 8:06 PM, Carl Steinbach >wrote: > > > The Apache Hive PMC has voted to make Xuefu Zhang a committer on the > Apache > > Hive project. > > > > Ple

Re: [ANNOUNCE] New Hive PMC Members - Thejas Nair and Brock Noland

Congrats Brock and Thejas! On Thu, Oct 24, 2013 at 3:25 PM, Prasad Mujumdar wrote: > >Congratulations Thejas and Brock ! > > thanks > Prasad > > > > On Thu, Oct 24, 2013 at 3:10 PM, Carl Steinbach wrote: > >> I am pleased to announce that Thejas Nair and Brock Noland have been >> elected to

Re: ClassCastExceptions using Hiveserver2 Thrift interface, Hive 0.11

Hi Andy, Using Http over Thrift is currently a feature in development and has limited functionality. As of now, it does not support doAs and works with only NOSASL authentication mode set on the server side. There is a follow-up JIRA (https://issues.apache.org/jira/browse/HIVE-4764) which will add

Re: hive_service.thrift vs TCLIService.thrift

Hi Haroon, hive_service.thrift is the interface definition language (IDL) file for HiveServer (older one), whereas TCLIService.thrift is the IDL for HiveServer2. HiveServer2 was introduced in Hive-0.11. Check the docs here: https://cwiki.apache.org/confluence/display/Hive/Setting+up+HiveServer2

Re: how to make async call to hive

Hi Gary, HiveServer2 has recently added an API to support asynchronous execution: https://github.com/apache/hive/blob/trunk/service/if/TCLIService.thrift#L604 You will have to create an instance of Thrift HiveServer2 client and while creating the request object for ExecuteStatement, set runAsync

Re: [ANNOUNCE] New Hive Committer - Yin Huai

Congrats Yin! On Tue, Sep 3, 2013 at 11:37 PM, Jarek Jarcec Cecho wrote: > Congratulations Yin! > > Jarcec > > On Tue, Sep 03, 2013 at 09:49:55PM -0700, Carl Steinbach wrote: > > The Apache Hive PMC has voted to make Yin Huai a committer on the Apache > > Hive project. > > > > Please join me in