Re: HQL parser internals

2018-04-13 Thread Pengcheng Xiong
Hi Jay, Yes, Hive parser is stripping out the "as". As Gopal explained in the earlier thread, parser is used to translate a SQL string into an AST, i.e., an AST that the compiler can understand. That said, as long as the following compiler knows that "oh, this is a renaming", it is OK. In ano

[ANNOUNCE] Apache Hive 2.3.0 Released

2017-07-18 Thread Pengcheng Xiong
The Apache Hive team is proud to announce the release of Apache Hive version 2.3.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides, among others: * Tools to enable easy

Re: Welcome Rui Li to Hive PMC

2017-05-25 Thread Pengcheng Xiong
Congrats, Rui! Best Pengcheng On Wed, May 24, 2017 at 9:19 PM, Xuefu Zhang wrote: > Hi all, > > It's an honer to announce that Apache Hive PMC has recently voted to invite > Rui Li as a new Hive PMC member. Rui is a long time Hive contributor and > committer, and has made significant contributi

Re: Jimmy Xiang now a Hive PMC member

2017-05-25 Thread Pengcheng Xiong
Congrats Jimmy! Best Pengcheng On Wed, May 24, 2017 at 9:16 PM, Xuefu Zhang wrote: > Hi all, > > It's an honer to announce that Apache Hive PMC has recently voted to invite > Jimmy Xiang as a new Hive PMC member. Please join me in congratulating him > and looking forward to a bigger role that h

Re: Welcome new Hive committer, Zhihai Xu

2017-05-07 Thread Pengcheng Xiong
Congrats! On Fri, May 5, 2017 at 9:52 AM, Xuefu Zhang wrote: > Hi all, > > I'm very please to announce that Hive PMC has recently voted to offer > Zhihai a committership which he accepted. Please join me in congratulating > on this recognition and thanking him for his contributions to Hive. > >

About next 2.3 release

2017-03-25 Thread Pengcheng Xiong
Hello Hive users and developers, Owen is working on releasing 2.2 and I am working on releasing 2.3. If you have an issue that will block 2.3, please use priority "Blocker" and target version "2.3". Otherwise, please use version "3.0" as the target version. After you fix the issue and commit i

Re: Num Rows computed by EXPLAIN - Hive

2017-02-08 Thread Pengcheng Xiong
Did u run "analyze table emp compute statistics" before you run the explain? thanks. Pengcheng On Wed, Feb 8, 2017 at 9:29 PM, Vivek Sharma wrote: > Hi, > > > I am new to Hive (just few days of learning). > > > I am an Oracle Performance Expert and am comparing the Explain feature of > Hive wit

Re: [ANNOUNCE] New Hive Committer - Rajesh Balamohan

2016-12-13 Thread Pengcheng Xiong
Congrats Rajesh! :) On Tue, Dec 13, 2016 at 6:51 PM, Prasanth Jayachandran wrote: > The Apache Hive PMC has voted to make Rajesh Balamohan a committer on the > Apache Hive Project. Please join me in congratulating Rajesh. > > Congratulations Rajesh! > > Thanks > Prasanth

Re: [ANNOUNCE] New PMC Member : Jesus

2016-07-18 Thread Pengcheng Xiong
Jesus, thanks for the tremendous contributions to the project. Congrats for the well deserved PMC membership! :) On Mon, Jul 18, 2016 at 11:16 AM, Hari Sivarama Subramaniyan < hsubramani...@hortonworks.com> wrote: > Hi Jesus > Congrats for the well deserved achievement. > > Regards > Hari > _

Re: [ANNOUNCE] New PMC Member : Pengcheng

2016-07-18 Thread Pengcheng Xiong
>>>>> > >>>>> > >>>>> > >>>>> > >>>>> On 7/17/16, 16:01, "Xuefu Zhang" wrote: > >>>>> > >>>>>> Congrats, PengCheng! > >>>>>

Re: column statistics for non-primitive types

2016-06-14 Thread Pengcheng Xiong
ues > num_falses comment > > foo int > > > from deserializer > Time taken: 0.197 seconds, Fetched: 3 row(s) > > ^^^ the table creation works, but I don't get any column stats. > > > Best regards > Michael &

Re: column statistics for non-primitive types

2016-06-14 Thread Pengcheng Xiong
in.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 14 June 2016 at 21:25, Pengcheng Xiong wrote: > >> Exactly, "the useful or meaningful these statistics is going to be" (The >

Re: column statistics for non-primitive types

2016-06-14 Thread Pengcheng Xiong
Exactly, "the useful or meaningful these statistics is going to be" (The motivation behind). Best Pengcheng On Tue, Jun 14, 2016 at 1:21 PM, Mich Talebzadeh wrote: > > Hi, > > My point was we are where we are and in this juncture there is no > collection of statistics for complex columns. That

Re: column statistics for non-primitive types

2016-06-14 Thread Pengcheng Xiong
Hi Michael, (1) We collect columns stats for the following purpose (a) Query optimization, esp. join reordering and big/small table size estimation. More recently, we also use it to remove filters. You can refer to Calcite rules. (b) Answer query directly through metaStore. You can refer to th

Re: Could i use Hive SQL parser in our application?

2016-05-18 Thread Pengcheng Xiong
Hi Heng, Sure you can. Hive SQL parser is based on ANTLR and you can do that by taking that part out of Hive and integrate in to your application. Please let me know if you need any further help. Thanks. Best Pengcheng Xiong On Wed, May 18, 2016 at 3:43 AM, Heng Chen wrote: > Hi, g

Re: Disable Hive autogather optimization

2016-04-29 Thread Pengcheng Xiong
Hi Udit, Could u be more specific about your problem? Like, what settings you have, what query you run and what is the result and what result do you expect? From what you said, my understanding is that, you want to wipe out the basic stats for existing tables? And, could u also let us kno

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

2016-03-10 Thread Pengcheng Xiong
Big congrats Wei! Pengcheng On Thu, Mar 10, 2016 at 9:25 AM, Vijay K.N wrote: > Congrats Wei Zheng!! > On Mar 10, 2016 6:57 AM, "Vikram Dixit K" wrote: > >> The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache >> Hive Project. Please join me in congratulating Wei. >> >> Th

Re: [ANNOUNCE] New PMC Member : John Pullokkaran

2015-11-24 Thread Pengcheng Xiong
Congrats! John! On Wed, Nov 25, 2015 at 6:59 AM, Ashutosh Chauhan wrote: > On behalf of the Hive PMC I am delighted to announce John Pullokkaran is > joining Hive PMC. > John is a long time contributor in Hive and is focusing on compiler and > optimizer areas these days. > Please give John a war

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

2015-09-16 Thread Pengcheng Xiong
Congratulations Ashutosh! On Wed, Sep 16, 2015 at 1:17 PM, John Pullokkaran < jpullokka...@hortonworks.com> wrote: > Congrats Ashutosh! > > From: Vaibhav Gumashta > Reply-To: "user@hive.apache.org" > Date: Wednesday, September 16, 2015 at 1:01 PM > To: "user@hive.apache.org" , "d...@hive.apache

Re: Is YSmart integrated into Hive on tez ?

2015-08-31 Thread Pengcheng Xiong
!isTezExecEngine) { transformations.add(new CorrelationOptimizer()); } {code} Hope it helps. Best Pengcheng Xiong On Mon, Aug 31, 2015 at 12:56 AM, Jeff Zhang wrote: > The reason why I ask this question is that when I execute the following > sql, it will generated a query p

Re: Query doubt

2015-08-20 Thread Pengcheng Xiong
Hi Rakesh, If you would like to get all the names starting with r, you can use select * from emp where name like 'r%'; or select * from emp where name rlike '^r'; or select * from emp where name regexp '^r'; Thanks. Pengcheng On Thu, Aug 20, 2015 at 11:40 AM, rakesh sharma wrote: > Hi