hive 0.11 on MRv1 Vs. YARN

2013-08-20 Thread Austin Chungath
Hi, Is hive 0.11 faster on YARN? What am I missing out if I am using hive 0.11 on MRv1 ? Thanks a lot :) - Austin

[ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Carl Steinbach
The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas!

Re: No java compiler available exception for HWI

2013-08-20 Thread Bing Li
Hi, Eric et al Did you resolve this failure? I'm using Hive-0.11.0, and get the same error when access to HWI via browser. I already set the following properties in hive-site.xml - hive.hwi.listen.host - hive.hwi.listen.port - hive.hwi.war.file And copied two jasper jars into hive/lib: -

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Navis류승우
Congratulations! 2013/8/20 Clark Yang (杨卓荦) yangzhuo...@gmail.com: Congrats Thejas! 在 2013年8月20日星期二,Carl Steinbach 写道: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas!

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Hamza Asad
Congrats Thejas. Where's the Party tonight !! :P On Tue, Aug 20, 2013 at 5:43 PM, Navis류승우 navis@nexr.com wrote: Congratulations! 2013/8/20 Clark Yang (杨卓荦) yangzhuo...@gmail.com: Congrats Thejas! 在 2013年8月20日星期二,Carl Steinbach 写道: The Apache Hive PMC has voted to make Thejas

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Brock Noland
Congratulations Thejas! On Tue, Aug 20, 2013 at 9:06 AM, Xuefu Zhang xzh...@cloudera.com wrote: Congratulations, Thejas! On Tue, Aug 20, 2013 at 5:43 AM, Navis류승우 navis@nexr.com wrote: Congratulations! 2013/8/20 Clark Yang (杨卓荦) yangzhuo...@gmail.com: Congrats Thejas! 在

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Jarek Jarcec Cecho
Congratulations Thejas! Jarcec On Tue, Aug 20, 2013 at 03:31:48AM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas! signature.asc Description: Digital signature

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Bill Graham
Congrats Thejas! On Tue, Aug 20, 2013 at 7:32 AM, Jarek Jarcec Cecho jar...@apache.orgwrote: Congratulations Thejas! Jarcec On Tue, Aug 20, 2013 at 03:31:48AM -0700, Carl Steinbach wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project.

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Thiruvel Thirumoolan
Congrats Thejas! On Aug 20, 2013, at 8:00 AM, Bill Graham billgra...@gmail.commailto:billgra...@gmail.com wrote: Congrats Thejas! On Tue, Aug 20, 2013 at 7:32 AM, Jarek Jarcec Cecho jar...@apache.orgmailto:jar...@apache.org wrote: Congratulations Thejas! Jarcec On Tue, Aug 20, 2013 at

Re: hive 0.11 on MRv1 Vs. YARN

2013-08-20 Thread Alan Gates
Hive 0.11 does run faster on YARN than MR1, but that's due solely to YARN being faster than MR1. Hive 0.11 doesn't take any advantage of YARN. Lots of work is going on to change that so that future versions of Hive will take advantage of YARN (see all the work in the Tez branch for example).

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Eugene Koifman
Congrats Thejas! On Tue, Aug 20, 2013 at 3:31 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas! -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Shreepadma Venugopalan
Congrats Tejas! On Tue, Aug 20, 2013 at 9:32 AM, Eugene Koifman ekoif...@hortonworks.comwrote: Congrats Thejas! On Tue, Aug 20, 2013 at 3:31 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Prasanth Jayachandran
Congrats Thejas!! On Aug 20, 2013, at 10:01 AM, Daniel Dai da...@hortonworks.com wrote: Congratulation! On Tue, Aug 20, 2013 at 4:56 PM, Shreepadma Venugopalan shreepa...@cloudera.com wrote: Congrats Tejas! On Tue, Aug 20, 2013 at 9:32 AM, Eugene Koifman ekoif...@hortonworks.com

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Daniel Dai
Congratulation! On Tue, Aug 20, 2013 at 4:56 PM, Shreepadma Venugopalan shreepa...@cloudera.com wrote: Congrats Tejas! On Tue, Aug 20, 2013 at 9:32 AM, Eugene Koifman ekoif...@hortonworks.com wrote: Congrats Thejas! On Tue, Aug 20, 2013 at 3:31 AM, Carl Steinbach c...@apache.org

Re: hive 0.11 on MRv1 Vs. YARN

2013-08-20 Thread Edward Capriolo
That is such a loaded question. Technically most of the hive API is written against hadoop 0.20.2. For example, hive does not use org.apache.hadoop.mapreduce classes it uses org.apache.hadoop.mapred classes. But the job launching and other optimizations in yarn could mean something, but mostly it

Re: DataNucleus patches for Hive

2013-08-20 Thread Eric Chu
Xuefu, Indeed that's the problem and ant very-clean also fixed the problem. Thanks, Eric On Tue, Aug 6, 2013 at 5:10 PM, Xuefu Zhang xzh...@cloudera.com wrote: You probably have mix-matched datanucleus libraries in your lib/ folder. You should only three 3.2.x files if you do ls datanu*. To

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Chris Drome
Congratulations Thejas! chris On 8/20/13 3:31 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas!

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Prasad Mujumdar
Congrats Thejas! thanks Prasad On Tue, Aug 20, 2013 at 3:31 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas!

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Thejas Nair
Thanks everybody! This is a great honor. I hope to live up to the expectations! It is great to see the fresh momentum in hive and I am glad to be able to work with the community on it. Now I will also do my best to help get the count for jiras in patch-available state down! On Tue, Aug 20,

single output file per partition?

2013-08-20 Thread Igor Tatarinov
What's the best way to enforce a single output file per partition? INSERT OVERWRITE TABLE table PARTITION (x,y,z) SELECT ... FROM ... WHERE ... It tried adding CLUSTER BY x,y,z at the end thinking that sorting will force a single reducer per partition but that didn't work. I still got multiple

Last time request for cwiki update privileges

2013-08-20 Thread Sanjay Subramanian
Hey guys I can only think of two reasons for my request is not yet accepted 1. The admins don't want to give me access 2. The admins have not seen my mail yet. This is the fourth and the LAST time I am requesting permission to edit wiki docs…Nobody likes being ignored and that includes me.

Re: Last time request for cwiki update privileges

2013-08-20 Thread Ashutosh Chauhan
Hi Sanjay, Really sorry for that. I apologize for the delay. You are added now. Feel free to make changes to make Hive even better! Thanks, Ashutosh On Tue, Aug 20, 2013 at 2:39 PM, Sanjay Subramanian sanjay.subraman...@wizecommerce.com wrote: Hey guys I can only think of two reasons

Re: Last time request for cwiki update privileges

2013-08-20 Thread Sanjay Subramanian
Thanks Ashutosh From: Ashutosh Chauhan hashut...@apache.orgmailto:hashut...@apache.org Reply-To: user@hive.apache.orgmailto:user@hive.apache.org user@hive.apache.orgmailto:user@hive.apache.org Date: Tuesday, August 20, 2013 3:13 PM To: user@hive.apache.orgmailto:user@hive.apache.org

Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Stephen Boesch
Views should theoretically not incur performance penalties: they simply represent queries. Are there situtions that things are not that simple - i.e. views may actually result in different exeucution plans than the underlying sql? Additionally, are there views-related bugs that we should be aware

Re: Bug when adding multiple partitions

2013-08-20 Thread Edward Capriolo
Navis, you are an antlr superhero. Impressive as always. On Tuesday, August 20, 2013, Navis류승우 navis@nexr.com wrote: https://issues.apache.org/jira/browse/HIVE-5122 2013/8/20 Navis류승우 navis@nexr.com: Looks like a bug. I'll fix that. 2013/8/15 Jan Dolinár dolik@gmail.com: Hi

inconsistent from_utc_timestamp result

2013-08-20 Thread Tongjie Chen
I am using hive 0.11 //using local mode hive select from_utc_timestamp(2011-12-25 09:00:00.123456, CET) from ts1; 2011-12-25 10:00:00.123456 (OK, utc +1h) hive select from_utc_timestamp(2013-08-17 02:15:41.123456, CET) from ts1; 2013-08-17 04:15:41.123456 (not OK, utc +2h) Do I miss anything

Re: Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Ricky Saltzer
Although this is already fixed in the next and upcoming impala release, you might want to be aware of the following view limitation. https://issues.cloudera.org/browse/IMPALA-495 On Aug 20, 2013 7:16 PM, Stephen Boesch java...@gmail.com wrote: Views should theoretically not incur performance

Re: Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Stephen Boesch
Thanks v much Ricky. Is this fixed in hive 0.11 - or going to be later i.e. 0.12? 2013/8/20 Ricky Saltzer ri...@cloudera.com Although this is already fixed in the next and upcoming impala release, you might want to be aware of the following view limitation.

Re: Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Ricky Saltzer
Since this bug was in Impala's query planner, I'm sure Hive is unaffected. On Aug 20, 2013 10:15 PM, Stephen Boesch java...@gmail.com wrote: Thanks v much Ricky. Is this fixed in hive 0.11 - or going to be later i.e. 0.12? 2013/8/20 Ricky Saltzer ri...@cloudera.com Although this is

Re: Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Edward Capriolo
Views are logical . The view is compiled and has no penalty over the standard query. On Tuesday, August 20, 2013, Ricky Saltzer ri...@cloudera.com wrote: Since this bug was in Impala's query planner, I'm sure Hive is unaffected. On Aug 20, 2013 10:15 PM, Stephen Boesch java...@gmail.com wrote:

Re: Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Ricky Saltzer
My apologies, being on both a Hive and Impala mailing list can be confusing ;). On Tue, Aug 20, 2013 at 10:40 PM, Edward Capriolo edlinuxg...@gmail.comwrote: Views are logical . The view is compiled and has no penalty over the standard query. On Tuesday, August 20, 2013, Ricky Saltzer

Re: Any Scenarios in which Views impose performance penalties

2013-08-20 Thread Stephen Boesch
Thanks for the inputs Edward and Ricky. I did look at the relevant source code on the version we are using 0.9 and it does not appear there would be any impact of views on the underlying sql - it does column aliasing and checks that the query partition columns match partition columns of the

First/last in npath

2013-08-20 Thread Justin Workman
When is it expect to support lead/lag/first_value/last_value in the npath result statement? Thanks Sent from my iPhone