[jira] [Created] (HIVE-11862) Double ctrl+c doesn't kill tez session

[Jeff Zhang (JIRA)]

Jeff Zhang created HIVE-11862:
-

 Summary: Double ctrl+c doesn't kill tez session
 Key: HIVE-11862
 URL: https://issues.apache.org/jira/browse/HIVE-11862
 Project: Hive
  Issue Type: Improvement
Reporter: Jeff Zhang


In cli, double ctrl+c will kill the dag and exit the cli. But the tez session 
is not stopped. Tez app AM will still alive there until it is timeout, this 
make the resource wasteful (one container for AM and may other containers for 
task when container reuse is enabled. )



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11861) Metadataonly and NullScan optimizer should not launch a job

[Prasanth Jayachandran (JIRA)]

Prasanth Jayachandran created HIVE-11861:


 Summary: Metadataonly and NullScan optimizer should not launch a 
job
 Key: HIVE-11861
 URL: https://issues.apache.org/jira/browse/HIVE-11861
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0, 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Ashutosh Chauhan


Metadataonly optimization and NullScan optimization launches a dummy one null 
row job when fetch optimization is disabled. This results is additional 
overhead of split computation and launching of tasks that does nothing. Also 
this creates failures in llap as localization per query (file.splitmetainfo 
file needs to localized) is not supported.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11860) StatsNoJobTask fails to collect fast stats when table have subdirectories

[Prasanth Jayachandran (JIRA)]

Prasanth Jayachandran created HIVE-11860:


 Summary: StatsNoJobTask fails to collect fast stats when table 
have subdirectories
 Key: HIVE-11860
 URL: https://issues.apache.org/jira/browse/HIVE-11860
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0, 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran


StatsNoJobTask is used by StatsProvidingRecordReaders like ORC reader for 
computing fast basic stats. The stats collection fails when "fs" based stats 
class is used and when table directory contains subdirectories (typically from 
union queries).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Vikram Dixit K]

Congrats Ashutosh!

On Wed, Sep 16, 2015 at 9:01 PM, Chetna C  wrote:

> Congrats Ashutosh !
>
> Thanks,
> Chetna Chaudhari
>
> On 17 September 2015 at 06:53, Navis Ryu  wrote:
>
> > Congratulations!
> >
> > 2015-09-17 9:35 GMT+09:00 Xu, Cheng A :
> > > Congratulations, Ashutosh!
> > >
> > > -Original Message-
> > > From: Mohammad Islam [mailto:misla...@yahoo.com.INVALID]
> > > Sent: Thursday, September 17, 2015 8:23 AM
> > > To: u...@hive.apache.org; Hive
> > > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> > >
> > > Congratulations Asutosh!
> > >
> > >
> > >  On Wednesday, September 16, 2015 4:51 PM, Bright Ling <
> > brig...@hostworks.com.au> wrote:
> > >
> > >
> > >  #yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285
> > {font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered
> #yiv7221259285
> > {font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered
> > #yiv7221259285 {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7221259285
> > {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered
> > #yiv7221259285 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;}
> > _filtered #yiv7221259285 {panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered
> > #yiv7221259285 {panose-1:2 1 6 0 3 1 1 1 1 1;}#yiv7221259285
> #yiv7221259285
> > p.yiv7221259285MsoNormal, #yiv7221259285 li.yiv7221259285MsoNormal,
> > #yiv7221259285 div.yiv7221259285MsoNormal
> > {margin:0cm;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7221259285
> a:link,
> > #yiv7221259285 span.yiv7221259285MsoHyperlink
> > {color:blue;text-decoration:underline;}#yiv7221259285 a:visited,
> > #yiv7221259285 span.yiv7221259285MsoHyperlinkFollowed
> > {color:purple;text-decoration:underline;}#yiv7221259285
> > p.yiv7221259285MsoAcetate, #yiv7221259285 li.yiv7221259285MsoAcetate,
> > #yiv7221259285 div.yiv7221259285MsoAcetate
> > {margin:0cm;margin-bottom:.0001pt;font-size:8.0pt;}#yiv7221259285
> > span.yiv7221259285EmailStyle17 {color:#1F497D;}#yiv7221259285
> > span.yiv7221259285BalloonTextChar {}#yiv7221259285
> > .yiv7221259285MsoChpDefault {font-size:10.0pt;} _filtered #yiv7221259285
> > {margin:72.0pt 72.0pt 72.0pt 72.0pt;}#yiv7221259285
> > div.yiv7221259285WordSection1 {}#yiv7221259285 Congratulations Asutosh!
> >From: Sathi Chowdhury [mailto:sathi.chowdh...@lithium.com]
> > > Sent: Thursday, 17 September 2015 8:04 AM
> > > To: u...@hive.apache.org
> > > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> > Congrats Asutosh!From:Sergey Shelukhin
> > > Reply-To: "u...@hive.apache.org"
> > > Date: Wednesday, September 16, 2015 at 2:31 PM
> > > To: "u...@hive.apache.org"
> > > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> > Congrats!From:Alpesh Patel 
> > > Reply-To: "u...@hive.apache.org" 
> > > Date: Wednesday, September 16, 2015 at 13:24
> > > To: "u...@hive.apache.org" 
> > > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> > Congratulations AshutoshOn Wed, Sep 16, 2015 at 1:23 PM, Pengcheng
> > Xiong  wrote: Congratulations Ashutosh!On Wed,
> Sep
> > 16, 2015 at 1:17 PM, John Pullokkaran 
> > wrote: Congrats Ashutosh!From:Vaibhav Gumashta <
> > vgumas...@hortonworks.com>
> > > Reply-To: "u...@hive.apache.org" 
> > > Date: Wednesday, September 16, 2015 at 1:01 PM
> > > To: "u...@hive.apache.org" , "
> dev@hive.apache.org"
> > 
> > > Cc: Ashutosh Chauhan 
> > > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> > Congrats Ashutosh! —VaibhavFrom:Prasanth Jayachandran <
> > pjayachand...@hortonworks.com>
> > > Reply-To: "u...@hive.apache.org" 
> > > Date: Wednesday, September 16, 2015 at 12:50 PM
> > > To: "dev@hive.apache.org" , "u...@hive.apache.org
> "
> > 
> > > Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
> > hashut...@apache.org>
> > > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> > Congratulations Ashutosh!
> > >
> > >  On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" <
> > xzh...@cloudera.com> wrote: Congratulations, Ashutosh!. Well-deserved.
> > >
> > > Thanks to Carl also for the hard work in the past few years!
> > >
> > > --Xuefu
> > >
> > > On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
> wrote:
> > >
> > >> I am very happy to announce that Ashutosh Chauhan is taking over as
> > >> the new VP of the Apache Hive project. Ashutosh has been a longtime
> > >> contributor to Hive and has played a pivotal role in many of the major
> > >> advances that have been made over the past couple of years. Please
> > >> join me in congratulating Ashutosh on his new role!
> > >>
> > >
> > >
> >
>



-- 
Nothing better than when appreciated for hard work.
-Mark

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Chetna C]

Congrats Ashutosh !

Thanks,
Chetna Chaudhari

On 17 September 2015 at 06:53, Navis Ryu  wrote:

> Congratulations!
>
> 2015-09-17 9:35 GMT+09:00 Xu, Cheng A :
> > Congratulations, Ashutosh!
> >
> > -Original Message-
> > From: Mohammad Islam [mailto:misla...@yahoo.com.INVALID]
> > Sent: Thursday, September 17, 2015 8:23 AM
> > To: u...@hive.apache.org; Hive
> > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> >
> > Congratulations Asutosh!
> >
> >
> >  On Wednesday, September 16, 2015 4:51 PM, Bright Ling <
> brig...@hostworks.com.au> wrote:
> >
> >
> >  #yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285
> {font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7221259285
> {font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered
> #yiv7221259285 {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7221259285
> {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered
> #yiv7221259285 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;}
> _filtered #yiv7221259285 {panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered
> #yiv7221259285 {panose-1:2 1 6 0 3 1 1 1 1 1;}#yiv7221259285 #yiv7221259285
> p.yiv7221259285MsoNormal, #yiv7221259285 li.yiv7221259285MsoNormal,
> #yiv7221259285 div.yiv7221259285MsoNormal
> {margin:0cm;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7221259285 a:link,
> #yiv7221259285 span.yiv7221259285MsoHyperlink
> {color:blue;text-decoration:underline;}#yiv7221259285 a:visited,
> #yiv7221259285 span.yiv7221259285MsoHyperlinkFollowed
> {color:purple;text-decoration:underline;}#yiv7221259285
> p.yiv7221259285MsoAcetate, #yiv7221259285 li.yiv7221259285MsoAcetate,
> #yiv7221259285 div.yiv7221259285MsoAcetate
> {margin:0cm;margin-bottom:.0001pt;font-size:8.0pt;}#yiv7221259285
> span.yiv7221259285EmailStyle17 {color:#1F497D;}#yiv7221259285
> span.yiv7221259285BalloonTextChar {}#yiv7221259285
> .yiv7221259285MsoChpDefault {font-size:10.0pt;} _filtered #yiv7221259285
> {margin:72.0pt 72.0pt 72.0pt 72.0pt;}#yiv7221259285
> div.yiv7221259285WordSection1 {}#yiv7221259285 Congratulations Asutosh!
>From: Sathi Chowdhury [mailto:sathi.chowdh...@lithium.com]
> > Sent: Thursday, 17 September 2015 8:04 AM
> > To: u...@hive.apache.org
> > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congrats Asutosh!From:Sergey Shelukhin
> > Reply-To: "u...@hive.apache.org"
> > Date: Wednesday, September 16, 2015 at 2:31 PM
> > To: "u...@hive.apache.org"
> > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congrats!From:Alpesh Patel 
> > Reply-To: "u...@hive.apache.org" 
> > Date: Wednesday, September 16, 2015 at 13:24
> > To: "u...@hive.apache.org" 
> > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congratulations AshutoshOn Wed, Sep 16, 2015 at 1:23 PM, Pengcheng
> Xiong  wrote: Congratulations Ashutosh!On Wed, Sep
> 16, 2015 at 1:17 PM, John Pullokkaran 
> wrote: Congrats Ashutosh!From:Vaibhav Gumashta <
> vgumas...@hortonworks.com>
> > Reply-To: "u...@hive.apache.org" 
> > Date: Wednesday, September 16, 2015 at 1:01 PM
> > To: "u...@hive.apache.org" , "dev@hive.apache.org"
> 
> > Cc: Ashutosh Chauhan 
> > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congrats Ashutosh! —VaibhavFrom:Prasanth Jayachandran <
> pjayachand...@hortonworks.com>
> > Reply-To: "u...@hive.apache.org" 
> > Date: Wednesday, September 16, 2015 at 12:50 PM
> > To: "dev@hive.apache.org" , "u...@hive.apache.org"
> 
> > Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
> hashut...@apache.org>
> > Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congratulations Ashutosh!
> >
> >  On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" <
> xzh...@cloudera.com> wrote: Congratulations, Ashutosh!. Well-deserved.
> >
> > Thanks to Carl also for the hard work in the past few years!
> >
> > --Xuefu
> >
> > On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
> >
> >> I am very happy to announce that Ashutosh Chauhan is taking over as
> >> the new VP of the Apache Hive project. Ashutosh has been a longtime
> >> contributor to Hive and has played a pivotal role in many of the major
> >> advances that have been made over the past couple of years. Please
> >> join me in congratulating Ashutosh on his new role!
> >>
> >
> >
>

[jira] [Created] (HIVE-11859) Bunch of SQL error reported for Hive with SQL Server as Metastore

[Aparup Banerjee (JIRA)]

Aparup Banerjee created HIVE-11859:
--

 Summary: Bunch of SQL error reported for Hive with SQL Server as 
Metastore
 Key: HIVE-11859
 URL: https://issues.apache.org/jira/browse/HIVE-11859
 Project: Hive
  Issue Type: Bug
Reporter: Aparup Banerjee
Priority: Critical


We are getting a lot of SQL errors reported at SQL Server end. Our set up is a 
Two Node Hive cluster using SQL Server as MetaStore.

Here is a snippet of SQL Server errors

Invalid object name 'v$instance'. Caused by: SELECT version FROM v$instance
 
Must declare the scalar variable "@@session".Caused by: SET 
@@session.sql_mode=ANSI_QUOTES

This is filling our logs at a very rapid rate, which we are forced to purge. 

Please note these queries are for MySQL / Oracle.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11858) Hive DISTRIBUTE BY should not sort output

[Gopal V (JIRA)]

Gopal V created HIVE-11858:
--

 Summary: Hive DISTRIBUTE BY should not sort output
 Key: HIVE-11858
 URL: https://issues.apache.org/jira/browse/HIVE-11858
 Project: Hive
  Issue Type: Improvement
  Components: Physical Optimizer, Tez
Affects Versions: 1.3.0, 2.0.0
Reporter: Gopal V
Assignee: Gopal V


{code}
select a ,b from table distribute by a;
{code}

Should not do any sorts at all & should use the partitioned unsorted edge 
instead. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11857) View created in 0.9.0 is not available when upgrade to 1.1.0

[Cody Fu (JIRA)]

Cody Fu created HIVE-11857:
--

 Summary: View created in 0.9.0 is not available when upgrade to 
1.1.0
 Key: HIVE-11857
 URL: https://issues.apache.org/jira/browse/HIVE-11857
 Project: Hive
  Issue Type: Bug
  Components: Views
Affects Versions: 1.1.0, 0.13.1
Reporter: Cody Fu






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11856) allow split strategies to run on threadpool

[Sergey Shelukhin (JIRA)]

Sergey Shelukhin created HIVE-11856:
---

 Summary: allow split strategies to run on threadpool
 Key: HIVE-11856
 URL: https://issues.apache.org/jira/browse/HIVE-11856
 Project: Hive
  Issue Type: Bug
Reporter: Sergey Shelukhin
Assignee: Sergey Shelukhin


If a split strategy makes metastore cache calls, it should probably run on the 
threadpool.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11855) Beeline display is not correct when content contains invisible character like \r

[Victor JMelo (JIRA)]

Victor JMelo created HIVE-11855:
---

 Summary: Beeline display is not correct when content contains 
invisible character like \r
 Key: HIVE-11855
 URL: https://issues.apache.org/jira/browse/HIVE-11855
 Project: Hive
  Issue Type: Bug
  Components: Beeline
Affects Versions: 1.2.1, 1.1.1
Reporter: Victor JMelo
Priority: Minor


Field content like this:
{quote}
col1_part1^Mcol1_part2
{quote}

create table statement:
{quote}
create table foo(c1 string);
{quote}

After load the data into table foo using sqoop, beeline display:
{quote}
0: jdbc:hive2://localhost:1/default> select * from foo;
+-+
| foo.c1  |
+-+
col1_part2t1
  |
+-+
{quote}

The first part of the data "col1_part1" is overwritten by the second part 
"col1_part2"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Navis Ryu]

Congratulations!

2015-09-17 9:35 GMT+09:00 Xu, Cheng A :
> Congratulations, Ashutosh!
>
> -Original Message-
> From: Mohammad Islam [mailto:misla...@yahoo.com.INVALID]
> Sent: Thursday, September 17, 2015 8:23 AM
> To: u...@hive.apache.org; Hive
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>
> Congratulations Asutosh!
>
>
>  On Wednesday, September 16, 2015 4:51 PM, Bright Ling 
>  wrote:
>
>
>  #yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285 
> {font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7221259285 
> {font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 
> {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7221259285 
> {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7221259285 
> {font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;} _filtered #yiv7221259285 
> {panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 {panose-1:2 1 6 0 3 
> 1 1 1 1 1;}#yiv7221259285 #yiv7221259285 p.yiv7221259285MsoNormal, 
> #yiv7221259285 li.yiv7221259285MsoNormal, #yiv7221259285 
> div.yiv7221259285MsoNormal 
> {margin:0cm;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7221259285 a:link, 
> #yiv7221259285 span.yiv7221259285MsoHyperlink 
> {color:blue;text-decoration:underline;}#yiv7221259285 a:visited, 
> #yiv7221259285 span.yiv7221259285MsoHyperlinkFollowed 
> {color:purple;text-decoration:underline;}#yiv7221259285 
> p.yiv7221259285MsoAcetate, #yiv7221259285 li.yiv7221259285MsoAcetate, 
> #yiv7221259285 div.yiv7221259285MsoAcetate 
> {margin:0cm;margin-bottom:.0001pt;font-size:8.0pt;}#yiv7221259285 
> span.yiv7221259285EmailStyle17 {color:#1F497D;}#yiv7221259285 
> span.yiv7221259285BalloonTextChar {}#yiv7221259285 
> .yiv7221259285MsoChpDefault {font-size:10.0pt;} _filtered #yiv7221259285 
> {margin:72.0pt 72.0pt 72.0pt 72.0pt;}#yiv7221259285 
> div.yiv7221259285WordSection1 {}#yiv7221259285 Congratulations Asutosh!   
> From: Sathi Chowdhury [mailto:sathi.chowdh...@lithium.com]
> Sent: Thursday, 17 September 2015 8:04 AM
> To: u...@hive.apache.org
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh ChauhanCongrats 
> Asutosh!From:Sergey Shelukhin
> Reply-To: "u...@hive.apache.org"
> Date: Wednesday, September 16, 2015 at 2:31 PM
> To: "u...@hive.apache.org"
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh ChauhanCongrats!
> From:Alpesh Patel 
> Reply-To: "u...@hive.apache.org" 
> Date: Wednesday, September 16, 2015 at 13:24
> To: "u...@hive.apache.org" 
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congratulations AshutoshOn Wed, Sep 16, 2015 at 1:23 PM, Pengcheng Xiong 
>  wrote: Congratulations Ashutosh!On Wed, Sep 16, 2015 
> at 1:17 PM, John Pullokkaran  wrote: Congrats 
> Ashutosh!From:Vaibhav Gumashta 
> Reply-To: "u...@hive.apache.org" 
> Date: Wednesday, September 16, 2015 at 1:01 PM
> To: "u...@hive.apache.org" , "dev@hive.apache.org" 
> 
> Cc: Ashutosh Chauhan 
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh ChauhanCongrats 
> Ashutosh! —VaibhavFrom:Prasanth Jayachandran 
> 
> Reply-To: "u...@hive.apache.org" 
> Date: Wednesday, September 16, 2015 at 12:50 PM
> To: "dev@hive.apache.org" , "u...@hive.apache.org" 
> 
> Cc: "dev@hive.apache.org" , Ashutosh Chauhan 
> 
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> Congratulations Ashutosh!
>
>  On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  
> wrote: Congratulations, Ashutosh!. Well-deserved.
>
> Thanks to Carl also for the hard work in the past few years!
>
> --Xuefu
>
> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
>
>> I am very happy to announce that Ashutosh Chauhan is taking over as
>> the new VP of the Apache Hive project. Ashutosh has been a longtime
>> contributor to Hive and has played a pivotal role in many of the major
>> advances that have been made over the past couple of years. Please
>> join me in congratulating Ashutosh on his new role!
>>
>
>

RE: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Xu, Cheng A]

Congratulations, Ashutosh!

-Original Message-
From: Mohammad Islam [mailto:misla...@yahoo.com.INVALID] 
Sent: Thursday, September 17, 2015 8:23 AM
To: u...@hive.apache.org; Hive
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Asutosh! 


 On Wednesday, September 16, 2015 4:51 PM, Bright Ling 
 wrote:
   

 #yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285 
{font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7221259285 
{font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 
{panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7221259285 
{font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7221259285 
{font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;} _filtered #yiv7221259285 
{panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 {panose-1:2 1 6 0 3 1 
1 1 1 1;}#yiv7221259285 #yiv7221259285 p.yiv7221259285MsoNormal, #yiv7221259285 
li.yiv7221259285MsoNormal, #yiv7221259285 div.yiv7221259285MsoNormal 
{margin:0cm;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7221259285 a:link, 
#yiv7221259285 span.yiv7221259285MsoHyperlink 
{color:blue;text-decoration:underline;}#yiv7221259285 a:visited, #yiv7221259285 
span.yiv7221259285MsoHyperlinkFollowed 
{color:purple;text-decoration:underline;}#yiv7221259285 
p.yiv7221259285MsoAcetate, #yiv7221259285 li.yiv7221259285MsoAcetate, 
#yiv7221259285 div.yiv7221259285MsoAcetate 
{margin:0cm;margin-bottom:.0001pt;font-size:8.0pt;}#yiv7221259285 
span.yiv7221259285EmailStyle17 {color:#1F497D;}#yiv7221259285 
span.yiv7221259285BalloonTextChar {}#yiv7221259285 .yiv7221259285MsoChpDefault 
{font-size:10.0pt;} _filtered #yiv7221259285 {margin:72.0pt 72.0pt 72.0pt 
72.0pt;}#yiv7221259285 div.yiv7221259285WordSection1 {}#yiv7221259285 
Congratulations Asutosh!       From: Sathi Chowdhury 
[mailto:sathi.chowdh...@lithium.com]
Sent: Thursday, 17 September 2015 8:04 AM
To: u...@hive.apache.org
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats 
Asutosh!    From:Sergey Shelukhin
Reply-To: "u...@hive.apache.org"
Date: Wednesday, September 16, 2015 at 2:31 PM
To: "u...@hive.apache.org"
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats!    
From:Alpesh Patel 
Reply-To: "u...@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 13:24
To: "u...@hive.apache.org" 
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    
Congratulations Ashutosh    On Wed, Sep 16, 2015 at 1:23 PM, Pengcheng Xiong 
 wrote: Congratulations Ashutosh!    On Wed, Sep 16, 2015 at 
1:17 PM, John Pullokkaran  wrote: Congrats 
Ashutosh!    From:Vaibhav Gumashta 
Reply-To: "u...@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 1:01 PM
To: "u...@hive.apache.org" , "dev@hive.apache.org" 

Cc: Ashutosh Chauhan 
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats 
Ashutosh!     —Vaibhav    From:Prasanth Jayachandran 

Reply-To: "u...@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "dev@hive.apache.org" , "u...@hive.apache.org" 

Cc: "dev@hive.apache.org" , Ashutosh Chauhan 

Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    
Congratulations Ashutosh!     

 On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  
wrote: Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as 
> the new VP of the Apache Hive project. Ashutosh has been a longtime 
> contributor to Hive and has played a pivotal role in many of the major 
> advances that have been made over the past couple of years. Please 
> join me in congratulating Ashutosh on his new role!
>       

  

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Mohammad Islam]

Congratulations Asutosh! 


 On Wednesday, September 16, 2015 4:51 PM, Bright Ling 
 wrote:
   

 #yiv7221259285 #yiv7221259285 -- _filtered #yiv7221259285 
{font-family:SimSun;panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7221259285 
{font-family:PMingLiU;panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 
{panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7221259285 
{font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7221259285 
{font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;} _filtered #yiv7221259285 
{panose-1:2 2 5 0 0 0 0 0 0 0;} _filtered #yiv7221259285 {panose-1:2 1 6 0 3 1 
1 1 1 1;}#yiv7221259285 #yiv7221259285 p.yiv7221259285MsoNormal, #yiv7221259285 
li.yiv7221259285MsoNormal, #yiv7221259285 div.yiv7221259285MsoNormal 
{margin:0cm;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7221259285 a:link, 
#yiv7221259285 span.yiv7221259285MsoHyperlink 
{color:blue;text-decoration:underline;}#yiv7221259285 a:visited, #yiv7221259285 
span.yiv7221259285MsoHyperlinkFollowed 
{color:purple;text-decoration:underline;}#yiv7221259285 
p.yiv7221259285MsoAcetate, #yiv7221259285 li.yiv7221259285MsoAcetate, 
#yiv7221259285 div.yiv7221259285MsoAcetate 
{margin:0cm;margin-bottom:.0001pt;font-size:8.0pt;}#yiv7221259285 
span.yiv7221259285EmailStyle17 {color:#1F497D;}#yiv7221259285 
span.yiv7221259285BalloonTextChar {}#yiv7221259285 .yiv7221259285MsoChpDefault 
{font-size:10.0pt;} _filtered #yiv7221259285 {margin:72.0pt 72.0pt 72.0pt 
72.0pt;}#yiv7221259285 div.yiv7221259285WordSection1 {}#yiv7221259285 
Congratulations Asutosh!       From: Sathi Chowdhury 
[mailto:sathi.chowdh...@lithium.com]
Sent: Thursday, 17 September 2015 8:04 AM
To: u...@hive.apache.org
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats 
Asutosh!    From:Sergey Shelukhin
Reply-To: "u...@hive.apache.org"
Date: Wednesday, September 16, 2015 at 2:31 PM
To: "u...@hive.apache.org"
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats!    
From:Alpesh Patel 
Reply-To: "u...@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 13:24
To: "u...@hive.apache.org" 
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    
Congratulations Ashutosh    On Wed, Sep 16, 2015 at 1:23 PM, Pengcheng Xiong 
 wrote: Congratulations Ashutosh!    On Wed, Sep 16, 2015 at 
1:17 PM, John Pullokkaran  wrote: Congrats 
Ashutosh!    From:Vaibhav Gumashta 
Reply-To: "u...@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 1:01 PM
To: "u...@hive.apache.org" , "dev@hive.apache.org" 

Cc: Ashutosh Chauhan 
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    Congrats 
Ashutosh!     —Vaibhav    From:Prasanth Jayachandran 

Reply-To: "u...@hive.apache.org" 
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "dev@hive.apache.org" , "u...@hive.apache.org" 

Cc: "dev@hive.apache.org" , Ashutosh Chauhan 

Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan    
Congratulations Ashutosh!     

 On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  
wrote: Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>       

  

Re: BONECP

[Ashutosh Chauhan]

We need to move to DN 4.x for other reasons as well. See :
https://issues.apache.org/jira/browse/HIVE-11036

On Wed, Sep 16, 2015 at 4:59 PM, Vaibhav Gumashta  wrote:

> It seems for the version of DataNucleus that we have (3.2.X), it does not
> support HikariCP:
> http://www.datanucleus.org/products/accessplatform_3_2/jpa/datastore_connec
> tion.html. DN 4.X onwards seems to support it:
> http://www.datanucleus.org/products/datanucleus/jdo/datastore_connection.ht
> ml#pooling_rdbms_hikaricp.
>
> —Vaibhav
>
> On 9/16/15, 3:05 PM, "John Pullokkaran" 
> wrote:
>
> >Seems like DBCP had issues and we switched
> >https://issues.apache.org/jira/browse/DBCP-398
> >https://issues.apache.org/jira/browse/HIVE-4807
> >
> >
> >On 9/16/15, 3:02 PM, "Sergey Shelukhin"  wrote:
> >
> >>Hi.
> >>Does anyone remember why we are using BONECP by default?
> >>0.8 version (the latest) has unfixed bugs since 2013 that we are hitting,
> >>and the github page says:
> >>³BoneCP Š. should now be considered deprecated in favour of HikariCP"
> >
> >
>
>

Re: BONECP

[Vaibhav Gumashta]

It seems for the version of DataNucleus that we have (3.2.X), it does not
support HikariCP: 
http://www.datanucleus.org/products/accessplatform_3_2/jpa/datastore_connec
tion.html. DN 4.X onwards seems to support it:
http://www.datanucleus.org/products/datanucleus/jdo/datastore_connection.ht
ml#pooling_rdbms_hikaricp.

—Vaibhav

On 9/16/15, 3:05 PM, "John Pullokkaran" 
wrote:

>Seems like DBCP had issues and we switched
>https://issues.apache.org/jira/browse/DBCP-398
>https://issues.apache.org/jira/browse/HIVE-4807
>
>
>On 9/16/15, 3:02 PM, "Sergey Shelukhin"  wrote:
>
>>Hi.
>>Does anyone remember why we are using BONECP by default?
>>0.8 version (the latest) has unfixed bugs since 2013 that we are hitting,
>>and the github page says:
>>³BoneCP Š. should now be considered deprecated in favour of HikariCP"
>
>

[jira] [Created] (HIVE-11854) LLAP: Analyze and fix vectorization tests

[Prasanth Jayachandran (JIRA)]

Prasanth Jayachandran created HIVE-11854:


 Summary: LLAP: Analyze and fix vectorization tests
 Key: HIVE-11854
 URL: https://issues.apache.org/jira/browse/HIVE-11854
 Project: Hive
  Issue Type: Sub-task
Affects Versions: llap
Reporter: Prasanth Jayachandran


Following vectorization tests aren't running in MiniLlap
vector_cast_constant.q (run in java 7 and java 8)
vector_decimal_precision.q
vector_left_outer_join3.q
vector_outer_join.q
vectorized_parquet_types.q
vectorized_timestamp_ints_casts.q



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11853) LLAP: Fix tests related to stats difference

[Prasanth Jayachandran (JIRA)]

Prasanth Jayachandran created HIVE-11853:


 Summary: LLAP: Fix tests related to stats difference
 Key: HIVE-11853
 URL: https://issues.apache.org/jira/browse/HIVE-11853
 Project: Hive
  Issue Type: Sub-task
Affects Versions: llap
Reporter: Prasanth Jayachandran


Following tests are showing stats diff
unionDistinct_1.q
vector_leftsemi_mapjoin.q
vector_multi_insert.q
vector_outer_join1.q
vector_outer_join2.q
vector_outer_join3.q
vector_outer_join4.q
explainuser_1.q



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11852) numRows and rawDataSize table properties are not replicated

[Sushanth Sowmyan (JIRA)]

Sushanth Sowmyan created HIVE-11852:
---

 Summary: numRows and rawDataSize table properties are not 
replicated
 Key: HIVE-11852
 URL: https://issues.apache.org/jira/browse/HIVE-11852
 Project: Hive
  Issue Type: Bug
  Components: Import/Export
Affects Versions: 1.2.1
Reporter: Sushanth Sowmyan
Assignee: Sushanth Sowmyan


numRows and rawDataSize table properties are not replicated when exported for 
replication and re-imported.

{code}
Table drdbnonreplicatabletable.vanillatable has different TblProps from 
drdbnonreplicatabletable.vanillatable expected [{numFiles=1, numRows=2, 
totalSize=560, rawDataSize=440}] but found [{numFiles=1, totalSize=560}]
java.lang.AssertionError: Table drdbnonreplicatabletable.vanillatable has 
different TblProps from drdbnonreplicatabletable.vanillatable expected 
[{numFiles=1, numRows=2, totalSize=560, rawDataSize=440}] but found 
[{numFiles=1, totalSize=560}]
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11851) LLAP: Test failure - metadataonly1.q, optimize_nullscan.q

[Prasanth Jayachandran (JIRA)]

Prasanth Jayachandran created HIVE-11851:


 Summary: LLAP: Test failure - metadataonly1.q, optimize_nullscan.q
 Key: HIVE-11851
 URL: https://issues.apache.org/jira/browse/HIVE-11851
 Project: Hive
  Issue Type: Sub-task
Affects Versions: llap
Reporter: Prasanth Jayachandran


metadataonly1.q
optimize_nullscan.q

are failing as the tasks couldn't locate job.splitmetainfo file. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 38442: HIVE-11834 Lineage doesn't work with dynamic partitioning query

[Szehon Ho]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38442/#review99325
---

Ship it!


Ship It!

- Szehon Ho


On Sept. 16, 2015, 10:35 p.m., Jimmy Xiang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38442/
> ---
> 
> (Updated Sept. 16, 2015, 10:35 p.m.)
> 
> 
> Review request for hive and Szehon Ho.
> 
> 
> Bugs: HIVE-11834
> https://issues.apache.org/jira/browse/HIVE-11834
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Fixed a bug in handling dynamic partitioning query output fields.
> 
> 
> Diffs
> -
> 
>   ql/src/java/org/apache/hadoop/hive/ql/hooks/LineageLogger.java f615d81 
>   ql/src/test/queries/clientpositive/lineage3.q c24ff7d 
>   ql/src/test/results/clientpositive/lineage3.q.out 708abee 
> 
> Diff: https://reviews.apache.org/r/38442/diff/
> 
> 
> Testing
> ---
> 
> Unit tests.
> 
> 
> Thanks,
> 
> Jimmy Xiang
> 
>

Re: Review Request 38123: HIVE-11726

[Hari Sankar Sivarama Subramaniyan]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38123/#review99321
---



metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g (line 222)


Needs to remove white spaces.



metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g (line 439)


Using COMMA instead of COLON might be a better name and changing the 
references to it.



ql/src/java/org/apache/hadoop/hive/ql/optimizer/PointLookupOptimizer.java (line 
280)


Most of the logic here might be redundant once HIVE-11634 goes in. We can 
decide which one goes in first.



ql/src/java/org/apache/hadoop/hive/ql/optimizer/PointLookupOptimizer.java (line 
429)


Looked at the entire code, seems like the change is similar to HIVE-11634. 
Can you please verify with the change in HIVE-11634.



ql/src/test/results/clientpositive/pointlookup4.q.out (line 377)


As noticed before, it looks like partition condition remover doesnt kick in 
and removes the partition only columns from the predicate.


- Hari Sankar Sivarama Subramaniyan


On Sept. 4, 2015, 5:49 a.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38123/
> ---
> 
> (Updated Sept. 4, 2015, 5:49 a.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Hari Sankar Sivarama Subramaniyan, 
> and John Pullokkaran.
> 
> 
> Bugs: HIVE-11726
> https://issues.apache.org/jira/browse/HIVE-11726
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> HIVE-11726
> 
> 
> Diffs
> -
> 
>   metastore/src/java/org/apache/hadoop/hive/metastore/parser/Filter.g 
> 8aef5bf631361cf4f30f532b9a5fb5e376c06de8 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/PointLookupOptimizer.java 
> d83636db82ecc1cb891df92736f284b1b29f29c0 
>   ql/src/java/org/apache/hadoop/hive/ql/optimizer/ppr/OpProcFactory.java 
> 7262164d39547b7832f52873a48ee998219230b1 
>   ql/src/java/org/apache/hadoop/hive/ql/plan/FilterDesc.java 
> 6a316895aacdd5d26d866c2b0c72ef4407e591e1 
>   ql/src/test/queries/clientpositive/pointlookup4.q PRE-CREATION 
>   ql/src/test/results/clientpositive/pointlookup4.q.out PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38123/diff/
> 
> 
> Testing
> ---
> 
> Existing tests (pointlookup1-4.q)
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

Review Request 38442: HIVE-11834 Lineage doesn't work with dynamic partitioning query

[Jimmy Xiang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38442/
---

Review request for hive and Szehon Ho.


Bugs: HIVE-11834
https://issues.apache.org/jira/browse/HIVE-11834


Repository: hive-git


Description
---

Fixed a bug in handling dynamic partitioning query output fields.


Diffs
-

  ql/src/java/org/apache/hadoop/hive/ql/hooks/LineageLogger.java f615d81 
  ql/src/test/queries/clientpositive/lineage3.q c24ff7d 
  ql/src/test/results/clientpositive/lineage3.q.out 708abee 

Diff: https://reviews.apache.org/r/38442/diff/


Testing
---

Unit tests.


Thanks,

Jimmy Xiang

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Sergio Pena]

Congratulations Ashutosh !!!.

On Wed, Sep 16, 2015 at 4:43 PM, Daniel Dai  wrote:

> Congratulations!
>
> On 9/16/15, 2:20 PM, "Szehon Ho"  wrote:
>
> >Congrats to Ashutosh and thanks Carl for the years of service!
> >
> >On Wed, Sep 16, 2015 at 2:00 PM, Eugene Koifman  >
> >wrote:
> >
> >> Congrats!
> >>
> >> From: Pengcheng Xiong 
> >> Reply-To: "u...@hive.apache.org" 
> >> Date: Wednesday, September 16, 2015 at 1:23 PM
> >> To: "u...@hive.apache.org" 
> >>
> >> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
> >> hashut...@apache.org>
> >> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> >>
> >> Congratulations Ashutosh!
> >>
> >> On Wed, Sep 16, 2015 at 1:17 PM, John Pullokkaran <
> >> jpullokka...@hortonworks.com> wrote:
> >>
> >>> Congrats Ashutosh!
> >>>
> >>> From: Vaibhav Gumashta 
> >>> Reply-To: "u...@hive.apache.org" 
> >>> Date: Wednesday, September 16, 2015 at 1:01 PM
> >>> To: "u...@hive.apache.org" ,
> >>>"dev@hive.apache.org"
> >>> 
> >>> Cc: Ashutosh Chauhan 
> >>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> >>>
> >>> Congrats Ashutosh!
> >>>
> >>> ‹Vaibhav
> >>>
> >>> From: Prasanth Jayachandran 
> >>> Reply-To: "u...@hive.apache.org" 
> >>> Date: Wednesday, September 16, 2015 at 12:50 PM
> >>> To: "dev@hive.apache.org" ,
> >>>"u...@hive.apache.org" <
> >>> u...@hive.apache.org>
> >>> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
> >>> hashut...@apache.org>
> >>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
> >>>
> >>> Congratulations Ashutosh!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" <
> >>> xzh...@cloudera.com> wrote:
> >>>
> >>> Congratulations, Ashutosh!. Well-deserved.
> >>>
> >>> Thanks to Carl also for the hard work in the past few years!
> >>>
> >>> --Xuefu
> >>>
> >>> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
> >>>wrote:
> >>>
> >>> > I am very happy to announce that Ashutosh Chauhan is taking over as
> >>>the
> >>> > new VP of the Apache Hive project. Ashutosh has been a longtime
> >>> contributor
> >>> > to Hive and has played a pivotal role in many of the major advances
> >>>that
> >>> > have been made over the past couple of years. Please join me in
> >>> > congratulating Ashutosh on his new role!
> >>> >
> >>>
> >>
> >>
>
>

Re: Review Request 38211: HIVE-11684

[John Pullokkaran]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38211/#review99318
---



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
 (line 49)


It would be good to implement   
public boolean matches(RelOptRuleCall call) 

and check if sort rel is actualy limit & not sort


- John Pullokkaran


On Sept. 10, 2015, 8:23 a.m., Jesús Camacho Rodríguez wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38211/
> ---
> 
> (Updated Sept. 10, 2015, 8:23 a.m.)
> 
> 
> Review request for hive and John Pullokkaran.
> 
> 
> Bugs: HIVE-11684
> https://issues.apache.org/jira/browse/HIVE-11684
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> Implement limit pushdown through outer join in CBO
> 
> 
> Diffs
> -
> 
>   common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 
> d2c5885b4808335cdddc826137d95a8a065dabf7 
>   itests/src/test/resources/testconfiguration.properties 
> bed621d3eb74f01e54110552f68538afd228018d 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/rules/HiveSortJoinReduceRule.java
>  PRE-CREATION 
>   ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java 
> 73ae7c4ef90af22847bef9e54863d4651d9c1013 
>   ql/src/test/queries/clientpositive/limit_join_transpose.q PRE-CREATION 
>   ql/src/test/queries/clientpositive/tez_dynpart_hashjoin_3.q PRE-CREATION 
>   ql/src/test/results/clientpositive/limit_join_transpose.q.out PRE-CREATION 
>   ql/src/test/results/clientpositive/tez/tez_dynpart_hashjoin_3.q.out 
> PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38211/diff/
> 
> 
> Testing
> ---
> 
> Two new tests added: limit_join_transpose.q and tez_dynpart_hashjoin_3.q 
> (only Tez)
> 
> 
> Thanks,
> 
> Jesús Camacho Rodríguez
> 
>

Re: BONECP

[John Pullokkaran]

Seems like DBCP had issues and we switched
https://issues.apache.org/jira/browse/DBCP-398
https://issues.apache.org/jira/browse/HIVE-4807


On 9/16/15, 3:02 PM, "Sergey Shelukhin"  wrote:

>Hi.
>Does anyone remember why we are using BONECP by default?
>0.8 version (the latest) has unfixed bugs since 2013 that we are hitting,
>and the github page says:
>³BoneCP Š. should now be considered deprecated in favour of HikariCP"

BONECP

[Sergey Shelukhin]

Hi.
Does anyone remember why we are using BONECP by default?
0.8 version (the latest) has unfixed bugs since 2013 that we are hitting, and 
the github page says:
“BoneCP …. should now be considered deprecated in favour of HikariCP"

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Daniel Dai]

Congratulations!

On 9/16/15, 2:20 PM, "Szehon Ho"  wrote:

>Congrats to Ashutosh and thanks Carl for the years of service!
>
>On Wed, Sep 16, 2015 at 2:00 PM, Eugene Koifman 
>wrote:
>
>> Congrats!
>>
>> From: Pengcheng Xiong 
>> Reply-To: "u...@hive.apache.org" 
>> Date: Wednesday, September 16, 2015 at 1:23 PM
>> To: "u...@hive.apache.org" 
>>
>> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
>> hashut...@apache.org>
>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>>
>> Congratulations Ashutosh!
>>
>> On Wed, Sep 16, 2015 at 1:17 PM, John Pullokkaran <
>> jpullokka...@hortonworks.com> wrote:
>>
>>> Congrats Ashutosh!
>>>
>>> From: Vaibhav Gumashta 
>>> Reply-To: "u...@hive.apache.org" 
>>> Date: Wednesday, September 16, 2015 at 1:01 PM
>>> To: "u...@hive.apache.org" ,
>>>"dev@hive.apache.org"
>>> 
>>> Cc: Ashutosh Chauhan 
>>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>>>
>>> Congrats Ashutosh!
>>>
>>> ‹Vaibhav
>>>
>>> From: Prasanth Jayachandran 
>>> Reply-To: "u...@hive.apache.org" 
>>> Date: Wednesday, September 16, 2015 at 12:50 PM
>>> To: "dev@hive.apache.org" ,
>>>"u...@hive.apache.org" <
>>> u...@hive.apache.org>
>>> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
>>> hashut...@apache.org>
>>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>>>
>>> Congratulations Ashutosh!
>>>
>>>
>>>
>>>
>>>
>>> On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" <
>>> xzh...@cloudera.com> wrote:
>>>
>>> Congratulations, Ashutosh!. Well-deserved.
>>>
>>> Thanks to Carl also for the hard work in the past few years!
>>>
>>> --Xuefu
>>>
>>> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
>>>wrote:
>>>
>>> > I am very happy to announce that Ashutosh Chauhan is taking over as
>>>the
>>> > new VP of the Apache Hive project. Ashutosh has been a longtime
>>> contributor
>>> > to Hive and has played a pivotal role in many of the major advances
>>>that
>>> > have been made over the past couple of years. Please join me in
>>> > congratulating Ashutosh on his new role!
>>> >
>>>
>>
>>

Re: Review Request 38429: HIVE-11786: Deprecate the use of redundant column in colunm stats related tables

[Sergey Shelukhin]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38429/#review99307
---



metastore/src/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java 
(line 61)


what if some code uses this? seems like not setting it is better, the bugs 
would be more obvious.
Or for now you could set it from table/db fields but deprecate the 
getter... as is it's not proper deprecation cause it may break things.



metastore/src/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java 
(line 306)


nit: whitespace



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 
(line 317)


that may have perf impact... why not change the queries on metastore instead



ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 
(line 327)


more whitespace


- Sergey Shelukhin


On Sept. 16, 2015, 12:37 p.m., Chaoyu Tang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38429/
> ---
> 
> (Updated Sept. 16, 2015, 12:37 p.m.)
> 
> 
> Review request for hive, Ashutosh Chauhan, Sergey Shelukhin, and Xuefu Zhang.
> 
> 
> Bugs: HIVE-11786
> https://issues.apache.org/jira/browse/HIVE-11786
> 
> 
> Repository: hive-git
> 
> 
> Description
> ---
> 
> The stats tables such as TAB_COL_STATS, PART_COL_STATS have redundant columns 
> such as DB_NAME, TABLE_NAME, PARTITION_NAME since these tables already have 
> foreign key like TBL_ID, or PART_ID referencing to TBLS or PARTITIONS. But 
> these columns are currently used in fetching column stats (e.g. 
> getTableStats/getPartitionStats) so any Hive operation involved in 
> db/table/partition name change has to update these columnn, which is not 
> necessary and sometimes quite difficult in implementation given the 
> limitations from DN and RawStore APIs.
> This patch is to remove the use of these redundant columns at HMS code level. 
> The changes include:
> 1. Instead of directly using these columns in TAB_COL_STATS, PART_COL_STATS, 
> use these in their referenced tables.
> 2. currently the CBO code assumes that the column stats returned from HMS are 
> in the same order as that passed in column request. It is not gurantteed and 
> has been changed.
> 3. The deprecated redundant columns are now temorarily populated with value 
> "Deprecated". They will be removed in a followed up JIRA.
> 
> 
> Diffs
> -
> 
>   metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java 
> 1f89b7c 
>   metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
> 4d6bfcc 
>   
> metastore/src/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java 
> b3ceff1 
>   
> metastore/src/test/org/apache/hadoop/hive/metastore/VerifyingObjectStore.java 
> 7e46523 
>   
> ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 
> 6c0bd25 
> 
> Diff: https://reviews.apache.org/r/38429/diff/
> 
> 
> Testing
> ---
> 
> 1. Manually tested some cases against MySQL/PostgreSQL/Oracle.
> 2. Is running precommit test.
> 
> 
> Thanks,
> 
> Chaoyu Tang
> 
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Szehon Ho]

Congrats to Ashutosh and thanks Carl for the years of service!

On Wed, Sep 16, 2015 at 2:00 PM, Eugene Koifman 
wrote:

> Congrats!
>
> From: Pengcheng Xiong 
> Reply-To: "u...@hive.apache.org" 
> Date: Wednesday, September 16, 2015 at 1:23 PM
> To: "u...@hive.apache.org" 
>
> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
> hashut...@apache.org>
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>
> Congratulations Ashutosh!
>
> On Wed, Sep 16, 2015 at 1:17 PM, John Pullokkaran <
> jpullokka...@hortonworks.com> wrote:
>
>> Congrats Ashutosh!
>>
>> From: Vaibhav Gumashta 
>> Reply-To: "u...@hive.apache.org" 
>> Date: Wednesday, September 16, 2015 at 1:01 PM
>> To: "u...@hive.apache.org" , "dev@hive.apache.org"
>> 
>> Cc: Ashutosh Chauhan 
>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>>
>> Congrats Ashutosh!
>>
>> —Vaibhav
>>
>> From: Prasanth Jayachandran 
>> Reply-To: "u...@hive.apache.org" 
>> Date: Wednesday, September 16, 2015 at 12:50 PM
>> To: "dev@hive.apache.org" , "u...@hive.apache.org" <
>> u...@hive.apache.org>
>> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
>> hashut...@apache.org>
>> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>>
>> Congratulations Ashutosh!
>>
>>
>>
>>
>>
>> On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" <
>> xzh...@cloudera.com> wrote:
>>
>> Congratulations, Ashutosh!. Well-deserved.
>>
>> Thanks to Carl also for the hard work in the past few years!
>>
>> --Xuefu
>>
>> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
>>
>> > I am very happy to announce that Ashutosh Chauhan is taking over as the
>> > new VP of the Apache Hive project. Ashutosh has been a longtime
>> contributor
>> > to Hive and has played a pivotal role in many of the major advances that
>> > have been made over the past couple of years. Please join me in
>> > congratulating Ashutosh on his new role!
>> >
>>
>
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Eugene Koifman]

Congrats!

From: Pengcheng Xiong mailto:pxi...@apache.org>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 1:23 PM
To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Cc: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, Ashutosh Chauhan 
mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Ashutosh!

On Wed, Sep 16, 2015 at 1:17 PM, John Pullokkaran 
mailto:jpullokka...@hortonworks.com>> wrote:
Congrats Ashutosh!

From: Vaibhav Gumashta 
mailto:vgumas...@hortonworks.com>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 1:01 PM
To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>, 
"dev@hive.apache.org" 
mailto:dev@hive.apache.org>>
Cc: Ashutosh Chauhan mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats Ashutosh!

-Vaibhav

From: Prasanth Jayachandran 
mailto:pjayachand...@hortonworks.com>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, 
"u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Cc: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, Ashutosh Chauhan 
mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Ashutosh!





On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" 
mailto:xzh...@cloudera.com>> wrote:

Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
mailto:c...@apache.org>> wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Pengcheng Xiong]

Congratulations Ashutosh!

On Wed, Sep 16, 2015 at 1:17 PM, John Pullokkaran <
jpullokka...@hortonworks.com> wrote:

> Congrats Ashutosh!
>
> From: Vaibhav Gumashta 
> Reply-To: "u...@hive.apache.org" 
> Date: Wednesday, September 16, 2015 at 1:01 PM
> To: "u...@hive.apache.org" , "dev@hive.apache.org" <
> dev@hive.apache.org>
> Cc: Ashutosh Chauhan 
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>
> Congrats Ashutosh!
>
> —Vaibhav
>
> From: Prasanth Jayachandran 
> Reply-To: "u...@hive.apache.org" 
> Date: Wednesday, September 16, 2015 at 12:50 PM
> To: "dev@hive.apache.org" , "u...@hive.apache.org" <
> u...@hive.apache.org>
> Cc: "dev@hive.apache.org" , Ashutosh Chauhan <
> hashut...@apache.org>
> Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan
>
> Congratulations Ashutosh!
>
>
>
>
>
> On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  > wrote:
>
> Congratulations, Ashutosh!. Well-deserved.
>
> Thanks to Carl also for the hard work in the past few years!
>
> --Xuefu
>
> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
>
> > I am very happy to announce that Ashutosh Chauhan is taking over as the
> > new VP of the Apache Hive project. Ashutosh has been a longtime
> contributor
> > to Hive and has played a pivotal role in many of the major advances that
> > have been made over the past couple of years. Please join me in
> > congratulating Ashutosh on his new role!
> >
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[John Pullokkaran]

Congrats Ashutosh!

From: Vaibhav Gumashta 
mailto:vgumas...@hortonworks.com>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 1:01 PM
To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>, 
"dev@hive.apache.org" 
mailto:dev@hive.apache.org>>
Cc: Ashutosh Chauhan mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats Ashutosh!

-Vaibhav

From: Prasanth Jayachandran 
mailto:pjayachand...@hortonworks.com>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, 
"u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Cc: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, Ashutosh Chauhan 
mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Ashutosh!





On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" 
mailto:xzh...@cloudera.com>> wrote:

Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
mailto:c...@apache.org>> wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Hari Sivarama Subramaniyan]

?Congrats Ashutosh!


Thanks

Hari


From: Vaibhav Gumashta 
Sent: Wednesday, September 16, 2015 1:01 PM
To: u...@hive.apache.org; dev@hive.apache.org
Cc: Ashutosh Chauhan
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats Ashutosh!

-Vaibhav

From: Prasanth Jayachandran 
mailto:pjayachand...@hortonworks.com>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, 
"u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Cc: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, Ashutosh Chauhan 
mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Ashutosh!





On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" 
mailto:xzh...@cloudera.com>> wrote:

Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
mailto:c...@apache.org>> wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>

[jira] [Created] (HIVE-11850) On Humboldt, creating udf function using wasb fail throwing java.lang.RuntimeException: invalid url: wasb:///... expecting ( file | hdfs | ivy) as url scheme.

[Takahiko Saito (JIRA)]

Takahiko Saito created HIVE-11850:
-

 Summary: On Humboldt, creating udf function using wasb fail 
throwing java.lang.RuntimeException: invalid url: wasb:///...  expecting ( file 
| hdfs | ivy)  as url scheme.
 Key: HIVE-11850
 URL: https://issues.apache.org/jira/browse/HIVE-11850
 Project: Hive
  Issue Type: Bug
  Components: UDF
Affects Versions: 1.2.1
 Environment: Humboldt
Reporter: Takahiko Saito
 Fix For: 1.2.1


{noformat}
hive> drop function if exists gencounter;
OK
Time taken: 2.614 seconds
On Humboldt, creating UDF function fail as follows:
hive> create function gencounter as 
'org.apache.hive.udf.generic.GenericUDFGenCounter' using jar 
'wasb:///tmp/hive-udfs-0.1.jar';
invalid url: wasb:///tmp/hive-udfs-0.1.jar, expecting ( file | hdfs | ivy)  as 
url scheme.
Failed to register default.gencounter using class 
org.apache.hive.udf.generic.GenericUDFGenCounter
FAILED: Execution Error, return code 1 from 
org.apache.hadoop.hive.ql.exec.FunctionTask
{noformat}

The jar exists in wasb dir:
{noformat}
hrt_qa@headnode0:~$ hadoop fs -ls wasb:///tmp/
Found 2 items
-rw-r--r--   1 hrt_qa supergroup   4472 2015-09-16 11:50 
wasb:///tmp/hive-udfs-0.1.jar
drwxrwxrwx   - hdfs   supergroup  0 2015-09-16 12:00 wasb:///tmp/阿䶵aa阿䶵
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Vaibhav Gumashta]

Congrats Ashutosh!

-Vaibhav

From: Prasanth Jayachandran 
mailto:pjayachand...@hortonworks.com>>
Reply-To: "u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Date: Wednesday, September 16, 2015 at 12:50 PM
To: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, 
"u...@hive.apache.org" 
mailto:u...@hive.apache.org>>
Cc: "dev@hive.apache.org" 
mailto:dev@hive.apache.org>>, Ashutosh Chauhan 
mailto:hashut...@apache.org>>
Subject: Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congratulations Ashutosh!





On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" 
mailto:xzh...@cloudera.com>> wrote:

Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach 
mailto:c...@apache.org>> wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Chao Sun]

Big congrats to Ashutosh! Thanks Carl for the awesome work too!

On Wed, Sep 16, 2015 at 12:55 PM, Lefty Leverenz 
wrote:

> Congratulations Ashutosh!  And thanks, Carl!
>
> -- Lefty
>
> On Wed, Sep 16, 2015 at 3:50 PM, Prasanth Jayachandran <
> pjayachand...@hortonworks.com> wrote:
>
> > Congratulations Ashutosh!
> >
> >
> >
> >
> >
> > On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" <
> xzh...@cloudera.com
> > > wrote:
> >
> > Congratulations, Ashutosh!. Well-deserved.
> >
> > Thanks to Carl also for the hard work in the past few years!
> >
> > --Xuefu
> >
> > On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
> >
> > > I am very happy to announce that Ashutosh Chauhan is taking over as the
> > > new VP of the Apache Hive project. Ashutosh has been a longtime
> > contributor
> > > to Hive and has played a pivotal role in many of the major advances
> that
> > > have been made over the past couple of years. Please join me in
> > > congratulating Ashutosh on his new role!
> > >
> >
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Lefty Leverenz]

Congratulations Ashutosh!  And thanks, Carl!

-- Lefty

On Wed, Sep 16, 2015 at 3:50 PM, Prasanth Jayachandran <
pjayachand...@hortonworks.com> wrote:

> Congratulations Ashutosh!
>
>
>
>
>
> On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang"  > wrote:
>
> Congratulations, Ashutosh!. Well-deserved.
>
> Thanks to Carl also for the hard work in the past few years!
>
> --Xuefu
>
> On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:
>
> > I am very happy to announce that Ashutosh Chauhan is taking over as the
> > new VP of the Apache Hive project. Ashutosh has been a longtime
> contributor
> > to Hive and has played a pivotal role in many of the major advances that
> > have been made over the past couple of years. Please join me in
> > congratulating Ashutosh on his new role!
> >
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Prasanth Jayachandran]

Congratulations Ashutosh!





On Wed, Sep 16, 2015 at 12:48 PM -0700, "Xuefu Zhang" 
mailto:xzh...@cloudera.com>> wrote:

Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Xuefu Zhang]

Congratulations, Ashutosh!. Well-deserved.

Thanks to Carl also for the hard work in the past few years!

--Xuefu

On Wed, Sep 16, 2015 at 12:39 PM, Carl Steinbach  wrote:

> I am very happy to announce that Ashutosh Chauhan is taking over as the
> new VP of the Apache Hive project. Ashutosh has been a longtime contributor
> to Hive and has played a pivotal role in many of the major advances that
> have been made over the past couple of years. Please join me in
> congratulating Ashutosh on his new role!
>

[ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

[Carl Steinbach]

I am very happy to announce that Ashutosh Chauhan is taking over as the new
VP of the Apache Hive project. Ashutosh has been a longtime contributor to
Hive and has played a pivotal role in many of the major advances that have
been made over the past couple of years. Please join me in congratulating
Ashutosh on his new role!

[jira] [Created] (HIVE-11849) NPE in HiveHBaseTableShapshotInputFormat in query with just count(*)

[Jason Dere (JIRA)]

Jason Dere created HIVE-11849:
-

 Summary: NPE in HiveHBaseTableShapshotInputFormat in query with 
just count(*)
 Key: HIVE-11849
 URL: https://issues.apache.org/jira/browse/HIVE-11849
 Project: Hive
  Issue Type: Bug
  Components: HBase Handler
Affects Versions: 1.3.0
Reporter: Jason Dere


Adding the following example as a qfile test in hbase-handler fails. Looks like 
this may have been introduced by HIVE-5277.

{noformat}
SET hive.hbase.snapshot.name=src_hbase_snapshot;
SET hive.hbase.snapshot.restoredir=/tmp;

select count(*) from src_hbase;
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11848) tables in subqueries don't get locked

[Eugene Koifman (JIRA)]

Eugene Koifman created HIVE-11848:
-

 Summary: tables in subqueries don't get locked
 Key: HIVE-11848
 URL: https://issues.apache.org/jira/browse/HIVE-11848
 Project: Hive
  Issue Type: Bug
  Components: Locking, Transactions
Reporter: Eugene Koifman
Assignee: Eugene Koifman


Consider
{noformat}
update acidTbl set b=19 where acidTbl.b in(select I.b from nonAcidOrcTbl I 
where I.a = 3)
{noformat}

noAcidOrcTbl doesn't get locked at all.  (SHARED_WRITE is taken on acidTbl).

This is is because the ReadEntity for nonAcidOrcTbl is skipped by
{noformat}
for (ReadEntity input : plan.getInputs()) {
  if (!input.needsLock() || input.isUpdateOrDelete()) {
// We don't want to acquire readlocks during update or delete as we'll 
be acquiring write
// locks instead.
continue;
  }
{noformat}
whatever sets isUpdateOrDelete() flag doesn't pay attention to whether the 
table is written to or not.

HIVE-10150 was a similar issue, abstractly



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11847) Avoid expensive call to contains/containsAll in DefaultGraphWalker

[Jesus Camacho Rodriguez (JIRA)]

Jesus Camacho Rodriguez created HIVE-11847:
--

 Summary: Avoid expensive call to contains/containsAll in 
DefaultGraphWalker
 Key: HIVE-11847
 URL: https://issues.apache.org/jira/browse/HIVE-11847
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer, Physical Optimizer
Affects Versions: 1.3.0, 2.0.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez


Continuing work started in HIVE-11652.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11846) CliDriver shutdown tries to drop index table again which was already dropped when dropping the original table

[Pengcheng Xiong (JIRA)]

Pengcheng Xiong created HIVE-11846:
--

 Summary: CliDriver shutdown tries to drop index table again which 
was already dropped when dropping the original table 
 Key: HIVE-11846
 URL: https://issues.apache.org/jira/browse/HIVE-11846
 Project: Hive
  Issue Type: Sub-task
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
Priority: Critical


Steps to repro:
{code}
set hive.stats.dbclass=fs;
set hive.stats.autogather=true;
set hive.cbo.enable=true;

DROP TABLE IF EXISTS aa;
CREATE TABLE aa (L_ORDERKEY  INT,
L_PARTKEY   INT,
L_SUPPKEY   INT,
L_LINENUMBERINT,
L_QUANTITY  DOUBLE,
L_EXTENDEDPRICE DOUBLE,
L_DISCOUNT  DOUBLE,
L_TAX   DOUBLE,
L_RETURNFLAGSTRING,
L_LINESTATUSSTRING,
l_shipdate  STRING,
L_COMMITDATESTRING,
L_RECEIPTDATE   STRING,
L_SHIPINSTRUCT  STRING,
L_SHIPMODE  STRING,
L_COMMENT   STRING)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '|';

LOAD DATA LOCAL INPATH '../../data/files/lineitem.txt' OVERWRITE INTO TABLE aa;

CREATE INDEX aa_lshipdate_idx ON TABLE aa(l_shipdate) AS 
'org.apache.hadoop.hive.ql.index.AggregateIndexHandler' WITH DEFERRED REBUILD 
IDXPROPERTIES("AGGREGATES"="count(l_shipdate)");
ALTER INDEX aa_lshipdate_idx ON aa REBUILD;

show tables;

explain select l_shipdate, count(l_shipdate)
from aa
group by l_shipdate;
{code}

The problem is that, we create an index table default_aa_lshipdate_idx, 
(default is the database name) and it comes after the table aa. Then, it first 
drop aa, which will drop default_aa_lshipdate_idx as well as it is related to 
aa. It will not find the table default_aa_lshipdate_idx when it tries to drop 
it again, which will throw an exception.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11845) Bucket map join requires exact number of files as number of buckets

[Prasanth Jayachandran (JIRA)]

Prasanth Jayachandran created HIVE-11845:


 Summary: Bucket map join requires exact number of files as number 
of buckets
 Key: HIVE-11845
 URL: https://issues.apache.org/jira/browse/HIVE-11845
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.3.0, 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Vikram Dixit K


I recently tried to write a test case for bucket map join in tez on ACID table 
but was unable to do so because bucket map join expects same number of files in 
table/partition as that of number of buckets. 

Steps to reproduce:
create table src_acid(key string, value string) clustered by (key) into 4 
buckets stored as orc tblproperties("transactional"="true");
insert into table src_acid values("key1","value1");
insert into table src_acid values("key2","value2");

After inserting 2 rows into the src_acid table, there will be total of 8 files 
in the table directory which does not match the number of buckets.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11844) CMerge master to Spark branch 9/16/2015 [Spark Branch]

[Xuefu Zhang (JIRA)]

Xuefu Zhang created HIVE-11844:
--

 Summary: CMerge master to Spark branch 9/16/2015 [Spark Branch]
 Key: HIVE-11844
 URL: https://issues.apache.org/jira/browse/HIVE-11844
 Project: Hive
  Issue Type: Sub-task
  Components: Spark
Reporter: Xuefu Zhang
Assignee: Xuefu Zhang
 Fix For: 1.2.0






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11843) Add 'sort by c' to Parquet PPD q-tests to avoid different output issues with hadoop-1

[JIRA]

Sergio Peña created HIVE-11843:
--

 Summary: Add 'sort by c' to Parquet PPD q-tests to avoid different 
output issues with hadoop-1
 Key: HIVE-11843
 URL: https://issues.apache.org/jira/browse/HIVE-11843
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Sergio Peña
Assignee: Sergio Peña


Parquet PPD tests has a different output when is run against hadoop-1 because 
mixed values are in different order.

To fix this, we should just add 'sort by c' in the queries that will display 
mixed values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11842) Improve RuleRegExp by caching some internal data structures

[Jesus Camacho Rodriguez (JIRA)]

Jesus Camacho Rodriguez created HIVE-11842:
--

 Summary: Improve RuleRegExp by caching some internal data 
structures
 Key: HIVE-11842
 URL: https://issues.apache.org/jira/browse/HIVE-11842
 Project: Hive
  Issue Type: Bug
Affects Versions: 2.0.0
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez
 Fix For: 2.0.0


Continuing work started in HIVE-11141.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11841) KeyValuesInputMerger creates huge logs

[Rajesh Balamohan (JIRA)]

Rajesh Balamohan created HIVE-11841:
---

 Summary: KeyValuesInputMerger creates huge logs
 Key: HIVE-11841
 URL: https://issues.apache.org/jira/browse/HIVE-11841
 Project: Hive
  Issue Type: Bug
Reporter: Rajesh Balamohan


https://github.com/apache/hive/blob/ac755ebe26361a4647d53db2a28500f71697b276/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/tools/KeyValuesInputMerger.java#L107

When running tpc-ds q75 at relatively large scale, it ends up generating huge 
logs due to this.
{noformat}
Log Type: syslog_attempt_1439860407967_1249_1_30_00_0
Log Upload Time: Wed Sep 16 12:49:09 + 2015
Log Length: 3992760053
Showing 4096 bytes of 3992760053 total. Click here for the full log.
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 38429: HIVE-11786: Deprecate the use of redundant column in colunm stats related tables

[Chaoyu Tang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38429/
---

Review request for hive, Ashutosh Chauhan, Sergey Shelukhin, and Xuefu Zhang.


Bugs: HIVE-11786
https://issues.apache.org/jira/browse/HIVE-11786


Repository: hive-git


Description
---

The stats tables such as TAB_COL_STATS, PART_COL_STATS have redundant columns 
such as DB_NAME, TABLE_NAME, PARTITION_NAME since these tables already have 
foreign key like TBL_ID, or PART_ID referencing to TBLS or PARTITIONS. But 
these columns are currently used in fetching column stats (e.g. 
getTableStats/getPartitionStats) so any Hive operation involved in 
db/table/partition name change has to update these columnn, which is not 
necessary and sometimes quite difficult in implementation given the limitations 
from DN and RawStore APIs.
This patch is to remove the use of these redundant columns at HMS code level. 
The changes include:
1. Instead of directly using these columns in TAB_COL_STATS, PART_COL_STATS, 
use these in their referenced tables.
2. currently the CBO code assumes that the column stats returned from HMS are 
in the same order as that passed in column request. It is not gurantteed and 
has been changed.
3. The deprecated redundant columns are now temorarily populated with value 
"Deprecated". They will be removed in a followed up JIRA.


Diffs
-

  metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java 
1f89b7c 
  metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 4d6bfcc 
  metastore/src/java/org/apache/hadoop/hive/metastore/StatObjectConverter.java 
b3ceff1 
  metastore/src/test/org/apache/hadoop/hive/metastore/VerifyingObjectStore.java 
7e46523 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 
6c0bd25 

Diff: https://reviews.apache.org/r/38429/diff/


Testing
---

1. Manually tested some cases against MySQL/PostgreSQL/Oracle.
2. Is running precommit test.


Thanks,

Chaoyu Tang

Can't read from not standard JSON format - JsonParseException(About HIVE-11825)

[Cazen Lee]

Good Day This is Cazen

It's related on "HIVE-11825
 get_json_object(col,'$.a')
is null in where clause didn`t work"

When UDF read JSON format, it calls org.codehaus.jackson.map.ObjectMapper

And, exception occured when meet wrong escape
character(org.codehaus.jackson.JsonParseException:
Unrecognized character escape)

For example in HIVE-11825, There are "keywords":"思科Q4收入估\$79.2亿 前景阴云笼罩" in
JSON, so when parser meet \$, it cause JsonParseException.

It can evade just set on ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER property -
JSON_FACTORY.enable(Feature.ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER)

I think it's some harsh. Of course I know it's unstandard JSON format.
There are some logic needed when store JSON.

Is there any reason that have a rule of strict JSON format?

I'm newbie in Hive history, so want to ask via mailling list

Thank you very much



--
ca...@korea.com
cazen@samsung.com
http://www.Cazen.co.kr 

Build failed in Jenkins: HIVE-TRUNK-JAVA8 #113

[hiveqa]

See 


Changes:

[Ferdinand Xu] HIVE-11780: Add "set role none" support(Sun Dapeng, reviewed by 
Ferdinand Xu)

[j.prasanth.j] HIVE-11792: User explain in tez does not preserve ordering 
(Prasanth Jayachandran reviewed by Pengcheng Xiong)

[j.prasanth.j] HIVE-5623: ORC accessing array column that's empty will fail 
with java out of bound exception (Prasanth Jayachandran reviewed by Ashutosh 
Chauhan)

[gopalv] HIVE-11544: Improve LazySimpleSerDe null data handling for Byte, 
Short, Integer, Float, Long and Double. (Gopal V, reviewed by Ashutosh Chauhan)

[Sergio Pena] HIVE-11802: Float-point numbers are displayed with different 
precision in Beeline/JDBC (Sergio Pena, reviewed by Carl Steinbach)

[Jimmy Xiang] HIVE-11814: Emit query time in lineage info (Jimmy, reviewed by 
Ashutosh)

[Jimmy Xiang] HIVE-11817: Window function max NullPointerException (Jimmy, 
reviewed by Szehon)

[Szehon Ho] HIVE-11745 : Alter table Exchange partition with multiple 
partition_spec is not working (Yongzhi Chen via Szehon)

[gopalv] HIVE-11821: JDK8 strict build broken for master (Gopal V, reviewed by 
Sergey Shelukhin)

[sershe] HIVE-11705 : refactor SARG stripe filtering for ORC into a separate 
method (Sergey Shelukhin, reviewed by Prasanth Jayachandran)

[j.prasanth.j] HIVE-11824: Insert to local directory causes staging directory 
to be copied (Prasanth Jayachandran reviewed by Ashutosh Chauhan)

--
[...truncated 325 lines...]
Aptest2/src/main/java/org/apache/hive/ptest/execution/Drone.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/Constants.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RemoteCommandResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommandExecutor.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommandExecutor.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHResult.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommand.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/NonZeroExitCodeException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHCommand.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHExecutionException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/AbortDroneException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommandFactory.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/ExecutionPhase.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/TestsFailedException.java
Aptest2/src/main/java/org/apache/hive/ptest/execution/PrepPhase.java
Aptest2/src/main/java/org/apache/hive/ptest/api
Aptest2/src/main/java/org/apache/hive/ptest/api/request
Aptest2/src/main/java/org/apache/hive/ptest/api/request/TestLogRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStatusRequest.java
Aptest2/src/main/java/org/apache/hive/ptest/api/request/TestStopRequest.java
Aptest2/src/main/java/org/apache/hive/ptest/api/request/TestListRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStartRequest.java
Aptest2/src/main/java/org/apache/hive/ptest/api/client
Aptest2/src/main/java/org/apache/hive/ptest/api/client/PTestClient.java
Aptest2/src/main/java/org/apache/hive/ptest/api/response
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStopResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestListResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/GenericResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStartResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestLogResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatusResponse.java
Aptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatus.java
Aptest2/src/main/java/org/apache/hive/ptest/api/Status.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server
A
ptest2/src/main/java/org/apache/hive/ptest/api/server/ExecutionController.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server/TestExecutor.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server/Test.java
Aptest2/src/main/java/org/apache/hive/ptest/api/server/TestLogger.java
Checked out revision 1703373.
+ cd ptest2
+ mvn clean package -DskipTests -Drat.numUnapprovedLicenses=1000 
-Dmaven.repo.local=

[jira] [Created] (HIVE-11840) when multi insert the inputformat becomes OneNullRowInputFormat

[Feng Yuan (JIRA)]

Feng Yuan created HIVE-11840:


 Summary: when multi insert the inputformat becomes 
OneNullRowInputFormat
 Key: HIVE-11840
 URL: https://issues.apache.org/jira/browse/HIVE-11840
 Project: Hive
  Issue Type: Bug
  Components: Hive
Affects Versions: 0.14.0
Reporter: Feng Yuan
Priority: Critical
 Fix For: 0.14.1


example:
from portrait.rec_feature_feedback a 
insert overwrite table portrait.test1 select iid, feedback_15day, 
feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = 
'2015-09-09' and bid in ('949722CF_12F7_523A_EE21_E3D591B7E755') 
insert overwrite table portrait.test2 select iid, feedback_15day, 
feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = 
'2015-09-09' and bid in ('test') 
insert overwrite table portrait.test3 select iid, feedback_15day, 
feedback_7day, feedback_5day, feedback_3day, feedback_1day where l_date = 
'2015-09-09' and bid in ('F7734668_CC49_8C4F_24C5_EA8B6728E394')

when single insert it works.but multi insert when i select * from test1:
NULL NULL NULL NULL NULL NULL.

i see "explain extended"
Path -> Alias:
-mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, 
cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394} [a]
-mr-10007portrait.rec_feature_feedback{l_date=2015-09-09, cid=Czgc_pc, 
bid=949722CF_12F7_523A_EE21_E3D591B7E755} [a]
  Path -> Partition:
-mr-10006portrait.rec_feature_feedback{l_date=2015-09-09, 
cid=Cyiyaowang, bid=F7734668_CC49_8C4F_24C5_EA8B6728E394} 
  Partition
base file name: bid=F7734668_CC49_8C4F_24C5_EA8B6728E394
input format: org.apache.hadoop.hive.ql.io.OneNullRowInputFormat
output format: 
org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
partition values:
  bid F7734668_CC49_8C4F_24C5_EA8B6728E394
  cid Cyiyaowang
  l_date 2015-09-09

but when single insert:
Path -> Alias:

hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755
 [a]
  Path -> Partition:

hdfs://bfdhadoopcool/warehouse/portrait.db/rec_feature_feedback/l_date=2015-09-09/cid=Czgc_pc/bid=949722CF_12F7_523A_EE21_E3D591B7E755
 
  Partition
base file name: bid=949722CF_12F7_523A_EE21_E3D591B7E755
input format: org.apache.hadoop.mapred.TextInputFormat
output format: 
org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
partition values:
  bid 949722CF_12F7_523A_EE21_E3D591B7E755
  cid Czgc_pc
  l_date 2015-09-09



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11839) Vectorization wrong results with filter of (CAST AS CHAR)

[Matt McCline (JIRA)]

Matt McCline created HIVE-11839:
---

 Summary: Vectorization wrong results with filter of (CAST AS CHAR)
 Key: HIVE-11839
 URL: https://issues.apache.org/jira/browse/HIVE-11839
 Project: Hive
  Issue Type: Bug
  Components: Hive
Reporter: Matt McCline
Assignee: Matt McCline
Priority: Critical


PROBLEM:
For query such as
select count(1) from table where CAST (id as CHAR(4))='1000';
gives wrong results 0 than expected results.
STEPS TO REPRODUCE:
create table s1(id smallint) stored as orc;
insert into table s1 values (1000),(1001),(1002),(1003),(1000);
set hive.vectorized.execution.enabled=true;
select count(1) from s1 where cast(id as char(4))='1000';
– this gives 0
set hive.vectorized.execution.enabled=false;
select count(1) from s1 where cast(id as char(4))='1000';
– this gives 2



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)