Re: Hive ptests not running

[Matthew McCline]

https://status.apache.org

Get Outlook for iOS



On Thu, Aug 30, 2018 at 2:28 AM -0500, "László Pintér" 
mailto:lpin...@cloudera.com.INVALID>> wrote:


A couple of things are down in the apache jenkins environment:
https://status.apache.org/

Regards,

On Thu, Aug 30, 2018 at 7:02 AM Sankar Hariappan
wrote:

> Hive ptests are not running since 2 days and the url is not available.
> https://builds.apache.org/job/PreCommit-HIVE-Build/
>
> Does anyone know what happened?
> Please help to fix it.
>
> Best regards
> Sankar
>
>

--
- Laszlo

My Hive QA job failed with "No space left on device (28)"

[Matthew McCline]

https://builds.apache.org/job/PreCommit-HIVE-Build/10785?


Thanks

Re: [Announce] New committer: Deepak Jaiswal

[Matthew McCline]

Congratulations!


From: Lefty Leverenz 
Sent: Tuesday, January 9, 2018 3:08 AM
To: dev@hive.apache.org
Subject: Re: [Announce] New committer: Deepak Jaiswal

Congratulations!

-- Lefty


On Mon, Jan 8, 2018 at 10:41 AM, Vihang Karajgaonkar 
wrote:

> Congrats Deepak!
>
> On Mon, Jan 8, 2018 at 10:25 AM, Mithun RK  wrote:
>
> > Congratulations, Deepak!
> >
> > On Mon, Jan 8, 2018 at 10:14 AM D K  wrote:
> >
> > > Congratulations Deepak!
> > >
> > > On Fri, Jan 5, 2018 at 2:18 PM, Ashutosh Chauhan  >
> > > wrote:
> > >
> > > > The Project Management Committee (PMC) for Apache Hive has invited
> > Deepak
> > > > Jaiswal to become a committer and we are pleased to announce that he
> > has
> > > >  accepted.
> > > >
> > > > Welcome, Deepak!
> > > >
> > > > Thanks,
> > > >  Ashutosh
> > > >
> > >
> >
>

Re: Unable to Use Vectorized Reader In Hive

[Matthew McCline]

When Fetch is used in the plan instead of Map, we do not vectorize.

Suggest using:
set hive.fetch.task.conversion=none;


From: Anubhav Tarar 
Sent: Thursday, July 13, 2017 6:03 AM
To: dev@hive.apache.org
Subject: Unable to Use Vectorized Reader In Hive

hi, i am uanble to use vectorized reader with hive 1.2.1 i use this link
from hive documentation

https://cwiki.apache.org/confluence/display/Hive/Vectorized+Query+Execution

step1: create table check(id int) stored as ORC;
OK
Time taken: 0.521 seconds

step2:hive> insert into check values(1);
Query ID = hduser_20170713162335_9bb368e6-c11f-4d87-8edf-86484fb0a233
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Job running in-process (local Hadoop)
2017-07-13 16:23:39,323 Stage-1 map = 0%,  reduce = 0%
2017-07-13 16:23:40,390 Stage-1 map = 100%,  reduce = 0%
Ended Job = job_local800495047_0001
Stage-4 is selected by condition resolver.
Stage-3 is filtered out by condition resolver.
Stage-5 is filtered out by condition resolver.
Moving data to:
hdfs://localhost:54310/usr/hive/warehouse/check/.hive-staging_hive_2017-07-13_16-23-35_493_7294075038374724529-1/-ext-1
Loading data to table default.check
Table default.check stats: [numFiles=1, numRows=1, totalSize=199,
rawDataSize=4]
MapReduce Jobs Launched:
Stage-Stage-1:  HDFS Read: 4055 HDFS Write: 270 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
Time taken: 5.505 seconds
step3:
hive> explain select * from check where id >1;
OK
STAGE DEPENDENCIES:
 Stage-0 is a root stage

STAGE PLANS:
 Stage: Stage-0
   Fetch Operator
 limit: -1
 Processor Tree:
   TableScan
 alias: check
 Statistics: Num rows: 1 Data size: 4 Basic stats: COMPLETE Column
stats: NONE
 Filter Operator
   predicate: (id > 1) (type: boolean)
   Statistics: Num rows: 1 Data size: 4 Basic stats: COMPLETE
Column stats: NONE
   Select Operator
 expressions: 1 (type: int)
 outputColumnNames: _col0
 Statistics: Num rows: 1 Data size: 4 Basic stats: COMPLETE
Column stats: NONE


explain command does not show that vectorized reader is applied
--
Thanks and Regards

*   Anubhav Tarar *


* Software Consultant*
  *Knoldus Software LLP    *
   LinkedIn  Twitter
fb 
  mob : 8588915184

Re: [Announce] New committer: Peter Vary

[Matthew McCline]

Congratulations Peter!


From: Jimmy Xiang 
Sent: Friday, July 07, 2017 12:29 PM
To: dev@hive.apache.org
Subject: Re: [Announce] New committer: Peter Vary

Congrats!!

On Fri, Jul 7, 2017 at 11:38 AM, Sergio Pena  wrote:
> Congrats Peter !!
>
> On Fri, Jul 7, 2017 at 12:51 PM, Vaibhav Gumashta > wrote:
>
>> Congratulations Peter!
>>
>> On 7/7/17, 10:46 AM, "Vineet Garg"  wrote:
>>
>> >Congrats Peter!
>> >
>> >> On Jul 7, 2017, at 9:27 AM, Xuefu Zhang  wrote:
>> >>
>> >> Congratulations!
>> >>
>> >> On Fri, Jul 7, 2017 at 4:17 AM, Adam Szita  wrote:
>> >>
>> >>> Congrats all!
>> >>>
>> >>> On 7 July 2017 at 10:03, Zoltan Haindrich 
>> >>> wrote:
>> >>>
>>  Congratulations Peter, Teddy, Deepesh, Vihang and Sahil!
>>  It's great to see that the Hive community is growing!
>> 
>>  On 6 Jul 2017 02:52, Ashutosh Chauhan  wrote:
>>  The Project Management Committee (PMC) for Apache Hive has invited
>> Peter
>>  Vary to become a committer and we are pleased to announce that he has
>>  accepted.
>> 
>>  Welcome, Peter!
>> 
>>  Thanks,
>>  Ashutosh
>> 
>> 
>> >>>
>> >
>>
>>

Re: [Announce] New committer: Teddy Choi

[Matthew McCline]

Congratulations Teddy!

Get Outlook for iOS



On Wed, Jul 5, 2017 at 5:53 PM -0700, "Ashutosh Chauhan" 
> wrote:


The Project Management Committee (PMC) for Apache Hive has invited Teddy
Choi to become a committer and we are pleased to announce that he has
accepted.

Welcome, Teddy!

Thanks,
Ashutosh

Re: [Announce] New committer: Vineet Garg

[Matthew McCline]

Congratulations!


From: Chaoyu Tang 
Sent: Tuesday, May 09, 2017 4:11 PM
To: dev@hive.apache.org
Subject: Re: [Announce] New committer: Vineet Garg

Congratulations Vineet!

On Tue, May 9, 2017 at 6:34 PM, Vaibhav Gumashta 
wrote:

> Congrats Vineet.
>
> ‹Vaibhav
>
> On 5/9/17, 1:54 PM, "Deepak Jaiswal"  wrote:
>
> >Congratulations Vineet!
> >
> >On 5/9/17, 1:51 PM, "Jimmy Xiang"  wrote:
> >
> >Congrats!!
> >
> >On Tue, May 9, 2017 at 1:47 PM, Sergio Pena
> > wrote:
> >> Congratulations Vinnet !!
> >>
> >> On Tue, May 9, 2017 at 3:42 PM, Wei Zheng 
> >wrote:
> >>
> >>> Congrats!
> >>>
> >>> Thanks,
> >>> Wei
> >>>
> >>> On 5/9/17, 13:36, "Gunther Hagleitner"
> >
> >>> wrote:
> >>>
> >>> Congrats Vineet!
> >>> 
> >>> From: Ashutosh Chauhan 
> >>> Sent: Tuesday, May 09, 2017 1:24 PM
> >>> To: dev@hive.apache.org
> >>> Subject: [Announce] New committer: Vineet Garg
> >>>
> >>> The Project Management Committee (PMC) for Apache Hive has
> >invited
> >>> Vineet
> >>> Garg to become a committer and we are pleased to announce that
> >he has
> >>> accepted.
> >>>
> >>> Welcome, Vineet!
> >>>
> >>> Thanks,
> >>> Ashutosh
> >>>
> >>>
> >>>
> >>>
> >
> >
> >
>
>

Re: Invitation for Hive committers to become ORC committers

[Matthew McCline]

Yes, I'm interested.


From: Owen O'Malley 
Sent: Thursday, December 15, 2016 1:12 PM
To: dev@hive.apache.org
Subject: Invitation for Hive committers to become ORC committers

All,
   As you are aware, we are in the last stages of removing the forked ORC
code out of Hive. The goal of moving ORC out of Hive was to increase its
community and we want to be very deliberately inclusive of the Hive
development community. Towards that end, the ORC PMC wants to welcome
anyone who is already a Hive committer to become a committer on ORC.

  Please respond on this thread to let us know if you are interested.

Thanks,
   Owen on behalf of the ORC PMC

Re: [DISCUSS] Making storage-api a separately released artifact

[Matthew McCline]

For good performance the VectorizedRowBatch doesn't follow "traditional" good 
object rules -- for better or worse.  We made a number of member variables 
public so they can be accessed directly (e.g. for LongColumnVector the long[] 
vector is public) and avoid using an interface for faster direct object access 
to the ColumnVector family.


From: Sergio Pena 
Sent: Friday, August 26, 2016 12:58 PM
To: dev
Subject: Re: [DISCUSS] Making storage-api a separately released artifact

Question:

Wouldn't be better to move part of the implementations to Orc, Parquet and
Avro, and just have some interfaces and basic implementations on Hive? This
way we could avoid Orc, Parquet and/or Avro to depend from Hive. I saw this
on Parquet where they created a RowBatch class internally and returns that
to Hive, then in Hive we will just bind it to the Hive vectorized interface
to support vectorization. It justs an idea, I am not clear exactly what I
am trying to say :)


On Fri, Aug 19, 2016 at 11:01 PM, Lefty Leverenz 
wrote:

> Sergey's idea is creative, although it leads to confusion about JIRA fix
> versions.  Issues would be given fix versions based on assumptions about
> whether SA or Hive will be released first.  (That's hard to predict when
> it's months away.)
>
> Keeping the version numbers tied together is very appealing.  Would it be
> possible to have incompatible changes in SA force a bump in the Hive
> release number?  Hm, I guess that means Hive would need a release at the
> same time as SA, but only for incompatible changes.
>
> What's the likelihood of another subproject getting spun off eventually?
> If that happened, the 4th minor version wouldn't make sense.  A 5th minor
> version wouldn't work either.
>
> -- Lefty
>
>
> On Fri, Aug 19, 2016 at 9:46 PM, Sergey Shelukhin 
> wrote:
>
> > I am suggesting we always skip the number. So only one component gets the
> > next one :) In your example Hive trunk would be 2.3, and if SA is
> released
> > again it would become 2.4. Otherwise we’d need a compat table cause
> > versions will be totally out of sync.
> >
> > On 16/8/19, 16:31, "Owen O'Malley"  wrote:
> >
> > >That won't necessarily work, especially in the beginning. If we release
> SA
> > >2.2.0 and use it for Hive trunk with the assumption that the next Hive
> > >release will be 2.2. What do we do when we need to make an incompatible
> > >change in SA? I guess we could release SA as 2.3.0 and when hive makes
> its
> > >next release skip over Hive 2.2 and go straight to Hive 2.3.0. In
> general
> > >I
> > >think that we'd be better off with the release numbers not tied
> together.
> > >
> > >.. Owen
> > >
> > >On Fri, Aug 19, 2016 at 4:14 PM, Sergey Shelukhin <
> ser...@hortonworks.com
> > >
> > >wrote:
> > >
> > >> Can we just run the versions thru? I.e. increment it every time but
> > >> release only one component (or both if they happen to align I guess).
> > >> E.g. storage-api will be released at 2.2, and say 2.3 if it moves
> fast,
> > >> then Hive 2.4, then storage-api 2.5, etc.
> > >> That might make it easier to reason about compatibility because the
> > >>order
> > >> is obvious.
> > >>
> > >> On 16/8/19, 09:04, "Sergio Pena"  wrote:
> > >>
> > >> >I see Parquet is currently using the SearchArgument class for
> > >>predicates
> > >> >push down.
> > >> >Will this class be part of the new sub-module or project?
> > >> >
> > >> >Following Sushanth idea, can we have other API interfaces in the new
> > >> >project that other components can use?
> > >> >Perhaps having this may be a good reason to create a project.
> > >> >
> > >> >I'm -1 with the 4th minor version. As Owen mentioned, changing the
> 4th
> > >> >version number for incompatible changes is ugly and confusing.
> > >> >I like the new project idea more, +1, but  the storage-api may be too
> > >> >small
> > >> >for a new project.
> > >> >
> > >> >- Sergio
> > >> >
> > >> >On Wed, Aug 17, 2016 at 2:05 PM, Owen O'Malley 
> > >> wrote:
> > >> >
> > >> >> On Wed, Aug 17, 2016 at 10:46 AM, Alan Gates  >
> > >> >>wrote:
> > >> >>
> > >> >> > +1 for making the API clean and easy for other projects to work
> > >>with.
> > >> >> A
> > >> >> > few questions:
> > >> >> >
> > >> >> > 1) Would this also make it easier for Parquet and others to
> > >>implement
> > >> >> > Hive’s ACID interfaces?
> > >> >> >
> > >> >>
> > >> >> Currently the ACID interfaces haven't been moved over to
> storage-api,
> > >> >> although it would make sense to do so at some point.
> > >> >>
> > >> >>
> > >> >> >
> > >> >> > 2) Would we make any attempt to coordinate version numbers
> between
> > >> >>Hive
> > >> >> > and the storage module, or would a given version of Hive just
> > >>depend
> > >> >>on a
> > >> >> > given version of the storage module?
> > >> >> >
> > >> >>

Re: [VOTE] Apache Hive 2.1.0 Release Candidate 2

[Matthew McCline]

-1 for HIVE-13974 ORC Schema Evolution doesn't support add columns to non-last 
STRUCT columns

This bug will prevent people with ORC tables that have added columns to inner 
STRUCT columns to not be able to read their tables.


From: Jesus Camacho Rodriguez 
Sent: Wednesday, June 15, 2016 3:20 AM
To: dev@hive.apache.org
Subject: Re: [VOTE] Apache Hive 2.1.0 Release Candidate 2

Hive PMC members,

Just a quick reminder that the vote for RC2 is still open and it needs two 
additional votes to pass.

Please test and cast your vote!

Thanks,
Jesús



On 6/10/16, 6:29 PM, "Alan Gates"  wrote:

>+1, checked signatures, did a build and ran a few simple unit tests.
>
>Alan.
>
>> On Jun 10, 2016, at 05:44, Jesus Camacho Rodriguez 
>>  wrote:
>>
>> Apache Hive 2.1.0 Release Candidate 2 is available here:
>>
>> http://people.apache.org/~jcamacho/hive-2.1.0-rc2
>>
>> Maven artifacts are available here:
>>
>> https://repository.apache.org/content/repositories/orgapachehive-1055/
>>
>> Source tag for RC2 is at:
>> https://github.com/apache/hive/releases/tag/release-2.1.0-rc2
>>
>>
>> Voting will conclude in 72 hours.
>>
>> Hive PMC Members: Please test and vote.
>>
>> Thanks.
>>
>>
>
>

Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

[Matthew McCline]

Congratulations!


From: Chetna C 
Sent: Wednesday, October 21, 2015 8:27 PM
To: dev@hive.apache.org
Cc: Siddharth Seth
Subject: Re: [ANNOUNCE] New Hive Committer - Siddharth Seth

Congratulations !!
On Oct 22, 2015 5:13 AM, "Pengcheng Xiong"  wrote:

> Congrats Sid!
>
> On Wed, Oct 21, 2015 at 2:14 PM, Sergey Shelukhin 
> wrote:
>
> > The Apache Hive PMC has voted to make Siddharth Seth a committer on the
> > Apache Hive Project.
> >
> > Please join me in congratulating Sid!
> >
> > Thanks,
> > Sergey.
> >
> >
>

Re: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and Sergio Pena

[Matthew McCline]

?

Thanks everyone, too! Congrats to Jimmy and Sergio.


I hear we will soon receive some karma.



From: Jimmy Xiang jxi...@cloudera.com
Sent: Tuesday, March 24, 2015 8:41 AM
To: u...@hive.apache.org
Cc: sanjiv.is...@gmail.com; dev@hive.apache.org; Matthew McCline; 
jxi...@apache.org; sergio.p...@cloudera.com
Subject: Re: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and 
Sergio Pena

Thanks everyone! Congrats to Sergio and Matt!!

On Mon, Mar 23, 2015 at 11:36 PM, Xu, Cheng A 
cheng.a...@intel.commailto:cheng.a...@intel.com wrote:
Congratulations!!!

From: @Sanjiv Singh 
[mailto:sanjiv.is...@gmail.commailto:sanjiv.is...@gmail.com]
Sent: Tuesday, March 24, 2015 12:45 PM
To: u...@hive.apache.orgmailto:u...@hive.apache.org
Cc: dev@hive.apache.orgmailto:dev@hive.apache.org; 
mmccl...@hortonworks.commailto:mmccl...@hortonworks.com; 
jxi...@apache.orgmailto:jxi...@apache.org; 
sergio.p...@cloudera.commailto:sergio.p...@cloudera.com
Subject: Re: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and 
Sergio Pena

Congratulations !!!

Regards
Sanjiv Singh
Mob :  +091 9990-447-339

On Mon, Mar 23, 2015 at 11:38 PM, Carl Steinbach 
c...@apache.orgmailto:c...@apache.org wrote:
The Apache Hive PMC has voted to make Jimmy Xiang, Matt McCline, and Sergio 
Pena committers on the Apache Hive Project.

Please join me in congratulating Jimmy, Matt, and Sergio.

Thanks.

- Carl

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

[Matthew McCline]

Congratulations!

On Mon, Oct 27, 2014 at 3:38 PM, Carl Steinbach c...@apache.org wrote:

 I am pleased to announce that Alan Gates has been elected to the Hive
 Project Management Committee. Please join me in congratulating Alan!

 Thanks.

 - Carl


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [ANNOUNCE] New Hive Committer - John Pullokkaran

[Matthew McCline]

Congrats!

On Wed, Oct 1, 2014 at 8:19 AM, Carl Steinbach c...@apache.org wrote:

 The Apache Hive PMC has voted to make John Pullokkaran a committer on the
 Apache Hive Project.

 Please join me in congratulating John!

 Thanks.

 - Carl



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [ANNOUNCE] New Hive Committer - Eugene Koifman

[Matthew McCline]

Congratulations, Eugene!

On Fri, Sep 12, 2014 at 4:18 PM, Eugene Koifman ekoif...@hortonworks.com
wrote:

 Thank you all!

 On Fri, Sep 12, 2014 at 4:15 PM, Xuefu Zhang xzh...@cloudera.com wrote:

  Congratulations, Eugene!
 
  --Xuefu
 
 
  On Fri, Sep 12, 2014 at 4:08 PM, Gunther Hagleitner 
  ghagleit...@hortonworks.com wrote:
 
  Congrats Eugene!
 
  Cheers,
  Gunther.
 
  On Fri, Sep 12, 2014 at 3:47 PM, Prasanth Jayachandran 
  pjayachand...@hortonworks.com wrote:
 
  Congrats Eugene!
 
  Thanks
  Prasanth Jayachandran
 
  On Sep 12, 2014, at 3:46 PM, Xiaobing Zhou xz...@hortonworks.com
  wrote:
 
   Congrats, Eugene!
  
   On Fri, Sep 12, 2014 at 3:35 PM, Carl Steinbach c...@apache.org
  wrote:
  
   The Apache Hive PMC has voted to make Eugene Koifman a committer on
  the
   Apache Hive Project.
  
   Please join me in congratulating Eugene!
  
   Thanks.
  
   - Carl
  
  
   --
   CONFIDENTIALITY NOTICE
   NOTICE: This message is intended for the use of the individual or
  entity to
   which it is addressed and may contain information that is
 confidential,
   privileged and exempt from disclosure under applicable law. If the
  reader
   of this message is not the intended recipient, you are hereby
 notified
  that
   any printing, copying, dissemination, distribution, disclosure or
   forwarding of this communication is strictly prohibited. If you have
   received this communication in error, please contact the sender
  immediately
   and delete it from your system. Thank You.
 
 
  --
  CONFIDENTIALITY NOTICE
  NOTICE: This message is intended for the use of the individual or
 entity
  to
  which it is addressed and may contain information that is confidential,
  privileged and exempt from disclosure under applicable law. If the
 reader
  of this message is not the intended recipient, you are hereby notified
  that
  any printing, copying, dissemination, distribution, disclosure or
  forwarding of this communication is strictly prohibited. If you have
  received this communication in error, please contact the sender
  immediately
  and delete it from your system. Thank You.
 
 
 
  CONFIDENTIALITY NOTICE
  NOTICE: This message is intended for the use of the individual or entity
  to which it is addressed and may contain information that is
 confidential,
  privileged and exempt from disclosure under applicable law. If the
 reader
  of this message is not the intended recipient, you are hereby notified
 that
  any printing, copying, dissemination, distribution, disclosure or
  forwarding of this communication is strictly prohibited. If you have
  received this communication in error, please contact the sender
 immediately
  and delete it from your system. Thank You.
 
 
 


 --

 Thanks,
 Eugene

 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or entity to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the reader
 of this message is not the intended recipient, you are hereby notified that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender immediately
 and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.