Re: wide ORC partitioned table insert causes "GC Overhead Limit Exceeded" error

2017-05-24 Thread Prasanth Jayachandran
Did you try with hive.optimize.sort.dynamic.partition set to true? Thanks Prasanth On Wed, May 24, 2017 at 11:07 PM -0700, "Revin Chalil" mailto:rcha...@expedia.com>> wrote: Forgot to mention that we use hive 1.2. From: Revin Chalil [mailto:rcha...@expedia.com] Sent: Wednesday, May 24, 2017

RE: wide ORC partitioned table insert causes "GC Overhead Limit Exceeded" error

2017-05-24 Thread Revin Chalil
Forgot to mention that we use hive 1.2. From: Revin Chalil [mailto:rcha...@expedia.com] Sent: Wednesday, May 24, 2017 10:53 PM To: user@hive.apache.org Subject: wide ORC partitioned table insert causes "GC Overhead Limit Exceeded" error I get the "GC Overhead Limit Exceeded" and "java heap space

wide ORC partitioned table insert causes "GC Overhead Limit Exceeded" error

2017-05-24 Thread Revin Chalil
I get the "GC Overhead Limit Exceeded" and "java heap space" errors when trying to insert from Stage table to wide (~2500 columns) ORC partitioned table with dynamic partitioning. It consistently fails with TEZ and but succeeds with lesser data in "MR" execution engine. We have been trying to ad

Re: Welcome Rui Li to Hive PMC

2017-05-24 Thread Lefty Leverenz
Congratulations! -- Lefty On Thu, May 25, 2017 at 12:40 AM, Chao Sun wrote: > Congratulations Rui!! > > On Wed, May 24, 2017 at 9:19 PM, Xuefu Zhang wrote: > > > Hi all, > > > > It's an honer to announce that Apache Hive PMC has recently voted to > invite > > Rui Li as a new Hive PMC member. R

Re: Jimmy Xiang now a Hive PMC member

2017-05-24 Thread Lefty Leverenz
Congratulations! -- Lefty On Thu, May 25, 2017 at 12:41 AM, Chao Sun wrote: > Congratulations Jimmy!! > > On Wed, May 24, 2017 at 9:16 PM, Xuefu Zhang wrote: > >> Hi all, >> >> It's an honer to announce that Apache Hive PMC has recently voted to >> invite >> Jimmy Xiang as a new Hive PMC membe

Re: Jimmy Xiang now a Hive PMC member

2017-05-24 Thread Chao Sun
Congratulations Jimmy!! On Wed, May 24, 2017 at 9:16 PM, Xuefu Zhang wrote: > Hi all, > > It's an honer to announce that Apache Hive PMC has recently voted to invite > Jimmy Xiang as a new Hive PMC member. Please join me in congratulating him > and looking forward to a bigger role that he will p

Re: Welcome Rui Li to Hive PMC

2017-05-24 Thread Chao Sun
Congratulations Rui!! On Wed, May 24, 2017 at 9:19 PM, Xuefu Zhang wrote: > Hi all, > > It's an honer to announce that Apache Hive PMC has recently voted to invite > Rui Li as a new Hive PMC member. Rui is a long time Hive contributor and > committer, and has made significant contribution in Hiv

Welcome Rui Li to Hive PMC

2017-05-24 Thread Xuefu Zhang
Hi all, It's an honer to announce that Apache Hive PMC has recently voted to invite Rui Li as a new Hive PMC member. Rui is a long time Hive contributor and committer, and has made significant contribution in Hive especially in Hive on Spark. Please join me in congratulating him and looking forwar

Jimmy Xiang now a Hive PMC member

2017-05-24 Thread Xuefu Zhang
Hi all, It's an honer to announce that Apache Hive PMC has recently voted to invite Jimmy Xiang as a new Hive PMC member. Please join me in congratulating him and looking forward to a bigger role that he will play in Apache Hive project. Thanks, Xuefu

CVE-2016-3083: Apache Hive SSL vulnerability bug disclosure

2017-05-24 Thread Vaibhav Gumashta
Severity: Important Vendor: The Apache Software Foundation Versions Affected: Apache Hive 0.13.x Apache Hive 0.14.x Apache Hive 1.0.0 - 1.0.1 Apache Hive 1.1.0 - 1.1.1 Apache Hive 1.2.0 - 1.2.1 Apache Hive 2.0.0 Description: Apache Hive (JDBC + HiveServer2) implements SSL for plain TCP and HTTP