Re: hiveserver2 oom

2016-09-22 Thread Tale Firefly
Hey Sanjeev. Can you put the /tmp/hive/hive.log (on the hvevserver2 host) when you launch the query ? Best regards. Tale On Thu, Sep 22, 2016 at 5:03 AM, Sanjeev Verma wrote: > lowered 1073741824 to half of it but still getting the same issue. > > On Wed, Sep 21,

Re: hiveserver2 oom

2016-09-21 Thread Sanjeev Verma
lowered 1073741824 to half of it but still getting the same issue. On Wed, Sep 21, 2016 at 6:44 PM, Sanjeev Verma wrote: > its 1073741824 now but I cant see anything running on client side, the job > which kicked up by the query got completed but HS2 is crashing > >

Re: hiveserver2 oom

2016-09-21 Thread Sanjeev Verma
its 1073741824 now but I cant see anything running on client side, the job which kicked up by the query got completed but HS2 is crashing On Wed, Sep 21, 2016 at 6:40 PM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > FetchOperator will run client side. What is the value for >

Re: hiveserver2 oom

2016-09-21 Thread Prasanth Jayachandran
FetchOperator will run client side. What is the value for hive.fetch.task.conversion.threshold? Thanks Prasanth > On Sep 21, 2016, at 6:37 PM, Sanjeev Verma wrote: > > I am getting hiveserver2 memory even after increasing the heap size from 8G > to 24G, in clue why

hiveserver2 oom

2016-09-21 Thread Sanjeev Verma
I am getting hiveserver2 memory even after increasing the heap size from 8G to 24G, in clue why it still going to OOM with enough heapsize "HiveServer2-HttpHandler-Pool: Thread-58026" prio=5 tid=58026 RUNNABLE at java.lang.OutOfMemoryError.(OutOfMemoryError.java:48) at

Re: HiveServer2 OOM

2015-10-12 Thread Bennie Schut
In my experience having looked at way to many heap dumps from hiveserver2 it always end up being a seriously over partitioned table and a user who decided to do a full table scan basically requesting all partitions. This often is by accident for example when using unix_timestamp to convert

HiveServer2 OOM

2015-10-10 Thread Sanjeev Verma
Even having enough heap size my hiveserver2 going outofmemory, I enable heap dump on error which producing 650MB of heap although I have hiveserver2 configured with 8GB Heap. here is the stacktrace of the thread which went in to OOM,could anybody let me know why it throwing OOM "pool-2-thread-4"

Hiveserver2 OOM

2015-10-08 Thread Sanjeev Verma
Even having enough heap size my hiveserver2 going outofmemory, I enable heap dump on error which producing 650MB of heap although I have hiveserver2 configured with 8GB Heap. here is the stacktrace of the thread which went in to OOM,could anybody let me know why it throwing OOM "pool-2-thread-4"