Re: Is there a bug in hiveserver2 metastore caused hold huge objects

Any further word on this? We're seeing a major memory leak too. On May 21, 2014 10:03 PM, "Meng QingPing" wrote: > Vaibhav, thanks for reply. > It's a remote metastore, stored in mysql. > > > 2014-05-22 5:31 GMT+08:00 Vaibhav Gumashta : > > > Meng, are you running a remote metastore or an embedde

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

Vaibhav, thanks for reply. It's a remote metastore, stored in mysql. 2014-05-22 5:31 GMT+08:00 Vaibhav Gumashta : > Meng, are you running a remote metastore or an embedded one (which would be > true if you added this config while starting HS2: -hiveconf > hive.metastore.uris=" ")? > > Thanks, >

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

Meng, are you running a remote metastore or an embedded one (which would be true if you added this config while starting HS2: -hiveconf hive.metastore.uris=" ")? Thanks, --Vaibhav On Wed, May 21, 2014 at 2:28 PM, Vaibhav Gumashta wrote: > Thanks a lot for the dump Meng! > > > On Wed, May 21, 2

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

Thanks a lot for the dump Meng! On Wed, May 21, 2014 at 1:41 AM, Meng QingPing wrote: > I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin > > Thanks. > > > 2014-05-21 15:41 GMT+08:00 Meng QingPing : > > > There are 18908 PM-s. I post it on > > http://jack-meng.qiniudn.com/hive-h

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

I post the heap bin file on http://jack-meng.qiniudn.com/heap.bin Thanks. 2014-05-21 15:41 GMT+08:00 Meng QingPing : > There are 18908 PM-s. I post it on > http://jack-meng.qiniudn.com/hive-heap2.png > > Thanks. > > > 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin : > > What is the count of PM-s th

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

There are 18908 PM-s. I post it on http://jack-meng.qiniudn.com/hive-heap2.png Thanks. 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin : > What is the count of PM-s that you are seeing when it crashes? From that > screenshot I don't see what the problem is or I'm not reading it right. > > > On Mon,

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

There are 18908 PM-s. I post it on http://jack-meng.qiniudn.com/hive-heap2.png Thanks. 2014-05-20 0:41 GMT+08:00 Sergey Shelukhin : > What is the count of PM-s that you are seeing when it crashes? From that > screenshot I don't see what the problem is

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

What is the count of PM-s that you are seeing when it crashes? From that screenshot I don't see what the problem is or I'm not reading it right. On Mon, May 19, 2014 at 1:17 AM, Meng QingPing wrote: > Thanks. > > I post it on http://jack-meng.qiniudn.com/hive-heap.png > > > > > 2014-05-06 23:14

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

Thanks. I post it on http://jack-meng.qiniudn.com/hive-heap.png 2014-05-06 23:14 GMT+08:00 Sergey Shelukhin : > I don't think the dev list supports attachment. Can you post to some image > sharing service? > > > On Tue, May 6, 2014 at 3:20 AM, Meng QingPing wrote: > > > > > Weird, the pictur

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

I don't think the dev list supports attachment. Can you post to some image sharing service? On Tue, May 6, 2014 at 3:20 AM, Meng QingPing wrote: > > Weird, the picture attached in sent mail. > > Anyway send again. > > > 2014-05-05 12:17 GMT+08:00 Chandra Reddy : > > seems you have missed attach

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

Weird, the picture attached in sent mail. Anyway send again. 2014-05-05 12:17 GMT+08:00 Chandra Reddy : > seems you have missed attachment. > -Chandra > > > On Sun, May 4, 2014 at 6:57 PM, Meng QingPing wrote: > > > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the > > hea

Re: Is there a bug in hiveserver2 metastore caused hold huge objects

seems you have missed attachment. -Chandra On Sun, May 4, 2014 at 6:57 PM, Meng QingPing wrote: > I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the > heap dump show huge objects hold by "org.datanucleus.api.jdo. > JDOPersistenceManagerFactory" as attached. It seems not rele

Is there a bug in hiveserver2 metastore caused hold huge objects

I run hiveserver2 with metastore in mysql. The hiveserver2 OOM and the heap dump show huge objects hold by "org.datanucleus.api.jdo. JDOPersistenceManagerFactory" as attached. It seems not release org.datanucleus.api.jdo.JDOPersistenceManager. Hive version is 0.13. Thanks, Jack