If that doesn't help and you can make a heap dump available via jhat somehow,
I'll take a look.
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back.
- Piet Hein (via Tom White)
--- On Tue, 12/21/10, Jack Levin <[email protected]> wrote:
> From: Jack Levin <[email protected]>
> Subject: Re: rest memory issues
> To: [email protected]
> Date: Tuesday, December 21, 2010, 5:09 PM
> We can, sure... Will let you now if
> it gets better.
>
> -Jack
>
> On Tue, Dec 21, 2010 at 5:05 PM, Ryan Rawson <[email protected]>
> wrote:
> > Try turning off thee incremental mode?
> > On Dec 21, 2010 5:04 PM, "Jack Levin" <[email protected]>
> wrote:
> >> bummer, gc log rolled over... our Xmx:
> >>
> >> root 12774 8.2 1.5 8833008 248832 pts/3 Sl 14:57
> 10:02
> >> /usr/java/jdk1.6.0_12/bin/java -Xmx6000m
> -XX:+UseConcMarkSweepGC
> >> -XX:+CMSIncrementalMode -XX:MaxDirectMemorySize=6G
> -verbose:gc
> >> -XX:+PrintGCDetails -XX:+PrintGCDateStamps
> >> -Xloggc:/usr/lib/hbase/bin/../logs/gc-hbase.log
> >>
> >> I think we are hitting some sort of GC issue.
> >>
> >> -Jack
> >>
> >> On Tue, Dec 21, 2010 at 4:15 PM, Andrew Purtell
> <[email protected]>
> > wrote:
> >>> What is your -Xmx ?
> >>>
> >>> Easiest way to scale is run more REST
> gateways.
> >>>
> >>> Best regards,
> >>>
> >>> - Andy
> >>>
> >>> Problems worthy of attack prove their worth by
> hitting back.
> >>> - Piet Hein (via Tom White)
> >>>
> >>>
> >>> --- On Tue, 12/21/10, Jack Levin <[email protected]>
> wrote:
> >>>
> >>>> From: Jack Levin <[email protected]>
> >>>> Subject: rest memory issues
> >>>> To: [email protected]
> >>>> Date: Tuesday, December 21, 2010, 2:38 PM
> >>>> We are getting those errors in the
> >>>> logs:
> >>>>
> >>>>
> >>>> 12781689 is
> mtag2.prod.imageshack.com:60020
> >>>> 2010-12-21 12:07:51,700 ERROR
> >>>> org.apache.zookeeper.ClientCnxn: from
> >>>>
> 1741604...@qtp-1278414937-4-sendthread(mtag3:2181)
> >>>> java.lang.OutOfMemoryError: GC overhead
> limit exceeded
> >>>> 2010-12-21 12:07:51,701 DEBUG
> >>>> org.apache.hadoop.hbase.rest.RowResource:
> GET
> >>>> Tue Dec 21 12:16:39 PST 2010 Starting rest
> on
> >>>> mtag2.prod.imageshack.com
> >>>>
> >>>> Does anyone know how to scale here?
> >>>>
> >>>> -Jack
> >>>>
> >>>
> >>>
> >>>
> >>>
> >
>