Re: [EXTERNAL] Re: JVM Heap erratic

2018-07-06 Thread Randy Lynn
ery difficult topic. > This is the kind of gold that a user mailing list can provide. Thank you, > Alain! > > > > > > Sean Durity > > > > *From:* Alain RODRIGUEZ > *Sent:* Tuesday, July 03, 2018 6:37 AM > *To:* user cassandra.apache.org > *Subject:* [EX

RE: [EXTERNAL] Re: JVM Heap erratic

2018-07-03 Thread Durity, Sean R
THIS! A well-reasoned and clear explanation of a very difficult topic. This is the kind of gold that a user mailing list can provide. Thank you, Alain! Sean Durity From: Alain RODRIGUEZ Sent: Tuesday, July 03, 2018 6:37 AM To: user cassandra.apache.org Subject: [EXTERNAL] Re: JVM Heap

Re: JVM Heap erratic

2018-07-03 Thread Alain RODRIGUEZ
Hello Randy, It's normal that the memory in the heap is having this pattern. Java uses memory available and when needed clean some memory for new needs, that's the variation you see. In your case, it's not really regular but this can depend on the workload as well. I'm a C# .NET guy, so I have

Re: JVM Heap erratic

2018-06-28 Thread Elliott Sims
Odd. Your "post-GC" heap level seems a lot lower than your max, which implies that you should be OK with ~10GB. I'm guessing either you're genuinely getting a huge surge in needed heap and running out, or it's falling behind and garbage is building up. If the latter, there might be some

Re: JVM Heap erratic

2018-06-28 Thread Randy Lynn
Thanks for the feedback.. Getting tons of OOM lately.. You mentioned overprovisioned heap size... well... tried 8GB = OOM tried 12GB = OOM tried 20GB w/ G1 = OOM (and long GC pauses usually over 2 secs) tried 20GB w/ CMS = running we're java 8 update 151. 3.11.1. We've got one table that's got

Re: JVM Heap erratic

2018-06-28 Thread Elliott Sims
It depends a bit on which collector you're using, but fairly normal. Heap grows for a while, then the JVM decides via a variety of metrics that it's time to run a collection. G1GC is usually a bit steadier and less sawtooth than the Parallel Mark Sweep , but if your heap's a lot bigger than

JVM Heap erratic

2018-06-28 Thread Randy Lynn
I have datadog monitoring JVM heap. Running 3.11.1. 20GB heap G1 for GC.. all the G1GC settings are out-of-the-box Does this look normal? https://drive.google.com/file/d/1hLMbG53DWv5zNKSY88BmI3Wd0ic_KQ07/view?usp=sharing I'm a C# .NET guy, so I have no idea if this is normal Java behavior.