Since it's a stop the world activity, it's supposed to finish as soon as
possible. it's parallel marking phase, so 23 threads (which is picked by
JVM) should be fine. I don't have any other apps running on this machine.
Spark is working perfectly fine except for one job, The eden size (8G) is
also
I'm not a GC tuning expert, but 23 GC threads sounds like a lot (?). Turn
that down maybe.
What are your actual heap region sizes, from -verbose:gc?
This kind of sounds like the young generation is too ... large I think? not
sure.
None of this is particularly Spark related, but maybe some ideas wi
it's a VM, but it has 16 cores and 32 processors.
-Kohki
On Mon, Nov 15, 2021 at 12:53 AM Deepak Goel wrote:
> How many 'hardware threads' do you have?
>
>
> Deepak
> "The greatness of a nation can be judged by the way its animals are
> treated - Mahatma Gandhi"
>
> +91 73500 12833
> deic...@gm
How many 'hardware threads' do you have?
Deepak
"The greatness of a nation can be judged by the way its animals are treated
- Mahatma Gandhi"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
Make In Ind
Hello, I'm seeing continuous long pauses (>5s) while running a job in Spark
(3.1.2). I'm using G1GC but every GC(young) takes around 5 seconds and it
happens continuously, anybody has seen anything like that ? Thanks
2021-11-14T05:03:11.084+: 372441.741: [GC pause (G1 Evacuation Pause)
(y
