Re: GC on TaskManagers stats

2016-02-09 Thread Robert Metzger
Hi Guido, sorry for the late reply. You were collecting the stats every 1 second. Afaik, Flink is internally collecting the stats with a frequency of 5 seconds, so you can either change your or Flink's polling interval (I think its taskmanager.heartbeat-interval) Regarding the details on

GC on TaskManagers stats

2016-02-04 Thread Guido
Hello, I have few questions regarding garbage collector’s stats on Taskmanagers and any help or further documentation would be great. I have collected “1 second polling requesting" stats on 7 Taskmanagers, through the relative request (/taskmanagers//) of the Monitoring REST API while a job,

Re: GC on taskmanagers

2015-03-31 Thread Maximilian Michels
Hi Emmanuel, In Java, the garbage collector will always run periodically. So remotely executing it won't make any difference. If you want to reuse the existing Java process without restarting it, you have to stop the program code from executing which is causing the OutOfMemoryError. Usually,

RE: GC on taskmanagers

2015-03-31 Thread Emmanuel
the OutOfMemoryError, I can't seem to be able to run another job.So the question is: what am I supposed to do to clear the memory after a program failed with this OutOfMemoryError. Thanks From: m...@apache.org Date: Tue, 31 Mar 2015 11:29:30 +0200 Subject: Re: GC on taskmanagers To: user

GC on taskmanagers

2015-03-30 Thread Emmanuel
My Java is still rusty and I often run into OutOfMemoryError: GC overhead exceeded... Yes, I need to look for memory leaks... But first I need to clear up this memory so I can run again without having to shut down and restart everything. I've tried using the jcmd pid GC.run command on eachof the