Re: Memory Logging

Hi Oliver, which Flink image are you using? If you are using the docker image from docker hub [1], then the memory logging will go to stdout and not to a log file. The reason for this behavior is that the docker image configures the logger to print to stdout such that one can easily access

Memory Logging

Hi everyone, We are using a simple Flink setup with one jobmanager and one taskmanager running inside a docker container. We are having issues enabling the *taskmanager.debug.memory.startLogThread *setting. We added *taskmanager.debug.memory.startLogThread: true*

Re: Using memory logging in Flink

Hi Filip! Someone else just used the memory logging with the exact described settings - it worked. There is probably some mixup, you may be looking into the wrong log file, or may setting the a value in a different config... Stephan On Wed, Dec 9, 2015 at 10:58 AM, Till Rohrmann <tro

Re: Using memory logging in Flink

I assume you're looking in the taskmanager log file for the memory usage logging statements, right? Cheers, Till On Wed, Dec 9, 2015 at 12:15 AM, Filip Łęczycki wrote: > Hi, > > Thank you for your reply! > > I have made sure I restarted the TaskManager after changing

Re: Using memory logging in Flink

regards, Filip Łęczycki Pozdrawiam, Filip Łęczycki 2015-12-09 11:13 GMT+01:00 Stephan Ewen <se...@apache.org>: > Hi Filip! > > Someone else just used the memory logging with the exact described > settings - it worked. > > There is probably some mixup, you may be looking

Using memory logging in Flink

Hi, I am trying to enable logging of memory usage on flink 0.10.0 by adding: taskmanager.debug.memory.startLogThread: true to config.yaml and setting log4j level to DEBUG however in the logs after running the job I cannot see any info regarding memory usage.My job lasted 30s so it should catch

Re: Using memory logging in Flink

Hi! That is exactly the right way to do it. Logging has to be at least INFO and the parameter "taskmanager.debug.memory.startLogThread" set to true. The log output should be under "org.apache.flink.runtime.taskmanager.TaskManager". Do you see other outputs for that class in the log? Make sure

Re: Using memory logging in Flink

Hi, Thank you for your reply! I have made sure I restarted the TaskManager after changing config, but it didn't resolve the issue.The config is loaded as I can see the following line in the log: 09:12:2015 00:00:21,894 DEBUG org.apache.flink.configuration.GlobalConfiguration- Loading