potiuk commented on issue #14924: URL: https://github.com/apache/airflow/issues/14924#issuecomment-914143098
So I guess the quest continues. Hmm. Interesting one that it wen't down indeed after some time. If that's the cache then this would be strange to have `container_memory_working_set_bytes` (I presume the graph above is this?). I have another hypothesis. Linux Kernel also has "dentries" and "inode" caches - it keeps in memory the used/opened directory structure and file node information. And I believe those caches would also be cleared whenever the log files are deleted. If this is a cache, you can very easily check it - you can force cleaning the cache and see the results: Cleaning just PageCache: ``` sync; echo 1 > /proc/sys/vm/drop_caches ``` Cleaning dentries and indoes: ``` sync; echo 2 > /proc/sys/vm/drop_caches ``` Can you make such experiment please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
