suhanovv commented on issue #14924:
URL: https://github.com/apache/airflow/issues/14924#issuecomment-912430014


   @potiuk @ashb 
   Firstly, since yesterday's deletion of the logs, memory consumption has 
grown by about 500MB.
   
   Second: my research led me to the following:
   
   Since the processes during this time did not consume more memory, and there 
were no processes in /proc/*/fd that were holding descriptors to the old logs, 
I decided to see what the Container_memory_working_set_bytes metric is actually 
showing -
   "From the cAdvisor code, the working set memory is defined as: The amount of 
working set memory and it includes recently accessed memory, dirty memory, and 
kernel memory. Therefore, Working set is (lesser than or equal to) </ =" usage 
".". After that, I conducted an experiment - with the removal of another day of 
logs with the output of vmstat before and after deletion. As it turned out, 
Container_memory_working_set_bytes - decreased by about 0.7-0.8 GB and in 
vmstat the system cache also decreased by 770 MB. 
   Before
   
![image](https://user-images.githubusercontent.com/3032319/131990110-ee9a0a91-dde7-4714-b3d5-db6430746425.png)
   After
   
![image](https://user-images.githubusercontent.com/3032319/131990200-fddac30d-c89b-4481-8dd8-61d28acc3471.png)
   
   Those. all these logs are stored in the cache, but it remains a mystery why 
they are in the cache for so long, our devops will also look from their side 
why this can happen.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to