rinzool commented on issue #28740: URL: https://github.com/apache/airflow/issues/28740#issuecomment-2314575437
Hi, If it may help someone, I faced the same issue, my scheduler memory increased from 600MB to 1.3GB in 4 days (the `container_memory_working_set_bytes` precisely). Using Airflow 2.10.0 and chart 1.15.0.  I tried a lot of things (exploring process using `ps` and `htop`), cleaning logs manually, etc. nothing worked. After re-re-re-reading the last message from @potiuk I focused on: > Does ite eventually cause your containers to crash with OOM (Out of Memory) or does the memory clears itself out when needed? So I added a memory limit to see if the pod goes OOM or not ```yaml scheduler: resources: requests: memory: 500Mi limits: memory: 1Gi ``` Here is the result:  No OOM, the pod clears itself when it is too close to the limit. Hope this message can help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
