wjddn279 commented on issue #59033: URL: https://github.com/apache/airflow/issues/59033#issuecomment-3615023368
I deployed both the 3.1.3 version image and the 3.1.4rc1 image simultaneously using docker compose to test the following PR https://github.com/apache/airflow/pull/58365, and after running 88,100 tasks over 14 hours, I compared the memory usage per process of the scheduler. As a result, I confirmed that the existing memory usage of 3.9GiB was reduced to 1.6GiB. | airflow:3.1.3 | airflow:3.1.4rc1 | |-------|-------| | <img width="644" height="781" alt="Image" src="https://github.com/user-attachments/assets/4cb2804e-77a5-4060-aa77-8988d745d294"; />|<img width="644" height="781" alt="Image" src="https://github.com/user-attachments/assets/799700ba-80ef-4803-9056-604f500eeafb"; />| ``` CONTAINER ID NAME CPU % MEM USAGE / LIMIT MEM % NET I/O BLOCK I/O PIDS 0a8484d2f548 af_test2-airflow-scheduler-1 0.81% 1.743GiB / 19.49GiB 8.94% 18.8GB / 10.7GB 656MB / 2.35GB 40 5f1ab497195d af_test-airflow-scheduler-1 2.02% 4.047GiB / 19.49GiB 20.76% 22.4GB / 12.1GB 638MB / 9.37GB 40 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
