wjddn279 commented on issue #55768:
URL: https://github.com/apache/airflow/issues/55768#issuecomment-3356590885
Like in @alkismavridis ’s case, I also observed that even though the number
of DAGs is not large and the DAG versions are not continuously increasing, the
scheduler’s memory usage keeps growing. Therefore, I infer that there is
another type of memory leak besides the cause mentioned by kaxil.
When deploying Airflow with LocalExecutor using Docker Compose, I confirmed
that worker processes are created as child processes of the scheduler, and the
allocated memory of both the scheduler and worker processes keeps increasing.
I will continue investigating the root cause, and once I find it, I will
share the details.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
