[
https://issues.apache.org/jira/browse/AIRFLOW-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888680#comment-16888680
]
Mikołaj Morawski commented on AIRFLOW-4593:
-------------------------------------------
I am not having the number of airflow process growing. ( Airflow 1.10.3 on
Docker. )
The only thing I can see is that sometimes I am able to see a few of this
process:
{code:java}
31424 0.0 0.0 0 0 ? Z 04:01 0:00 [airflow] <defunct>
31425 0.0 0.0 0 0 ? Z 04:01 0:00 [airflow] <defunct>
{code}
I think that this defunct processes are related to this:
"{{INFO - Started process (PID=2278) to work on
/usr/local/airflow/dags/hello_world.py" check
([https://github.com/puckel/docker-airflow/issues/403])}}
The
{code:java}
ps -ef | wc -l{code}
command shows stable number of airflow processes. The only thing is that
airflow scheduler is still spawning and killing new processes so the PID number
is changing - increasing all the time, but the number of processes stays on the
same level.
> Memory leak in Airflow scheduler
> --------------------------------
>
> Key: AIRFLOW-4593
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4593
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.10.2
> Reporter: Nikhil SInghal
> Priority: Major
> Attachments: Screenshot 2019-05-30 at 3.19.33 PM.png
>
>
> We are running Apache Airflow on Kubernetes. When I see my Grafana Dashboard
> I see that the memory used is consistently increasing. Can anyone give me
> some pointers for how can I debug this or with existing issues/solutions
> related to this.
> This is a sharp increase in Airflow scheduler and slow increase for worker
> and webserver
> !Screenshot 2019-05-30 at 3.19.33 PM.png|width=100%!
>
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
