Hi Adinata, I had the same issue and have logged a JIRA for this ( https://issues.apache.org/jira/browse/AIRFLOW-401).
Bolke has commented on JIRA to have the issue verified against master branch and it is on my to-do list. Looks like there were a lot of scheduler fixes made since release. I haven't verified this on master yet, if you get a chance to verify, please let us know what you find. The only workaround I found is to set up a process that restarts the scheduler every X minutes although it might not be clean. Also, did you try with Celery Executor? Thanks, Nadeem On Sat, Aug 13, 2016 at 10:38 PM, Adinata <[email protected]> wrote: > Hi all, > > I think I have problem with long running task in LocalExecutor, that make > other scheduler process become defunct. > I'm using airflow 1.7.1.3, and running airflow scheduler -n 20. When it's > on the defunct state, it's unable to schedule any tasks. Do you have any > possible solution? > > Attached the screenshot in this email. > > -- > *Adinata* > Engineer - UrbanIndo.com >
