Ash Berlin-Taylor created AIRFLOW-5035:
------------------------------------------

             Summary: Dag parsing process can leave orphan processes under 
heavy load
                 Key: AIRFLOW-5035
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5035
             Project: Apache Airflow
          Issue Type: Bug
          Components: core
    Affects Versions: 1.10.4
            Reporter: Ash Berlin-Taylor
            Assignee: Ash Berlin-Taylor
             Fix For: 1.10.4


As reported by James Meickle on the mailing list, under certain cases it is 
possible that the multiprocessing.Manager process can end up orphaned when the 
scheduler shuts down.

This is relating to a new merge in 1.10.4 (i.e. 1.10.3 wasn't affected)

The "orphan" process is massively exasperated but having a {{--run-duration 
600}}, but we should try and fix this if we can.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to