Ash Berlin-Taylor created AIRFLOW-5035:
------------------------------------------
Summary: Dag parsing process can leave orphan processes under
heavy load
Key: AIRFLOW-5035
URL: https://issues.apache.org/jira/browse/AIRFLOW-5035
Project: Apache Airflow
Issue Type: Bug
Components: core
Affects Versions: 1.10.4
Reporter: Ash Berlin-Taylor
Assignee: Ash Berlin-Taylor
Fix For: 1.10.4
As reported by James Meickle on the mailing list, under certain cases it is
possible that the multiprocessing.Manager process can end up orphaned when the
scheduler shuts down.
This is relating to a new merge in 1.10.4 (i.e. 1.10.3 wasn't affected)
The "orphan" process is massively exasperated but having a {{--run-duration
600}}, but we should try and fix this if we can.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)