[
https://issues.apache.org/jira/browse/AIRFLOW-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895509#comment-16895509
]
ASF GitHub Bot commented on AIRFLOW-5035:
-----------------------------------------
ashb commented on pull request #5615: [AIRFLOW-5035] Remove
multiprocessing.Manager in-favour of Pipes
URL: https://github.com/apache/airflow/pull/5615
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Dag parsing process can leave orphan processes under heavy load
> ---------------------------------------------------------------
>
> Key: AIRFLOW-5035
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5035
> Project: Apache Airflow
> Issue Type: Bug
> Components: core
> Affects Versions: 1.10.4
> Reporter: Ash Berlin-Taylor
> Assignee: Ash Berlin-Taylor
> Priority: Blocker
> Fix For: 1.10.4
>
>
> As reported by James Meickle on the mailing list, under certain cases it is
> possible that the multiprocessing.Manager process can end up orphaned when
> the scheduler shuts down.
> This is relating to a new merge in 1.10.4 (i.e. 1.10.3 wasn't affected)
> The "orphan" process is massively exasperated but having a {{--run-duration
> 600}}, but we should try and fix this if we can.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)