[
https://issues.apache.org/jira/browse/AIRFLOW-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092345#comment-17092345
]
ASF GitHub Bot commented on AIRFLOW-6874:
-----------------------------------------
stale[bot] commented on pull request #7498:
URL: https://github.com/apache/airflow/pull/7498#issuecomment-619434349
This issue has been automatically marked as stale because it has not had
recent activity. It will be closed if no further activity occurs. Thank you for
your contributions.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> There are risks that subprocesses not killed when a task failed
> ---------------------------------------------------------------
>
> Key: AIRFLOW-6874
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6874
> Project: Apache Airflow
> Issue Type: Improvement
> Components: worker
> Affects Versions: 1.10.4
> Reporter: Yingbo Wang
> Assignee: Yingbo Wang
> Priority: Major
>
> Many airflow tasks create subprocesses and these subprocesses may create more
> subprocesses. In our experience, there is a risk that although a task failed
> and tried to reap the process group, there are still left over processes
> running and cause issues with both resources and correctness.
> Propose to improve the cgroup task runner to reap all processes for current
> node on node termination.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
