Ruimeng Shi created AIRFLOW-7030:
------------------------------------
Summary: No subprocess logging for LocalExecutor on webserver
Key: AIRFLOW-7030
URL: https://issues.apache.org/jira/browse/AIRFLOW-7030
Project: Apache Airflow
Issue Type: Bug
Components: logging
Affects Versions: 1.10.7
Reporter: Ruimeng Shi
I found this bug when upgrading from 1.10.6 to 1.10.7.
My local environment is running a airflow webserver + airflow scheduler with
local executor. I have a python operator that starts a subprocess within it. In
Airflow 1.10.6, I can see the subprocess stdout logs in webserver logs,
however, when upgrading to 1.10.7, they are gone.
After some digging around, I found that this PR
[https://github.com/apache/airflow/pull/6627] changes the way the subprocess is
spawned. The new way (forking) seems to not handle the log streams, thus
causing the logs missing in webserver. After I change the code to always create
a subprocess without fork (old way), the logs come right back.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
