[ https://issues.apache.org/jira/browse/AIRFLOW-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063579#comment-17063579 ]
Oleg Korsak commented on AIRFLOW-7078: -------------------------------------- Same DAG running in 1.10.7: {noformat} *** Log file does not exist: /usr/local/airflow/logs/aaa_test_logging/aaa_test_logging/2020-03-20T18:53:32.597835+00:00/1.log *** Fetching from: http://airflow-worker-0.airflow-worker.svc.cluster.local:8793/log/aaa_test_logging/aaa_test_logging/2020-03-20T18:53:32.597835+00:00/1.log[2020-03-20 18:53:41,245] {{taskinstance.py:655}} INFO - Dependencies all met for <TaskInstance: aaa_test_logging.aaa_test_logging 2020-03-20T18:53:32.597835+00:00 [queued]> [2020-03-20 18:53:41,262] {{taskinstance.py:655}} INFO - Dependencies all met for <TaskInstance: aaa_test_logging.aaa_test_logging 2020-03-20T18:53:32.597835+00:00 [queued]> [2020-03-20 18:53:41,262] {{taskinstance.py:866}} INFO - -------------------------------------------------------------------------------- [2020-03-20 18:53:41,262] {{taskinstance.py:867}} INFO - Starting attempt 1 of 4 [2020-03-20 18:53:41,263] {{taskinstance.py:868}} INFO - -------------------------------------------------------------------------------- [2020-03-20 18:53:41,276] {{taskinstance.py:887}} INFO - Executing <Task(PythonOperator): aaa_test_logging> on 2020-03-20T18:53:32.597835+00:00 [2020-03-20 18:53:41,279] {{standard_task_runner.py:52}} INFO - Started process 97 to run task [2020-03-20 18:53:41,347] {{logging_mixin.py:112}} INFO - Running %s on host %s <TaskInstance: aaa_test_logging.aaa_test_logging 2020-03-20T18:53:32.597835+00:00 [running]> airflow-worker-0.airflow-worker.svc.cluster.local [2020-03-20 18:53:41,373] {{python_operator.py:105}} INFO - Exporting the following env vars: AIRFLOW_CTX_DAG_EMAIL=okors...@magic.com AIRFLOW_CTX_DAG_OWNER=airflow AIRFLOW_CTX_DAG_ID=aaa_test_logging AIRFLOW_CTX_TASK_ID=aaa_test_logging AIRFLOW_CTX_EXECUTION_DATE=2020-03-20T18:53:32.597835+00:00 AIRFLOW_CTX_DAG_RUN_ID=manual__2020-03-20T18:53:32.597835+00:00 [2020-03-20 18:53:41,373] {{logging_mixin.py:112}} INFO - 2020-03-20 18:53:41,373 [INFO] PID=97:TID=140024320354112 unusual_prefix_d10a2b072eae7440d844f0a89f859c97e2e8e18b_aaa_test_logging.aaa_test_logging:56: aaa_test_logging START before sleep [2020-03-20 18:58:41,473] {{logging_mixin.py:112}} INFO - 2020-03-20 18:58:41,473 [INFO] PID=97:TID=140024320354112 unusual_prefix_d10a2b072eae7440d844f0a89f859c97e2e8e18b_aaa_test_logging.aaa_test_logging:58: aaa_test_logging END after sleep [2020-03-20 18:58:41,474] {{python_operator.py:114}} INFO - Done. Returned value was: None{noformat} > logger / print gets overwritten with custom Operator after version upgrade > -------------------------------------------------------------------------- > > Key: AIRFLOW-7078 > URL: https://issues.apache.org/jira/browse/AIRFLOW-7078 > Project: Apache Airflow > Issue Type: Bug > Components: logging > Affects Versions: 1.10.9 > Reporter: seth > Priority: Major > Attachments: airflow_post.PNG, airflow_pre.PNG > > > Hi, I have customized `AWSAthenaOperator` to both log the executed query, and > log the query_id. > I am using a simple print statement, which should be logged as INFO by the > logger > After upgrade to airflow==1.10.9 these logs are not persisted anymore, and in > fact seems to be overwritten. > I'm attaching 2 screenshots, 1 of the log output while the task is still > running. As you can see, the expected output is present in the logs. > The 2nd, the log is taken after the task has completed successfully . -- This message was sent by Atlassian Jira (v8.3.4#803005)