[
https://issues.apache.org/jira/browse/AIRFLOW-7078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063579#comment-17063579
]
Oleg Korsak commented on AIRFLOW-7078:
--------------------------------------
Same DAG running in 1.10.7:
{noformat}
*** Log file does not exist:
/usr/local/airflow/logs/aaa_test_logging/aaa_test_logging/2020-03-20T18:53:32.597835+00:00/1.log
*** Fetching from:
http://airflow-worker-0.airflow-worker.svc.cluster.local:8793/log/aaa_test_logging/aaa_test_logging/2020-03-20T18:53:32.597835+00:00/1.log[2020-03-20
18:53:41,245] {{taskinstance.py:655}} INFO - Dependencies all met for
<TaskInstance: aaa_test_logging.aaa_test_logging
2020-03-20T18:53:32.597835+00:00 [queued]>
[2020-03-20 18:53:41,262] {{taskinstance.py:655}} INFO - Dependencies all met
for <TaskInstance: aaa_test_logging.aaa_test_logging
2020-03-20T18:53:32.597835+00:00 [queued]>
[2020-03-20 18:53:41,262] {{taskinstance.py:866}} INFO -
--------------------------------------------------------------------------------
[2020-03-20 18:53:41,262] {{taskinstance.py:867}} INFO - Starting attempt 1 of 4
[2020-03-20 18:53:41,263] {{taskinstance.py:868}} INFO -
--------------------------------------------------------------------------------
[2020-03-20 18:53:41,276] {{taskinstance.py:887}} INFO - Executing
<Task(PythonOperator): aaa_test_logging> on 2020-03-20T18:53:32.597835+00:00
[2020-03-20 18:53:41,279] {{standard_task_runner.py:52}} INFO - Started process
97 to run task
[2020-03-20 18:53:41,347] {{logging_mixin.py:112}} INFO - Running %s on host %s
<TaskInstance: aaa_test_logging.aaa_test_logging
2020-03-20T18:53:32.597835+00:00 [running]>
airflow-worker-0.airflow-worker.svc.cluster.local
[2020-03-20 18:53:41,373] {{python_operator.py:105}} INFO - Exporting the
following env vars:
[email protected]
AIRFLOW_CTX_DAG_OWNER=airflow
AIRFLOW_CTX_DAG_ID=aaa_test_logging
AIRFLOW_CTX_TASK_ID=aaa_test_logging
AIRFLOW_CTX_EXECUTION_DATE=2020-03-20T18:53:32.597835+00:00
AIRFLOW_CTX_DAG_RUN_ID=manual__2020-03-20T18:53:32.597835+00:00
[2020-03-20 18:53:41,373] {{logging_mixin.py:112}} INFO - 2020-03-20
18:53:41,373 [INFO] PID=97:TID=140024320354112
unusual_prefix_d10a2b072eae7440d844f0a89f859c97e2e8e18b_aaa_test_logging.aaa_test_logging:56:
aaa_test_logging START before sleep
[2020-03-20 18:58:41,473] {{logging_mixin.py:112}} INFO - 2020-03-20
18:58:41,473 [INFO] PID=97:TID=140024320354112
unusual_prefix_d10a2b072eae7440d844f0a89f859c97e2e8e18b_aaa_test_logging.aaa_test_logging:58:
aaa_test_logging END after sleep
[2020-03-20 18:58:41,474] {{python_operator.py:114}} INFO - Done. Returned
value was: None{noformat}
> logger / print gets overwritten with custom Operator after version upgrade
> --------------------------------------------------------------------------
>
> Key: AIRFLOW-7078
> URL: https://issues.apache.org/jira/browse/AIRFLOW-7078
> Project: Apache Airflow
> Issue Type: Bug
> Components: logging
> Affects Versions: 1.10.9
> Reporter: seth
> Priority: Major
> Attachments: airflow_post.PNG, airflow_pre.PNG
>
>
> Hi, I have customized `AWSAthenaOperator` to both log the executed query, and
> log the query_id.
> I am using a simple print statement, which should be logged as INFO by the
> logger
> After upgrade to airflow==1.10.9 these logs are not persisted anymore, and in
> fact seems to be overwritten.
> I'm attaching 2 screenshots, 1 of the log output while the task is still
> running. As you can see, the expected output is present in the logs.
> The 2nd, the log is taken after the task has completed successfully .
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
