andormarkus commented on issue #13824: URL: https://github.com/apache/airflow/issues/13824#issuecomment-1055799980
Hi @rafidka, I'm so sorry, I was looking for this warning in Kubernetes not in CloudWatch. Here are the warning in CloudWatch: <img width="1428" alt="Screen Shot 2022-03-01 at 20 43 43" src="https://user-images.githubusercontent.com/51825189/156237489-b40e4cd1-658c-42f7-ad8e-4b6f0bb4d11f.png";> Here is an exported Log steam. In is very interesting: CloudWatch does not store the log level (info/warning/error), just to log message. ```csv timestamp,message 1646162883080,Dependencies all met for <TaskInstance: simple_dag_1.sleep scheduled__2022-03-01T19:27:00+00:00 [queued]> 1646162883380,Dependencies all met for <TaskInstance: simple_dag_1.sleep scheduled__2022-03-01T19:27:00+00:00 [queued]> 1646162883380," --------------------------------------------------------------------------------" 1646162883380,Starting attempt 1 of 2 1646162883380," --------------------------------------------------------------------------------" 1646162883612,Executing <Task(PythonOperator): sleep> on 2022-03-01 19:27:00+00:00 1646162883618,Started process 163492 to run task 1646162883624,"Running: ['airflow', 'tasks', 'run', 'simple_dag_1', 'sleep', 'scheduled__2022-03-01T19:27:00+00:00', '--job-id', '70863', '--raw', '--subdir', 'DAGS_FOLDER/simple_dag_1.py', '--cfg-path', '/tmp/tmpth9fhum_', '--error-file', '/tmp/tmp4e258sys']" 1646162883625,Job 70863: Subtask sleep 1646162883853,Running <TaskInstance: simple_dag_1.sleep scheduled__2022-03-01T19:27:00+00:00 [running]> on host airflow-worker-58b8d8789b-w7jwv 1646162883926,"Exporting the following env vars: [email protected] AIRFLOW_CTX_DAG_OWNER=airflow AIRFLOW_CTX_DAG_ID=simple_dag_1 AIRFLOW_CTX_TASK_ID=sleep AIRFLOW_CTX_EXECUTION_DATE=2022-03-01T19:27:00+00:00 AIRFLOW_CTX_DAG_RUN_ID=scheduled__2022-03-01T19:27:00+00:00" 1646162903946,Done. Returned value was: True 1646162903969,"Marking task as SUCCESS. dag_id=simple_dag_1, task_id=sleep, execution_date=20220301T192700, start_date=20220301T192803, end_date=20220301T192823" 1646162904149,State of this instance has been externally set to success. Terminating instance. 1646162904152,Received SIGTERM. Terminating subprocesses. 1646162904152,Sending Signals.SIGTERM to group 163492. PIDs of all processes in the group: [163492] 1646162904152,Sending the signal Signals.SIGTERM to group 163492 1646162904292,"Process psutil.Process(pid=163492, status='terminated', exitcode=1, started='19:28:03') (163492) terminated with exit code 1" ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
![https://user-images.githubusercontent.com/51825189/156237489-b40e4cd1-658c-42f7-ad8e-4b6f0bb4d11f.png"](https://user-images.githubusercontent.com/51825189/156237489-b40e4cd1-658c-42f7-ad8e-4b6f0bb4d11f.png"){kind=link}