ashb commented on issue #23107:
URL: https://github.com/apache/airflow/issues/23107#issuecomment-1103574418
Curious, something is up with the zombie detection too:
```[2022-04-20 08:42:36,843] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1360}} WARNING -
Failing (3) jobs without heartbeat after 2022-04-20 07:37:36.841761+00:00
[2022-04-20 08:42:36,844] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=2
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b5ebc0>,
'is_failure_callback': True}
[2022-04-20 08:42:36,844] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=1
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088c1cd60>,
'is_failure_callback': True}
[2022-04-20 08:42:36,844] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=0
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b7e320>,
'is_failure_callback': True}
[2022-04-20 08:42:46,880] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1360}} WARNING -
Failing (3) jobs without heartbeat after 2022-04-20 07:37:46.878339+00:00
[2022-04-20 08:42:46,881] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=2
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b8bd30>,
'is_failure_callback': True}
[2022-04-20 08:42:46,881] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=1
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b7b8e0>,
'is_failure_callback': True}
[2022-04-20 08:42:46,881] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=0
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b5ebc0>,
'is_failure_callback': True}
[2022-04-20 08:42:49 +0100] [331200] [INFO] Handling signal: winch
[2022-04-20 08:42:56,915] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1360}} WARNING -
Failing (3) jobs without heartbeat after 2022-04-20 07:37:56.912725+00:00
[2022-04-20 08:42:56,915] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=2
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b5d6f0>,
'is_failure_callback': True}
[2022-04-20 08:42:56,915] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=1
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b7e320>,
'is_failure_callback': True}
[2022-04-20 08:42:56,915] 331186 MainProcess
{{airflow.jobs.scheduler_job.SchedulerJob scheduler_job.py:1368}} ERROR -
Detected zombie job: {'full_filepath':
'/home/ash/code/airflow/airflow/kpodag.py', 'msg': 'Detected <TaskInstance:
kpo_mapped.cowsay_mapped manual__2022-04-20T07:42:30.995741+00:00 map_index=0
[running]> as zombie', 'simple_task_instance':
<airflow.models.taskinstance.SimpleTaskInstance object at 0x7f6088b7f460>,
'is_failure_callback': True}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
