zachliu commented on issue #16163:
URL: https://github.com/apache/airflow/issues/16163#issuecomment-1331206378
just in case someone is on the same boat:
this behavior can also cause your logs to look funny because when the 2nd
worker picked up the task after the `visibility_timeout` (6 hours), it can only
get the the logs starting from the 7th hour, all previous logs obtained by the
1st work are gone
```
[2022-11-10, 06:30:22 EST] {{taskinstance.py:1155}} INFO - Dependencies not
met for <TaskInstance: my_dag.my_task scheduled__2022-11-09T05:30:00+00:00
[running]>, dependency 'Task Instance Not Running' FAILED: Task is in the
running state
[2022-11-10, 06:30:22 EST] {{taskinstance.py:1155}} INFO - Dependencies not
met for <TaskInstance: my_dag.my_task scheduled__2022-11-09T05:30:00+00:00
[running]>, dependency 'Task Instance State' FAILED: Task is in the 'running'
state.
[2022-11-10, 06:30:22 EST] {{local_task_job.py:103}} INFO - Task is not able
to be run
[2022-11-10, 06:30:50 EST] {{ecs.py:154}} INFO - [2022-11-10 11:30:36,655]
{<LOGS STARTING FROM THE 7th HOUR>}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]