potiuk commented on issue #34013: URL: https://github.com/apache/airflow/issues/34013#issuecomment-2015639112
No. I do not see anyone working on it nor providing a solution. But the log above suggests that this is caused by so called "mini scheduler" which is enabled by this configuration https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#schedule-after-task-execution - likely disabling it will mitigate the problem (at the expense of slightly increased latency between tasks. Can everyone in this thread make an experiment, disable it and report back here - at least this will give some clue on where the problems might happen. cc: @kaxil @ephraimbuddy -> problems similar to that one keep on appearing, I think there is some kind of deadlock/resource contention with mini scheduler in some specific cases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
