GitHub user nesp159de added a comment to the discussion: Deferred operator causing deadlock and Airflow falled down
Thank you for fast response. I am still trying to reproduce the issue with the provided sample, but not succeeded yet. Now I see the same issue from our testing run in Airflow: 2.10.3. The exception is still the same from realy easy task waiting for some external action using deferred infrastructure. Still related to UPDATE task_instance SET state=. Related to your proposals: - Move to postgres: I already tested it because of performance issues, I was a bit surprised it was even slower than mysql. This solution is quite heavy for us because we have currently running app with mysql and introduce new DB engine including setup users + installation will take serious time. - try to disable "schedule_after_task_execution" - which is an often source for deadlock: I will test it. - Airlfow 3 it is far future, maybe our application will be released sooner. GitHub link: https://github.com/apache/airflow/discussions/46069#discussioncomment-11981744 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
