potiuk commented on issue #16982: URL: https://github.com/apache/airflow/issues/16982#issuecomment-1193335348
OK. I finally got into it. The reason is actually very simple as I found out. The patch was supposed to work. BUT your MYSQL version does not support row level locking @tulanowski . You are using MySQL 5.7 and it simply does not have row-locking feature. MySQL 8 is the first version that actually uses "SELECT FOR UPDATE SKIP_LOCKED functionality" and the problem is that this is what is needed to get mini-scheduler and multiple schedulers to work. And likely it might be cause of deadlock whe for example you use backfill in parallel to Airflow. So the solution for you is to upgrade to MySQL 8. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
