potiuk commented on issue #19957: URL: https://github.com/apache/airflow/issues/19957#issuecomment-1003544607
To bump it up - Just let us know @stablum @AmarEL if disabling mini-scheduler works. I **think** this might be causesd by the mini-scheduler in the task deadlocking with the "actual" scheduler trying to lock the same rows in a different order. But I think before we attempt to analyse it in detail and fix it - since you have easily reproducible and repeatable case, disable the mini-scheduler it and see if it helps. If It does, it will help us to narrow down the reason and possibly fix it. The only drawback of disabling the mini-scheduler is potentially slightly longer latency in scheduling subsequent tasks in the same dag. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
