msumit commented on PR #63489: URL: https://github.com/apache/airflow/pull/63489#issuecomment-4094892343
We've had the same problem, and we also thought of either directly submitting deferred tasks back to executor queues or skipping concurrency control checks for such tasks in the scheduler. We did the latter one, as it was a quick and small change in comparison to the first one, but we would definitely vote for the first one. Also, I don't think that this is creating a parallel scheduler in any way. It's just bypassing concurrency checks for the tasks that have already passed those checks earlier. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
