KevinYang21 commented on issue #5079: [AIRFLOW-4285] Update task dependency context defination and usage URL: https://github.com/apache/airflow/pull/5079#issuecomment-561905372 Thanks @ashb for clarifying! I'll do a quick deep dive later today on this. From what you described, my understanding is that basically our problem came from [how we sort the queued tasks when triggering](https://github.com/apache/airflow/blob/master/airflow/executors/base_executor.py#L159-L162). So when we trigger tasks we always let those upstream tasks to take over the open slots and leave the downstream tasks in the queue_tasks. I think the one-line fix you had is needed logically but I'm not 100% sure if that is solving the root cause for us. In fact the behavior strikes me as expected, since we don'g really set priority on those tasks. All above is my hypothesis, I'll validate when I got a charger for my laptop--docker burns out battery too fast...
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
