Adam-Leyshon commented on issue #9975: URL: https://github.com/apache/airflow/issues/9975#issuecomment-761028139
This issue is affecting 1.10.14. Upgrading to 2.0 is not possible for us at this time since we have a number of internal blockers on plugins that we wrote that require refactoring. We cleared a DAG run for 2019-01-01 and selected the all future tasks option, Now it want to processes over 200 runs at the same time We did not experience this issue in 1.10.9. Instead it is now trying to run a single task for each of the active runs in parallel instead of waiting for the first run to complete. What I expect to happen is for it to clear the tasks and then complete each run sequentially, our system requires data be loaded in that order, having multiple parallel runs is causing huge issues for us.   ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
