widewing edited a comment on issue #18487: URL: https://github.com/apache/airflow/issues/18487#issuecomment-937543884
I'm having the exactly same issue in the latest version, it breaks many of our DAGs that rely on the catchup setting. We have DAGs scheduled every minute, most of them should finish within 1 minute, but sometimes it could exceed, e.g. network issue, external service slow, etc. When this happen, it will cumulate the DagRuns that we don't expect. We have internal backfill mechanism already. The [document](https://airflow.apache.org/docs/apache-airflow/stable/dag-run.html) said "Turning catchup off is great if your DAG performs catchup internally." in section "catchup" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
