ElXaxe opened a new issue, #46898: URL: https://github.com/apache/airflow/issues/46898
### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.9.2 ### What happened? Hi, I have a DAG in production in AWS MWAA that is called by a AWS Lambda after creating a CSV file with infor received by AWS SQS. Lamda passes the file name as a DAG param. **_max_active_runs_** is set to 1, as I need to process every file in order. E.g.: create hierarchy 205, delete hierarchy 205, create hierarchy 206, create hierarchy 207, delete hierarchy 206, etc. Yesterdey, we received 200 petitions in a small range of time, so there were a lot of runs queued. From this amount of queued runs of the DAG, some were executed without respecting the FIFO order. Next tables show some of the latest runs, in descending queued order. I marked the start dates with bold and italic the ones that started when they shouldn't. |Logical Date|Run Id|Queued At|Start Date|End Date| |------------|------|---------|----------|--------| |2025-02-18, 19:02:59|manual__2025-02-18T18:02:59+00:00|2025-02-18, 19:02:59|2025-02-18, 19:58:51|2025-02-18, 20:00:04| |2025-02-18, 19:02:52|manual__2025-02-18T18:02:52+00:00|2025-02-18, 19:02:52|2025-02-18, 19:58:18|2025-02-18, 19:58:50| |2025-02-18, 19:02:33|manual__2025-02-18T18:02:33+00:00|2025-02-18, 19:02:33|2025-02-18, 19:57:00|2025-02-18, 19:58:17| |2025-02-18, 19:02:28|manual__2025-02-18T18:02:28+00:00|2025-02-18, 19:02:28|2025-02-18, 19:56:24|2025-02-18, 19:56:59| |2025-02-18, 19:01:28|manual__2025-02-18T18:01:28+00:00|2025-02-18, 19:01:28|2025-02-18, 19:54:06|2025-02-18, 19:56:23| |2025-02-18, 19:01:18|manual__2025-02-18T18:01:18+00:00|2025-02-18, 19:01:18|2025-02-18, 19:53:32|2025-02-18, 19:54:05| |2025-02-18, 19:00:32|manual__2025-02-18T18:00:32+00:00|2025-02-18, 19:00:32|2025-02-18, 19:52:19|2025-02-18, 19:53:32| |2025-02-18, 19:00:27|manual__2025-02-18T18:00:27+00:00|2025-02-18, 19:00:27|2025-02-18, 19:51:45|2025-02-18, 19:52:18| |2025-02-18, 18:59:54|manual__2025-02-18T17:59:54+00:00|2025-02-18, 18:59:54|2025-02-18, 19:50:34|2025-02-18, 19:51:45| |2025-02-18, 18:59:46|manual__2025-02-18T17:59:46+00:00|2025-02-18, 18:59:46|2025-02-18, 19:49:54|2025-02-18, 19:50:33| |2025-02-18, 18:59:28|manual__2025-02-18T17:59:28+00:00|2025-02-18, 18:59:28|2025-02-18, 19:48:42|2025-02-18, 19:49:54| |2025-02-18, 18:59:19|manual__2025-02-18T17:59:19+00:00|2025-02-18, 18:59:19|2025-02-18, 19:48:11|2025-02-18, 19:48:42| |2025-02-18, 18:58:51|manual__2025-02-18T17:58:51+00:00|2025-02-18, 18:58:51|2025-02-18, 19:46:55|2025-02-18, 19:48:11| |2025-02-18, 18:58:46|manual__2025-02-18T17:58:46+00:00|2025-02-18, 18:58:46|**_2025-02-18, 19:27:51_**|2025-02-18, 19:28:56| |2025-02-18, 18:58:17|manual__2025-02-18T17:58:17+00:00|2025-02-18, 18:58:17|2025-02-18, 19:45:44|2025-02-18, 19:46:55| |2025-02-18, 18:58:12|manual__2025-02-18T17:58:12+00:00|2025-02-18, 18:58:12|2025-02-18, 19:45:11|2025-02-18, 19:45:43| |2025-02-18, 18:57:58|manual__2025-02-18T17:57:58+00:00|2025-02-18, 18:57:58|2025-02-18, 19:43:59|2025-02-18, 19:45:10| |2025-02-18, 18:57:50|manual__2025-02-18T17:57:50+00:00|2025-02-18, 18:57:50|2025-02-18, 19:43:24|2025-02-18, 19:43:59| |2025-02-18, 18:57:33|manual__2025-02-18T17:57:33+00:00|2025-02-18, 18:57:33|2025-02-18, 19:42:11|2025-02-18, 19:43:24| |2025-02-18, 18:57:27|manual__2025-02-18T17:57:27+00:00|2025-02-18, 18:57:28|2025-02-18, 19:41:34|2025-02-18, 19:42:10| |2025-02-18, 18:57:03|manual__2025-02-18T17:57:03+00:00|2025-02-18, 18:57:03|2025-02-18, 19:40:23|2025-02-18, 19:41:34| |2025-02-18, 18:56:56|manual__2025-02-18T17:56:56+00:00|2025-02-18, 18:56:56|2025-02-18, 19:39:48|2025-02-18, 19:40:22| |2025-02-18, 18:56:34|manual__2025-02-18T17:56:34+00:00|2025-02-18, 18:56:34|2025-02-18, 19:38:39|2025-02-18, 19:39:47| |2025-02-18, 18:56:27|manual__2025-02-18T17:56:27+00:00|2025-02-18, 18:56:27|2025-02-18, 19:38:06|2025-02-18, 19:38:39| |2025-02-18, 18:51:32|manual__2025-02-18T17:51:32+00:00|2025-02-18, 18:51:32|2025-02-18, 19:36:52|2025-02-18, 19:38:06| |2025-02-18, 18:51:27|manual__2025-02-18T17:51:27+00:00|2025-02-18, 18:51:27|2025-02-18, 19:36:19|2025-02-18, 19:36:52| |2025-02-18, 18:51:05|manual__2025-02-18T17:51:05+00:00|2025-02-18, 18:51:05|_**2025-02-18, 19:16:06**_|2025-02-18, 19:18:34| |2025-02-18, 18:50:59|manual__2025-02-18T17:50:59+00:00|2025-02-18, 18:50:59|2025-02-18, 19:35:46|2025-02-18, 19:36:19| |2025-02-18, 18:50:38|manual__2025-02-18T17:50:38+00:00|2025-02-18, 18:50:38|2025-02-18, 19:34:37|2025-02-18, 19:35:45| |2025-02-18, 18:50:31|manual__2025-02-18T17:50:31+00:00|2025-02-18, 18:50:31|2025-02-18, 19:34:03|2025-02-18, 19:34:36| |2025-02-18, 18:50:04|manual__2025-02-18T17:50:04+00:00|2025-02-18, 18:50:04|2025-02-18, 19:32:46|2025-02-18, 19:34:02| |2025-02-18, 18:49:56|manual__2025-02-18T17:49:56+00:00|2025-02-18, 18:49:56|2025-02-18, 19:32:11|2025-02-18, 19:32:45| |2025-02-18, 18:49:27|manual__2025-02-18T17:49:27+00:00|2025-02-18, 18:49:27|2025-02-18, 19:30:24|2025-02-18, 19:32:11| |2025-02-18, 18:49:19|manual__2025-02-18T17:49:19+00:00|2025-02-18, 18:49:19|2025-02-18, 19:29:40|2025-02-18, 19:30:24| |2025-02-18, 18:48:49|manual__2025-02-18T17:48:49+00:00|2025-02-18, 18:48:49|2025-02-18, 19:27:51|2025-02-18, 19:29:40| |2025-02-18, 18:48:43|manual__2025-02-18T17:48:43+00:00|2025-02-18, 18:48:43|2025-02-18, 19:27:16|2025-02-18, 19:27:50| |2025-02-18, 18:48:13|manual__2025-02-18T17:48:13+00:00|2025-02-18, 18:48:13|2025-02-18, 19:26:04|2025-02-18, 19:27:15| |2025-02-18, 18:48:07|manual__2025-02-18T17:48:07+00:00|2025-02-18, 18:48:07|2025-02-18, 19:25:32|2025-02-18, 19:26:04| |2025-02-18, 18:39:45|manual__2025-02-18T17:39:45+00:00|2025-02-18, 18:39:45|2025-02-18, 19:24:18|2025-02-18, 19:25:32| |2025-02-18, 18:39:39|manual__2025-02-18T17:39:39+00:00|2025-02-18, 18:39:39|2025-02-18, 19:23:43|2025-02-18, 19:24:18| |2025-02-18, 18:39:20|manual__2025-02-18T17:39:20+00:00|2025-02-18, 18:39:20|2025-02-18, 19:22:38|2025-02-18, 19:23:43| |2025-02-18, 18:39:14|manual__2025-02-18T17:39:14+00:00|2025-02-18, 18:39:14|2025-02-18, 19:22:04|2025-02-18, 19:22:37| |2025-02-18, 18:38:47|manual__2025-02-18T17:38:47+00:00|2025-02-18, 18:38:47|2025-02-18, 19:20:50|2025-02-18, 19:22:03| |2025-02-18, 18:38:42|manual__2025-02-18T17:38:42+00:00|2025-02-18, 18:38:42|2025-02-18, 19:20:18|2025-02-18, 19:20:50| |2025-02-18, 18:38:23|manual__2025-02-18T17:38:23+00:00|2025-02-18, 18:38:23|2025-02-18, 19:19:09|2025-02-18, 19:20:18| |2025-02-18, 18:38:17|manual__2025-02-18T17:38:17+00:00|2025-02-18, 18:38:17|2025-02-18, 19:18:35|2025-02-18, 19:19:09| |2025-02-18, 18:37:52|manual__2025-02-18T17:37:52+00:00|2025-02-18, 18:37:52|2025-02-18, 19:16:06|2025-02-18, 19:18:34| |2025-02-18, 18:37:47|manual__2025-02-18T17:37:47+00:00|2025-02-18, 18:37:47|2025-02-18, 19:15:33|2025-02-18, 19:16:05| |2025-02-18, 18:37:31|manual__2025-02-18T17:37:31+00:00|2025-02-18, 18:37:31|2025-02-18, 19:14:19|2025-02-18, 19:15:32| |2025-02-18, 18:37:25|manual__2025-02-18T17:37:25+00:00|2025-02-18, 18:37:25|2025-02-18, 19:13:38|2025-02-18, 19:14:19| |2025-02-18, 18:37:03|manual__2025-02-18T17:37:03+00:00|2025-02-18, 18:37:03|2025-02-18, 19:11:51|2025-02-18, 19:13:38| |2025-02-18, 18:36:57|manual__2025-02-18T17:36:57+00:00|2025-02-18, 18:36:57|2025-02-18, 19:11:18|2025-02-18, 19:11:50| |2025-02-18, 18:36:33|manual__2025-02-18T17:36:33+00:00|2025-02-18, 18:36:33|2025-02-18, 19:10:07|2025-02-18, 19:11:17| |2025-02-18, 18:36:28|manual__2025-02-18T17:36:28+00:00|2025-02-18, 18:36:28|2025-02-18, 19:09:32|2025-02-18, 19:10:07| |2025-02-18, 18:36:04|manual__2025-02-18T17:36:04+00:00|2025-02-18, 18:36:04|2025-02-18, 19:08:17|2025-02-18, 19:09:31| |2025-02-18, 18:35:58|manual__2025-02-18T17:35:58+00:00|2025-02-18, 18:35:58|2025-02-18, 19:07:38|2025-02-18, 19:08:17| |2025-02-18, 18:35:23|manual__2025-02-18T17:35:23+00:00|2025-02-18, 18:35:23|2025-02-18, 19:05:10|2025-02-18, 19:07:38| |2025-02-18, 18:35:17|manual__2025-02-18T17:35:17+00:00|2025-02-18, 18:35:17|2025-02-18, 19:04:37|2025-02-18, 19:05:09| |2025-02-18, 18:35:03|manual__2025-02-18T17:35:03+00:00|2025-02-18, 18:35:03|**_2025-02-18, 18:44:51_**|2025-02-18, 18:47:20| |2025-02-18, 18:34:57|manual__2025-02-18T17:34:57+00:00|2025-02-18, 18:34:57|2025-02-18, 19:04:04|2025-02-18, 19:04:37| |2025-02-18, 18:34:40|manual__2025-02-18T17:34:40+00:00|2025-02-18, 18:34:40|2025-02-18, 19:02:47|2025-02-18, 19:04:03| |2025-02-18, 18:34:34|manual__2025-02-18T17:34:34+00:00|2025-02-18, 18:34:34|2025-02-18, 19:02:15|2025-02-18, 19:02:47| |2025-02-18, 18:34:15|manual__2025-02-18T17:34:15+00:00|2025-02-18, 18:34:15|2025-02-18, 19:00:38|2025-02-18, 19:02:14| |2025-02-18, 18:34:10|manual__2025-02-18T17:34:10+00:00|2025-02-18, 18:34:10|2025-02-18, 18:59:42|2025-02-18, 19:00:37| |2025-02-18, 18:33:46|manual__2025-02-18T17:33:46+00:00|2025-02-18, 18:33:46|2025-02-18, 18:58:31|2025-02-18, 18:59:41| |2025-02-18, 18:33:40|manual__2025-02-18T17:33:40+00:00|2025-02-18, 18:33:40|2025-02-18, 18:57:53|2025-02-18, 18:58:30| |2025-02-18, 18:33:22|manual__2025-02-18T17:33:22+00:00|2025-02-18, 18:33:22|2025-02-18, 18:56:43|2025-02-18, 18:57:53| |2025-02-18, 18:33:15|manual__2025-02-18T17:33:15+00:00|2025-02-18, 18:33:15|2025-02-18, 18:56:12|2025-02-18, 18:56:43| |2025-02-18, 18:33:04|manual__2025-02-18T17:33:04+00:00|2025-02-18, 18:33:04|2025-02-18, 18:55:01|2025-02-18, 18:56:11| |2025-02-18, 18:32:58|manual__2025-02-18T17:32:58+00:00|2025-02-18, 18:32:58|2025-02-18, 18:54:29|2025-02-18, 18:55:00| |2025-02-18, 18:32:34|manual__2025-02-18T17:32:34+00:00|2025-02-18, 18:32:34|2025-02-18, 18:53:15|2025-02-18, 18:54:29| |2025-02-18, 18:32:29|manual__2025-02-18T17:32:29+00:00|2025-02-18, 18:32:29|2025-02-18, 18:52:39|2025-02-18, 18:53:14| |2025-02-18, 18:32:09|manual__2025-02-18T17:32:09+00:00|2025-02-18, 18:32:09|2025-02-18, 18:51:31|2025-02-18, 18:52:39| |2025-02-18, 18:32:04|manual__2025-02-18T17:32:04+00:00|2025-02-18, 18:32:04|2025-02-18, 18:50:57|2025-02-18, 18:51:30| |2025-02-18, 18:31:45|manual__2025-02-18T17:31:45+00:00|2025-02-18, 18:31:45|2025-02-18, 18:49:44|2025-02-18, 18:50:57| |2025-02-18, 18:31:40|manual__2025-02-18T17:31:40+00:00|2025-02-18, 18:31:40|2025-02-18, 18:49:12|2025-02-18, 18:49:44| |2025-02-18, 18:31:16|manual__2025-02-18T17:31:16+00:00|2025-02-18, 18:31:16|2025-02-18, 18:47:58|2025-02-18, 18:49:12| |2025-02-18, 18:31:12|manual__2025-02-18T17:31:12+00:00|2025-02-18, 18:31:12|2025-02-18, 18:47:21|2025-02-18, 18:47:58| |2025-02-18, 18:30:57|manual__2025-02-18T17:30:57+00:00|2025-02-18, 18:30:57|2025-02-18, 18:44:50|2025-02-18, 18:47:20| |2025-02-18, 18:30:48|manual__2025-02-18T17:30:48+00:00|2025-02-18, 18:30:48|2025-02-18, 18:44:17|2025-02-18, 18:44:50| |2025-02-18, 18:30:30|manual__2025-02-18T17:30:30+00:00|2025-02-18, 18:30:30|2025-02-18, 18:42:22|2025-02-18, 18:44:17| |2025-02-18, 18:30:21|manual__2025-02-18T17:30:21+00:00|2025-02-18, 18:30:21|2025-02-18, 18:41:45|2025-02-18, 18:42:20| |2025-02-18, 18:30:08|manual__2025-02-18T17:30:08+00:00|2025-02-18, 18:30:08|2025-02-18, 18:40:40|2025-02-18, 18:41:45| |2025-02-18, 18:30:02|manual__2025-02-18T17:30:02+00:00|2025-02-18, 18:30:02|2025-02-18, 18:40:07|2025-02-18, 18:40:39| |2025-02-18, 18:29:42|manual__2025-02-18T17:29:42+00:00|2025-02-18, 18:29:42|2025-02-18, 18:38:52|2025-02-18, 18:40:06| |2025-02-18, 18:29:37|manual__2025-02-18T17:29:37+00:00|2025-02-18, 18:29:37|2025-02-18, 18:38:18|2025-02-18, 18:38:52| |2025-02-18, 18:29:11|manual__2025-02-18T17:29:11+00:00|2025-02-18, 18:29:11|2025-02-18, 18:37:05|2025-02-18, 18:38:18| |2025-02-18, 18:29:05|manual__2025-02-18T17:29:05+00:00|2025-02-18, 18:29:05|2025-02-18, 18:35:45|2025-02-18, 18:37:04| |2025-02-18, 18:28:42|manual__2025-02-18T17:28:42+00:00|2025-02-18, 18:28:42|2025-02-18, 18:34:06|2025-02-18, 18:35:44| |2025-02-18, 18:28:37|manual__2025-02-18T17:28:37+00:00|2025-02-18, 18:28:37|2025-02-18, 18:33:32|2025-02-18, 18:34:06| ### What you think should happen instead? _No response_ ### How to reproduce Don't know how. ### Operating System MWAA ### Versions of Apache Airflow Providers _No response_ ### Deployment Amazon (AWS) MWAA ### Deployment details _No response_ ### Anything else? _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
