whitleykeith commented on issue #23361: URL: https://github.com/apache/airflow/issues/23361#issuecomment-1168991129
Having this issue as well, we're only on 2.0.2. Looking through some of the Airflow configs I'm wondering if it could be related to the [file_parsing_sort_mode](https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#file-parsing-sort-mode)? It seems like the default behavior could cause the schedulers to always start at the same place when parsing dag files, and I could see that causing a deadlock at scale. This option doesn't seem to be availble in our version, does someone want to try it out for us 😃 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
