ashb commented on a change in pull request #15046:
URL: https://github.com/apache/airflow/pull/15046#discussion_r603177507
##########
File path: airflow/config_templates/config.yml
##########
@@ -1834,6 +1834,22 @@
type: string
example: ~
default: "2"
+ - name: file_parsing_sort_mode
+ description: |
+ One of ``modified_time``, ``random_seeded_by_host`` and
``alphabetical``.
+ The scheduler will list and sort the dag files to decide the parsing
order.
+
+ * ``modified_time``: Sort by modified time of the files. This is
useful on large scale to parse the
+ recently modified DAGs first.
+ * ``random_seeded_by_host``: Sort randomly across multiple Schedulers
but with same order on the
+ same host. This is useful when running with Scheduler in HA mode
where each scheduler can
+ parse different DAG files.
+ * ``alphabetical``: Sort by filename
+
+ version_added: 2.0.2
Review comment:
Shouldn't this be 2.1? It feels like a new feature, not a bug fix to me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
