GitHub user igorlovich created a discussion: Reparsing of unmodified DAGs
Hello, Would it make sense to have an option on the dag processor to skip unmodified files ? I have seen the issue [21089](https://github.com/apache/airflow/issues/21089) and understand the justification given. In our usecase we have thousands (no real limit but today at around 10000) of DAGs that are static for the majority of the time. At "steady state"' new DAGs are added, existing DAGs are deleted or modified; however this represents a tiny fraction of the total number of DAGs. We have adjusted the min_file_process_interval to be as high as is acceptable but would like to avoid the reparsing of the 99.99% of DAGS that have not changed. What are your thoughts ? GitHub link: https://github.com/apache/airflow/discussions/57049 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
