potiuk commented on issue #21089: URL: https://github.com/apache/airflow/issues/21089#issuecomment-1033861621
This is as intendeed. Alll DAGs are parsed continuously. No matter if they changed or not - simply because re-parsing of the dag at different times can generate a different DAG (for example if the DAG reads an external file and creates DAG structure based on that the DAG might produce a different DAG if the external file changes. Same with importing external libraries. Time of last modification of the DAG only matters for scheduling priority but each DAG will be re-parsed every `min_file_process_interval` seconds. This is how Airlfow works currently. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
