GitHub user potiuk added a comment to the discussion: Facing intermittent issue in DAG
Could be - depend how you do it. If your syncing will DELETE dags to replace them with new ones, and there are periods of time that the dags are missing (even short ones) - yes that might happen. Improve your syncing process in this case so rather than deleting and recreating DAGs you replace them atomically . This is what git-sync does for example - it downloads the dags to folder that it has symbolic link to and after downloading a new copy of DAG folder it swaps the symbolic link to poin to the new directory GitHub link: https://github.com/apache/airflow/discussions/50390#discussioncomment-13120067 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
