GitHub user jlangf closed the discussion with a comment: DAGProcessor failing 
to process dag files after an unknown period of time

I don't know the cause of this issue, but a workaround I found that at least 
delays how soon this issue happens is by increasing the following configuration 
value:
`stale_dag_threshold = 1800`

For me this defaulted to 50 (50 seconds).  I increased this to a much higher 
number (10000, over 2 hours), and at least for now this has delayed how soon 
this issue is happening for me.  

Ideally it would be nice to have any associated bugs fixed though.

GitHub link: 
https://github.com/apache/airflow/discussions/54274#discussioncomment-14105165

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to