msumit opened a new pull request #11462: URL: https://github.com/apache/airflow/pull/11462
As of now, the logic to mark DAGs inactive is out of the `_run_scheduler_loop` which never runs unless `num_runs` is configured, so have to move it inside the `_run_scheduler_loop` method. Also currently, it relies on Scheduler's loop start time to figure out which all DAGs needed to be marked inactive, something which won't work in a Scheduler HA setup, as each Scheduler would be processing a small number of DAGs only. To solve that, I've introduced a timeout config with a default value of 10mins, so a deleted DAG would be visible up to 10mins on UI, but that's better to wrongly mark some active DAGs as inactive or not marking them at all. PS: Will write unit tests if the approach looks good. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
