ashb commented on a change in pull request #11344:
URL: https://github.com/apache/airflow/pull/11344#discussion_r501872025
##########
File path: airflow/jobs/scheduler_job.py
##########
@@ -1741,6 +1730,16 @@ def _run_scheduler_loop(self) -> None:
if not is_unit_test:
time.sleep(self._processor_poll_interval)
+ # Verify that all files were processed, and if so, deactivate DAGs
that
+ # haven't been touched by the scheduler as they likely have been
+ # deleted.
+ if self.processor_agent.all_files_processed:
Review comment:
This is fine on master, but will need updating under a world where
multiple schedulers can coexist.
Would you mind leaving this change out for two reasons: 1. It's a separate
issue to the pr subject 😀 2. To avoid conflicts on scheduler ha which I'm
hopeful to merge today or tomorrow
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
