MatrixManAtYrService commented on issue #18473:
URL: https://github.com/apache/airflow/issues/18473#issuecomment-925904610


   I had filed this issue in the wrong repo previously (oops).  Here's a 
comment about it from @uranusjr :
   
   
   > Hmm, this is some weird inherited design. So airflow dag test triggers 
backfill runs (in this instance one backfill run on start_date) but ignores all 
the scheduling limitations specifies by the DAG. It schedules backfills even 
for a None schedule (which logically never backfills), and ignore start_date, 
end_date, etc. The timetable implementation unified the scheduling logic and 
causes a None schedule to never backfill, and a backfill to never happen 
outside of the DAG and its tasks’ start_date and end_date.
   > 
   > I think we have a design decision to make. We could stick to the current 
logic and change airflow dag test to trigger manual runs instead, but that’s 
affect the behaviour of DAGs that have a schedule since now the backfilled time 
to run more than once (in the previous implementation, if a date was run by 
airflow dag test, the scheduler won’t schedule a backfill at that time again). 
Or we need to add some additional logic to the timetable protocol (and users’ 
custom timetables) to account for this “hey I know this timetable don’t 
schedule backfills during this time but please give me a backfilling schedule 
anyway” logic.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to