eladkal commented on issue #11118: URL: https://github.com/apache/airflow/issues/11118#issuecomment-699527148
Airflow doesn't guarantee when tasks will be executed. It only guarantee when they can start. I'm still not sure that I fully understand your suggestion. For your use-case I assume the flow is: TimeWindowSensor - > ExecutingOperator Your safe time as you describe it is: 1PM - 6PM Lets assume that TimeWindowSensor was executed at 1:30PM so it succeeded and downstream branch is good to go But then cluster was under heavy load. The ExecutingOperator started running on 06:10PM. That's not the functionality you are after. From what I can tell the solution for you is to write a combined custom operator-sensor that will check the condition and execute the action. This will also solve issues with retries where 1st attempt was in the timeframe but 2nd is not. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
