o-nikolas commented on issue #26725: URL: https://github.com/apache/airflow/issues/26725#issuecomment-1796368628
I looked more deeply into this issue. There actually isn’t a small bug fix here. It’s a fundamental conflict between how the sensor in question works (which is stateful, it needs to keep track of the current keys to compare against future keys in each poke, and in reschedule mode there is no way to do this (cleanly)) and how the debug executor works (which is single threaded and must use reschedule mode for sensors). I think the best course of action is to invest in teaching the Airflow system test mechanism to use other executors than the DebugExecutor. This will solve this problem and allow us to get test coverage for other new executors (ECS executor for an example). But that will be a much bigger task. CC: @shubham22 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
