MartinKChen commented on issue #19043: URL: https://github.com/apache/airflow/issues/19043#issuecomment-951477335
Just to summarize what I found, not sure if these are bugs or some of them are as it was designed. 1. SmartSensor timeout and terminate itself, which raise TI/DAG fail and false alarm when we monitor for TI/DAG fail. - It should not timeout as long as the smart_sensor_task is still running the loop and poking around. - Even we terminate smart_sensor_task for other reasons, it should be terminated in state success instead of fail. 2. smart_sensor_task should not create a new attempt every time it pick up SIs/TIs. This probably will cause DAG fail when the times of attempts reach retries. 3. Logs missing after smart_sensor_task picked up SIs/TIs. To be more specific, logs within function "_load_sensor_works" after line 358 (v2.0.2), Performance query %s tis, time: %.3f, and after the function are not record. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
