jedcunningham commented on issue #40516: URL: https://github.com/apache/airflow/issues/40516#issuecomment-2357458615
Let's see. So #28871 attempted to fix the the missing "TaskInstance Finished" log line, and #30872 was a fix of that fix. With that if block from #30872 gone, I'd expect you'll see multiple of those "TaskInstance Finished" log lines. Feels like a race condition between Airflow detecting the "Succeeded" -> deleting it itself and the pod being deleted elsewhere. I'm a little surprised the watcher doesn't see the initial "Succeeded" too though? Maybe the right answer is to, instead, only emit to the `event_buffer` if the task is in `self.running`. As in, don't try to protect against the duplicate events with the if block in `process_status`, but instead in `_change_state` using the running list. @vlieven, can you take a stab at attempting that fix? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
