notatallshaw-gts commented on issue #25859: URL: https://github.com/apache/airflow/issues/25859#issuecomment-1349096500
Okay, we seem to got to the bottom of how this was being triggered for us, but I don't have any further information of why clearing the task didn't work. Our steps to reproduce: 1. Create a task with https://registry.astronomer.io/providers/astronomer-providers/modules/filesensorasync 2. Provide a filepath that will never be found (this happened because we were using a user macro to generate the filepath, and it turned out we were relying on branching conditions in this user macro, so the filepath that we sent at defer time was not the ultimate filepath that is normally detected) 3. After several hours try to clear task, does not work, where as marking as success did This was all in our prod environment and we didn't see any errors in Scheduler, Triggerer, or Worker logs, we are using Airflow 2.3.4 on Docker with Celery/Redis backend. I am looking to set-up a dev reproduction of our prod environment later today, let me know if there's anything you would like me to check if I can reproduce in dev. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
