devon-seitz-cirrusmd commented on issue #23700: URL: https://github.com/apache/airflow/issues/23700#issuecomment-1133058423
btw not sure if it helps, but I had a similar issue and what ended up happening was that I had a bad celery worker. Whenever a task got sent to that celery worker it "failed" immediately but did not let the scheduler know so it appeared to be stuck in queue/scheduled even though it had failed due to the worker being the issue. This happened only periodically because the other celery workers were fine, and only this particular one was the issue. I found it by monitoring our flower setup and noticed whenever this particular celery worker got it, it failed 100% of the time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
