Jorricks edited a comment on issue #16023: URL: https://github.com/apache/airflow/issues/16023#issuecomment-876729124
I think the problem is that it shouldn't go through this filter, but it somehow is. https://github.com/apache/airflow/blob/db6acd9e8a91e0eca9e12cace72edc57b2667d25/airflow/jobs/scheduler_job.py#L1185 Makes me wonder a couple of things: 1. what do you have for your [worker_refresh_interval](https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#worker-refresh-interval) in the airflow.cfg? 2. Is it possible you are restarting your webserver frequently or after you started the task? 3. To get to the root cause of the issue (and fix it) it would help if you could provide DEBUG logs of the scheduler while reproducing the issue. Could you please be so kind to provide these when you have the time? 4. If you can't provide the full logs, do you see anything like the following in the logs (note that you should not search for %s as you won't find it) : a. "attempting to adopt pod %s" a. "Failed to adopt pod %s. Reason: %s" b. "attempting to adopt task %s in dag %s which was not specified by database" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
