EugeneBad commented on issue #8907: URL: https://github.com/apache/airflow/issues/8907#issuecomment-2568918699
We had a similar experience, but the cause turned out to be the database backend. Airflow makes a database call(s) for most web requests including the admin UI; to fetch static assets. If the database is already slow, then this impact will be cascaded upstream. In our case, we had a long-running DAG with a locking SQL query being run from multiple airflow pods. This left many open connections, and a high DBLoad. AWS RDS' "Performance Insights" makes it easy to assess the database's health, and diagnose such issues. Removing this query restored the UI's performance. Hope this helps someone. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
