GitHub user marcosmartinezfco added a comment to the discussion: UI latency pausing DAGs from main /dags page (Airflow 3.1.4, Celery + Docker Compose)
> One of the reasons might also be not upgrading to latest version. 3.1.5 had > some "N+1" dag fixes (too many sql queries generated on dag list page) . What > can also slow down things are huge history in dag files that might slow down > queries (airflow db clean might help) So far `3.1.5` has been the version that better behaves out of the list we tried. Started in `3.1.2` and performance improved significantly after `3.1.3` > You should take a loook at the monitoring of your database, looking at > excessive queries, peaks in resource usage, strange errors - possibly looking > at plans of queries generated by your database and looking for full-table > scans. Generally when database statistics are not updated and cleaned up > regularly, your table stats migh wildy differ from the actual data stored and > database engine might use sub-optimal ways of planning the queries, whihc - > for example -might result in loading all rows to memory instead of just > loading indexes. DB is cleaned fairly often that why I doubt it's a db issue. All metrics in the aws console look healthy and what I would expect GitHub link: https://github.com/apache/airflow/discussions/60847#discussioncomment-15554357 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
