jscheffl commented on issue #41851: URL: https://github.com/apache/airflow/issues/41851#issuecomment-2320689319
I would assume a setup with 3000+ DAGs is nothing that is running w/o special attention in regards of performance. Re-writing the queries of course is possible but also the complexity of data selection might be expensive. Plans are ongoing to re-write the UI and also make async calls in a future Airflow 3, I would not expect a major investment in current Airflow 2.10-line. Some options that might help compensating - as you are already in level of patching code: - Have you attempted to analyze the query and add more resources to the DB to improve queries or add specific indexes? - Do you use DAG level permissions? If not, as you are patching the code, removing the DAG access level filter might be a simple option to improve query -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
