sunank200 commented on issue #38776: URL: https://github.com/apache/airflow/issues/38776#issuecomment-2135015443
These queries(https://github.com/apache/airflow/blob/main/airflow/www/views.py#L855, https://github.com/apache/airflow/blob/main/airflow/www/views.py#L860, https://github.com/apache/airflow/blob/main/airflow/www/views.py#L866 and so on) run serially as mentioned by @vchiapaikeo. I tried running these locally with 4000 DAGs and it took 1.86 seconds to show the running DAGs. Running these key database queries concurrently in the index method using ThreadPoolExecutor improves the performance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
