kadubhumika commented on issue #74394: URL: https://github.com/apache/airflow/issues/74394#issuecomment-6096739637
Hi @Jeoffreybauvin @bbovenzi I would love to work on this issue. It looks like the 15+ second delay and 5 GB memory spike when calling /ui/structure/structure_data is caused by an N+1 query pattern or inefficient serialization loop when processing a large number of nodes/edges. I plan to look into airflow/api_fastapi/core_api/routes/ui/structure.py to identify where database queries are executing inside the task loop and optimize it using SQLAlchemy eager loading (joinedload / selectinload) or a bulk pre-fetch strategy. Please assign this issue to me so I can get started on a PR. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
