uranusjr opened a new pull request, #29625: URL: https://github.com/apache/airflow/pull/29625
`importlib.metadata.distributions()` reads information from the actual installations, which is a lot of IO that we can avoid by caching. The benefit of this depends on how many packages you have in your installation. It’s nearly zero with a bare Airflow installation, and I observed a ~7% save (17s to 16s) for the webserver to finish init (launch until `when_ready` is emitted) in a setup with all official providers installed. The downside is we are now persisting a lot of small objects in memory. I wonder whether there’s a good time we can purge those. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
