vandonr-amz commented on PR #30259: URL: https://github.com/apache/airflow/pull/30259#issuecomment-1481698846
just putting here for the sake of it a little test I did locally, with 100 relatively simple dag files, each have 8 `Variable` calls (maybe you're going to tell me that's excessive and shouldn't be done, but hey, I didn't write those dags). I ran with and without this change, and logged the dag processing time. Having a cache improves the processing time a lot (the first parsing is always slower, I don't know exactly why in the "main" case, I excluded it from the min/max/avg) <img width="621" alt="image" src="https://user-images.githubusercontent.com/114772123/227310977-78c8f4eb-a9cc-4933-9a37-1ce63c30cabe.png";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
![https://user-images.githubusercontent.com/114772123/227310977-78c8f4eb-a9cc-4933-9a37-1ce63c30cabe.png"](https://user-images.githubusercontent.com/114772123/227310977-78c8f4eb-a9cc-4933-9a37-1ce63c30cabe.png"){kind=link}