potiuk commented on issue #35938: URL: https://github.com/apache/airflow/issues/35938#issuecomment-1955253302
There is absolutely no guarantee and expecations that the same resources will be used when you install two versions of app where the new version is much more capable than the other - it would be unreasonable to expect that you can use exactly the same environment and resource expectations will stay the same. So yes if your environment did not change and you install different versions, it's possible that things will work differently or fail to run due to some limitations. And as deployment manager you need to experiment to see what is causing problem and see how to optimize resource usage. There were 7331 commits between these two versions. There were likely several hundred new features added including rewriting a lot of code of UI to use completely different technology. So in short A LOT. My best guess is that you should increase memory for the webserrver. Generally experiment with resources because it's [impossible to foresee](https://airflow.apache.org/docs/apache-airflow/stable/installation/index.html#notes-about-minimum-requirements) it and whenever you deploy any complex applications run on k8s you need to adjust your resources and figure out the best values for your case. I'd suggest continue experimenting increase timeouts first (note that there are two timeouts - worker and master)/ memory - many of similar problems come simply from spike in memory use that causes cache swapping and your application to slow down to a crawll -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
